PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play
We introduce PopuLoRA, a population-based asymmetric self-play framework for reinforcement learning with verifiable rewards (RLVR) post-training of LLMs.
PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play PopuLoRA: Co-Evolving LLM Populations for Reasoning Self-Play Authors Roger Creus Castanyer, Geoffrey Bradway, Lorenz Wolf, Maxwill Lin, Augustine N. Mavor-Parker, Matthew James Sargent Description We introduce PopuLoRA, a population-based asymmetric self-play framework for reinforcement learning with verifiable rewards (RLVR) post-training of LLMs. External Link https://arxiv.org/abs/2605.16727v1 Date May 20, 2026 Affiliations Vmax Reinforcement learning with verifiable rewards (RLVR) gives large language models (LLMs; hereafter,
saved by
related reading
- You Only Need Minimal RLVR Training: Extrapolating LLMs via Rank-1 Trajectoriesarxiv.org
- LoRA Without Regret - Thinking Machines Labthinkingmachines.ai
- State of RL for reasoning LLMs | A. Weersaweers.de
- LLM Powered Autonomous Agents | Lil'Loglilianweng.github.io
- [2507.19457] GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningarxiv.org
- [2106.09685] LoRA: Low-Rank Adaptation of Large Language Modelsarxiv.org
- Reasoning in General Domains without Verifiersarxiv.org
- RLHF | John Lambertjohnwlambert.github.io
- PPO for LLMs: A Guide for Normal Peoplecameronrwolfe.substack.com
- GRPO++: Tricks for Making RL Actually Workcameronrwolfe.substack.com
- [2602.19362] LLMs Can Learn to Reason Via Off-Policy RLarxiv.org
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org