RL Scaling Laws for LLMs - by Cameron R. Wolfe, Ph.D.

How scaling laws have evolved from pretraining to reinforcement learning...

RL Scaling Laws for LLMs How scaling laws have evolved from pretraining to reinforcement learning... Cameron R. Wolfe, Ph.D. Apr 20, 2026 129 17 Share (from [1, 2, 3]) Scaling is one of the most impactful concepts in the history of AI research. For large language models (LLMs), scaling has mostly been studied in the context of pretraining, where rigorous scaling laws have allowed us to clearly define the relationship between compute and performance. Inspired by these predictable trends, the LLM research community has empirically validated pretraining scaling laws across several orders of magni

saved by

• Ishaan Panigrahi

related reading

• State of RL for reasoning LLMs | A. Weersaweers.de
• Scaling is subtler than it seemsberen.io
• How can LLM RL Work Despite Information-Theoretic Inefficiencyberen.io
• Scaling Laws, Carefully | Lil'Loglilianweng.github.io
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• Lil'Loglilianweng.github.io
• IsoCompute Playbook: Optimally Scaling Sampling Compute for RL Training of LLMscompute-optimal-rl-llm-scaling.github.io
• The Extreme Inefficiency of RL for Frontier Models - Toby Ordtobyord.com
• The Scaling Hypothesis · Gwern.netgwern.net
• Scaling Laws for Value-Based RLvalue-scaling.github.io
• Q-learning is not yet scalableseohong.me
• The Art of Scaling Reinforcement Learning for LLMs | Sean Bell, ResolveAI Labsyoutube.com