2404.10102v1
arxiv.org · 4,890 words · saved by 1 readers
N/A
Chinchilla Scaling: A replication attempt Tamay Besiroglu Ege Erdil Matthew Barnett Josh You Epoch AI April 17, 2024 Abstract scaled equally: for every doubling of model size the…
saved by
related reading
- Scaling Laws, Carefully | Lil'Loglilianweng.github.io
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
- Scaling is subtler than it seemsberen.io
- Chinchillaarxiv.org
- [2509.14786] Pre-training under infinite computearxiv.org
- [2510.03280] Training Optimal Large Diffusion Language Modelsar5iv.labs.arxiv.org
- [1706.04599] On Calibration of Modern Neural Networksarxiv.org
- IsoCompute Playbook: Optimally Scaling Sampling Compute for RL Training of LLMscompute-optimal-rl-llm-scaling.github.io
- [2602.05970] Inverse Depth Scaling From Most Layers Being Similararxiv.org
- Pre-training under infinite computearxiv.org
- [2605.12715] Scaling Laws for Mixture Pretraining Under Data Constraintsarxiv.org
- Demystify Transformers: A Guide to Scaling Laws | by Yu-Cheng Tsai | Sage Ai | Mediummedium.com