Chinchilla
arxiv.org · 6,259 words · saved by 1 readers
N/A
Training Compute-Optimal Large Language Models Jordan Hoffmann★, Sebastian Borgeaud★, Arthur Mensch★, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, Tom Hennigan, Eric Noland, Katie Millican, George van den Driessche, Bogdan Damoc, Aurelia Guy, Simon Osindero, Karen Simonyan, Erich Elsen, Jack W. Rae, Oriol Vinyals and Laurent…
saved by
related reading
- [2203.15556] Training Compute-Optimal Large Language Modelsarxiv.org
- Large Language Diffusion Modelsarxiv.org
- Training a compute-optimal gpt2-small – Tomek Korbak — personal homepagetomekkorbak.com
- chinchilla's wild implications — LessWronglesswrong.com
- LoRA Without Regret - Thinking Machines Labthinkingmachines.ai
- [2510.03280] Training Optimal Large Diffusion Language Modelsar5iv.labs.arxiv.org
- chinchilla's wild implications — AI Alignment Forumalignmentforum.org
- Scaling Laws, Carefully | Lil'Loglilianweng.github.io
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
- IsoFLOP curves of large language models are extremely flatseverelytheoretical.wordpress.com
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- Publications — Google DeepMinddeepmind.com