2404.10102v1
arxiv.org · 4,890 words · saved by 1 readers
N/A
Chinchilla Scaling: A replication attempt Tamay Besiroglu Ege Erdil Matthew Barnett Josh You Epoch AI April 17, 2024 Abstract scaled equally: for every doubling of model size the…
saved by
related reading
- Scaling Laws, Carefully | Lil'Loglilianweng.github.io
- Demystify Transformers: A Guide to Scaling Laws | by Yu-Cheng Tsai | Sage Ai | Mediummedium.com
- On neural scaling and the quanta hypothesisericjmichaud.com
- Chinchillaarxiv.org
- New Scaling Laws for Large Language Models — LessWronglesswrong.com
- How To Scale Your Modeljax-ml.github.io
- Fermi estimate of future training runsdanieldewey.net
- The Scaling Hypothesis · Gwern.netgwern.net
- Scaling Laws That Extrapolate 300× Past the Fitopenathena.ai
- Scaling is subtler than it seemsberen.io
- Training a compute-optimal gpt2-small – Tomek Korbak — personal homepagetomekkorbak.com
- IsoFLOP curves of large language models are extremely flatseverelytheoretical.wordpress.com