[2411.12925] Loss-to-Loss Prediction: Scaling Laws for All Datasets
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack
[2411.12925] Loss-to-Loss Prediction: Scaling Laws for All Datasets Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Machine Learning arXiv:2411.12925 (cs) [Submitted on 19 Nov 2024] Title: Loss-to-Loss Prediction: Scaling Laws for All Datasets Authors: David Brandfonbrener , Nikhil Anand , Nikhil Vyas , Eran Malach , Sham Kakade View a PDF of the paper titled Loss-to-Loss Prediction: Scaling Laws for All Datasets, by David Brandfonbrener and 4 other authors View PDF HTML (experimen
Explore this link on the map →related reading
- Scaling Laws, Carefully | Lil'Loglilianweng.github.io
- Scaling laws literature review | Epoch AIepochai.org
- On neural scaling and the quanta hypothesisericjmichaud.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Demystify Transformers: A Guide to Scaling Laws | by Yu-Cheng Tsai | Sage Ai | Mediummedium.com
- RL Scaling Laws for LLMs - by Cameron R. Wolfe, Ph.D.cameronrwolfe.substack.com
- Fermi estimate of future training runsdanieldewey.net
- [2001.08361] Scaling Laws for Neural Language Modelsarxiv.org
- The Little Book of Deep Learningfleuret.org
- New Scaling Laws for Large Language Models — LessWronglesswrong.com
- [2602.05970] Inverse Depth Scaling From Most Layers Being Similararxiv.org
- [2405.10938] Observational Scaling Laws and the Predictability of Language Model Performancearxiv.org