will depue on X: "A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data. At the foundation of the scaling" / X
A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data. At the foundation of the scaling
will depue @willdepue A Stargate for Data Labs are on a trajectory towards >$100B/year of data spend by 2030. As we begin the trillion-dollar compute project, we need to think about the equivalent civilizational-scale effort for the other core ingredient: data. At the foundation of the scaling revolution is a simple empirical law: deep neural networks improve smoothly, near magically, as you scale two things in proportion — (1) the size of the model and (2) the amount of data you train on. And despite the scaling laws being brutally diminishing, we’ve successfully bitten the bullet of logarith
Explore this link on the map →related reading
- A Stargate for Data - by willdepue - Will DePuewilldepue.substack.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
- State of Data (Jan 2026)seancai.com
- AI Is Slowing Downwheresyoured.at
- AI progress is about to speed up | Epoch AIepoch.ai
- The Scaling Hypothesis · Gwern.netgwern.net
- The Moon Should Be a Computerpalladiummag.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- A World of Verifiable Domainsseancai.com