Inference Scaling Reshapes AI Governance — Toby Ord
The shift from scaling up the pre-training compute of AI systems to scaling up their inference compute may have profound effects on AI governance. The nature of these effects depends crucially on whether this new inference compute will primarily be used during external deployment or as part of a mor
Inference Scaling Reshapes AI Governance February 12, 2025 Toby Ord The shift from scaling up the pre-training compute of AI systems to scaling up their inference compute may have profound effects on AI governance. The nature of these effects depends crucially on whether this new inference compute will primarily be used during external deployment or as part of a more complex training programme within the lab. Rapid scaling of inference-at-deployment would: lower the importance of open-weight models (and of securing the weights of closed models), reduce the impact of the first human-level model
Explore this link on the map →related reading
- How Well Does RL Scale? - Toby Ordtobyord.com
- AI 2027ai-2027.com
- My picture of the present in AI — LessWronglesswrong.com
- AI in 2025: gestalt — LessWronglesswrong.com
- The Scaling Hypothesis · Gwern.netgwern.net
- Distinguish between inference scaling and "larger tasks use more compute" — AI Alignment Forumalignmentforum.org
- Trading off compute in training and inference | Epoch AIepochai.org
- Questions about the Future of AI - by Dwarkesh Pateldwarkesh.com
- Computing Power and the Governance of AI | GovAIgovernance.ai
- AI progress is about to speed up | Epoch AIepoch.ai
- Dario Amodei — "We are near the end of the exponential"dwarkesh.com
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai