Competing with sampling — Alignment Research Center
In 2025, ARC has been making conceptual and theoretical progress at the fastest pace that I've seen since I first interned in 2022. Most of this progress has come about because of a re-orientation around a more specific goal: outperforming random sampling when it comes to understanding neural
In 2025, ARC has been making conceptual and theoretical progress at the fastest pace that I've seen since I first interned in 2022. Most of this progress has come about because of a re-orientation around a more specific goal: outperforming random sampling when it comes to understanding neural network outputs. Compared to our previous goals, this goal has the advantage of being more concrete and more directly tied to useful applications. The purpose of this post is to: Explain and motivate our "outperforming sampling" agenda from the standpoint of preventing catastrophic AI misalignment. Introd
Explore this link on the map →saved by
related reading
- ARC progress update: Competing with sampling — LessWronglesswrong.com
- AlgZoo: uninterpreted models with fewer than 1,500 parameters — LessWronglesswrong.com
- A Mike's-Eye View of ARC's Research — Alignment Research Centeralignment.org
- Fact Finding: Attempting to Reverse-Engineer Factual Recall on the Neuron Level (Post 1) — AI Alignment Forumalignmentforum.org
- arxiv.org/pdf/1805.08522arxiv.org
- [2605.05179] Estimating the expected output of wide random MLPs more efficiently than samplingarxiv.org
- Announcing the ARC White-Box Estimation Challenge — LessWronglesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Research update: Towards a Law of Iterated Expectations for Heuristic Estimators — Alignment Research Centeralignment.org
- A Pragmatic Vision for Interpretability — AI Alignment Forumalignmentforum.org
- Formal verification, heuristic explanations and surprise accounting — Alignment Research Centeralignment.org
- Obstacles in ARC's agenda: Finding explanations — LessWronglesswrong.com