Are AI benchmarks doomed? - by Anson Ho and Greg Burnham
In this episode, Greg Burnham and Tom Adamczewski join Anson Ho to push back on benchmark pessimism and dig into what the next generation of AI benchmarks could look like.
Epoch After Hours Are AI benchmarks doomed? In this episode, Greg Burnham and Tom Adamczewski join Anson Ho to push back on benchmark pessimism and dig into what the next generation of AI benchmarks could look like. Anson Ho and Greg Burnham May 01, 2026 16 2 3 Share Greg Burnham leads Epoch’s benchmarking team. Tom Adamczewski is a senior research engineer who develops new benchmarks, including MirrorCode. Topics we cover: why benchmark saturation isn’t as alarming as it seems, how AI can speed up benchmark development, the benchmark-reality gap, whether an AGI benchmark can exist, and the ro
saved by
related reading
- AI researchers debate how close we are to recursive self-improvementyoutube.com
- AI Boom or Bust? – #122youtube.com
- Everyone Is Still Undersizing the AI Market | Eric Vishriayoutube.com
- Why Sam Altman is against a single superintelligenceyoutube.com
- Strange Geometric Shapes Found Inside AIs — Tom McGrathyoutube.com
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- Does AI Progress Have a Speed Limit?—Asteriskasteriskmag.com
- AI progress is about to speed up | Epoch AIepoch.ai
- What will be left for us to work on?normaltech.ai
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- On measuring AInikilravi.substack.com
- RIP Classic Reasoning Benchmarks. What’s Next?epochai.substack.com