How close is AI to taking my job? | Epoch AI
epoch.ai · 5,133 words · saved by 1 readers
Beyond benchmarks as leading indicators for task automation
How close is AI to taking my job? | Epoch AI Gradient Updates shares more opinionated or informal takes on big questions in AI progress. These posts solely represent the views of the authors, and do not necessarily reflect the views of Epoch AI as a whole. I. Searching under the streetlight How can we anticipate when AI will be able to do our jobs? AI researchers have mainly tried to answer this question by building complex AI benchmarks. The problem is that this approach is fundamentally flawed. A good example of this is OpenAI’s GDPval . On paper, it’s a cool benchmark that captures AI perfo
related reading
- After Automation | Everyevery.to
- When AI builds itself \ Anthropicanthropic.com
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- Measuring AI Ability to Complete Long Tasks - METRmetr.org
- Are AI benchmarks doomed? - by Anson Ho and Greg Burnhamepochai.substack.com
- Introducing the Anthropic Economic Index \ Anthropicanthropic.com
- Measuring AI Ability to Complete Long Software Tasksarxiv.org
- Clarifying and predicting AGI — LessWronglesswrong.com
- Where’s my ten minute AGI?epochai.substack.com
- Something Big Is Happening - matt shumershumer.dev
- My picture of the present in AI — LessWronglesswrong.com
- Scenarios for our Economic Futureanthropic.com