✳flâneur — a map of the web's best reading
How close is AI to taking my job? | Epoch AI
epoch.ai · 5,133 words · saved by 1 readers
Beyond benchmarks as leading indicators for task automation
How close is AI to taking my job? | Epoch AI Gradient Updates shares more opinionated or informal takes on big questions in AI progress. These posts solely represent the views of the authors, and do not necessarily reflect the views of Epoch AI as a whole. I. Searching under the streetlight How can we anticipate when AI will be able to do our jobs? AI researchers have mainly tried to answer this question by building complex AI benchmarks. The problem is that this approach is fundamentally flawed. A good example of this is OpenAI’s GDPval . On paper, it’s a cool benchmark that captures AI perfo
Explore this link on the map →related reading
- After Automation | Everyevery.to
- When AI builds itself \ Anthropicanthropic.com
- Measuring AI Ability to Complete Long Tasks - METRmetr.org
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- Introducing the Anthropic Economic Index \ Anthropicanthropic.com
- Are AI benchmarks doomed? - by Anson Ho and Greg Burnhamepochai.substack.com
- My picture of the present in AI — LessWronglesswrong.com
- Clarifying and predicting AGI — LessWronglesswrong.com
- Something Big Is Happening - matt shumershumer.dev
- AI progress is about to speed up | Epoch AIepoch.ai
- Measuring the performance of our models on real-world tasks | OpenAIopenai.com
- AI #100: Meet the New Boss | Don't Worry About the Vasethezvi.wordpress.com