GDPval
cdn.openai.com · 8,376 words · saved by 1 readers
N/A
GDP VAL : E VALUATING AI M ODEL P ERFORMANCE ON R EAL -W ORLD E CONOMICALLY VALUABLE TASKS Tejal Patwardhan∗ Rachel Dias∗ Elizabeth Proehl∗ Grace Kim∗ Michele Wang∗ Olivia Watkins∗ Simón Posada Fishman∗ Marwan Aljubeh∗ Phoebe Thacker∗ Laurance Fauconnet Natalie S. Kim Patrick Chao Samuel Miserendino Gildas Chabot David Li Michael Sharman Alexandra Barr Amelia Glaese Jerry Tworek OpenAI A BSTRACT We introduce GDPval, a benchmark evaluating AI model…
related reading
- Measuring the performance of our models on real-world tasks | OpenAIopenai.com
- gpt-4.pdfcdn.openai.com
- Economics and Transformative AI | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- Introducing the Anthropic Economic Index \ Anthropicanthropic.com
- Forecasts of AI & Economic Growth | Tom Cunningham – Tom Cunninghamtecunningham.github.io
- AI Model & API Providers Analysis | Artificial Analysisartificialanalysis.ai
- How close is AI to taking my job? | Epoch AIepoch.ai
- Labor market impacts of AI: A new measure and early evidence \ Anthropicanthropic.com
- w31161.pdfnber.org
- RL Environments and RL for Science: Data Foundries and Multi-Agent Architecturesnewsletter.semianalysis.com
- Scaling Activation Oracles to Trillion-Parameter Modelstransluce.org
- Language Models can Solve Computer Tasksarxiv.org