EconEvals: Benchmarks and Litmus Tests for LLM Agents in Unknown Environments

N/A

EconEvals: Benchmarks and Litmus Tests for Economic Decision-Making by LLM Agents∗ Sara Fish Julia Shephard† Minkai Li† Harvard University Harvard University Harvard University arXiv:2503.18825v4 [cs.AI] 18 Feb 2026 Ran Shorrer Yannai A. Gonczarowski…

related reading

• [2503.18825] EconEvals: Benchmarks and Litmus Tests for Economic Decision-Making by LLM Agentsarxiv.org
• [2602.09514] EcoGym: Evaluating LLMs for Long-Horizon Plan-and-Execute in Interactive Economiesarxiv.org
• Agent Evaluation: A Detailed Guidecameronrwolfe.substack.com
• [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
• [2412.00543] Evaluating the Consistency of LLM Evaluatorsarxiv.org
• Evaluation-Conditioned Training: Teaching Models to Generalize to Stronger Oversight Regimesarxiv.org
• [2411.00640] Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluationsarxiv.org
• Language Models can Solve Computer Tasksarxiv.org
• Pitfalls in Evaluating Language Model Forecastersarxiv.org
• [2506.13023] A Practical Guide for Evaluating LLMs and LLM-Reliant Systemsarxiv.org
• [2605.21739] AttuneBench: A Conversation-Based Benchmark for LLM Emotional Intelligencearxiv.org