2026 ACL Workshop on Evaluating AI in Practice | EvalEval Coalition

This workshop focuses on AI evaluation in practice, centering the tensions and collaborations between model developers and evaluation researchers and aims to surface practical insights from across the evaluation ecosystem.

Update: We are excited to meet you in San Diego! Save the date: on 03/July/2026 around 8pm, we will co-host a Social together with the GEM workshop . Both of our workshops will then be on the day after. 🗓️ Schedule 04/July/2026 Afternoon 👋 2:00 PM – 2:05 PM | Welcome and Introduction (5 mins) Jennifer Mickel , EvalEval Workshop Co-Chair 🎙️ 2:05 PM – 2:45 PM | Panel Presentation (30 mins panel + 10 mins Q&A) Moderator: Leshem Choshen, MIT, IBM Research, MIT-IBM Watson AI Lab This panel brings together model developers and evaluation researchers to examine how evaluations are designed, interp

related reading

• 9th Workshop on Visualization for AI Explainabilityvisxai.io
• Schedule · AI Engineer World's Fair 2026ai.engineer
• pdfopenreview.net
• blog | ICLR Blogposts 2026iclr-blogposts.github.io
• The Science of Physical AI Safety — CoRL 2026spais-ws.org
• Seoul Alignment Workshop 2026: What We Learnedfar.ai
• [2411.00640] Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluationsarxiv.org
• Agent Evaluation: A Detailed Guidecameronrwolfe.substack.com
• [2408.02565] Reasons to Doubt the Impact of AI Risk Evaluationsarxiv.org
• The Curve 2026thecurve.goldengateinstitute.org
• Research Areas in Benchmark Design and Evaluation (The Alignment Project by UK AISI) — AI Alignment Forumalignmentforum.org
• Challenges in evaluating AI systems \ Anthropicanthropic.com