A starter guide for evals — AI Alignment Forum
This is a starter guide for model evaluations (evals). Our goal is to provide a general overview of what evals are, what skills are helpful for evalu…
x A starter guide for evals — AI Alignment Forum AI Alignment Intro Materials AI Evaluations Apollo Research (org) AI Frontpage 26 A starter guide for evals by Marius Hobbhahn , Jérémy Scheurer , Mikita Balesni , rusheb , Alex Meinke 8th Jan 2024 Linkpost for www.apolloresearch.ai 14 min read 2 26 This is a starter guide for model evaluations (evals). Our goal is to provide a general overview of what evals are, what skills are helpful for evaluators, potential career trajectories, and possible ways to start in the field of evals. Evals is a nascent field, so many of the following recommendatio
Explore this link on the map →related reading
- A starter guide for evals — LessWronglesswrong.com
- Demystifying evals for AI agents \ Anthropicanthropic.com
- Your Evals Will Break and You Won't See It Coming - Lun Wangwanglun1996.github.io
- Your AI Product Needs Evals – Hamel's Blog - Hamel Husainhamel.dev
- The bitter lesson of LLM evalsparsed.com
- A statistical approach to model evaluations \ Anthropicanthropic.com
- We Need A ‘Science of Evals’ – Apollo Researchapolloresearch.ai
- We need a Science of Evals — AI Alignment Forumalignmentforum.org
- Chapter 3: LLM Evaluations - ARENAlearn.arena.education
- Model evals for dangerous capabilities — LessWronglesswrong.com
- LLM evaluation: a beginner's guideevidentlyai.com
- A pragmatic guide to LLM evals for devsnewsletter.pragmaticengineer.com