Some Thoughts On Harvey's Launch of 'LAB,' An Open-Source, Long-Horizon Benchmark for Legal AI Agents | LawSites
Harvey, the legal AI company whose valuation recently hit $11 billion, recently released what it is calling the Legal Agent Benchmark, or LAB — an open-source evaluation framework designed to measure...
Harvey, the legal AI company whose valuation recently hit $11 billion , recently released what it is calling the Legal Agent Benchmark, or LAB — an open-source evaluation framework designed to measure how well AI agents can perform extended, real-world legal work rather than the discrete reasoning tasks that have dominated legal AI benchmarks to date. Announced May 6 in a post by Harvey researchers Niko Grupen , Gabe Pereyra (Harvey’s cofounder), and Julio Pereyra , the first version of LAB contains more than 1,200 tasks spanning 24 legal practice areas, graded against more than 75,000 e
related reading
- Training a State-of-the-Art Legal Agent with Harvey | Applied Computeappliedcompute.com
- Harvey – Professional Class AIharvey.ai
- Gabe Pereyra on X: "Model strategy for @harvey: We are working on the first model in our legal foundation model series, inspired by @cursor_ai's Composer. Two goals: 1. Allow us to serve frontier intelligence across our product surface areas at an affordable price and a strong security posture." / Xx.com
- Customizing models for legal professionals | OpenAIopenai.com
- Understanding a Law Firm through Studyengram.com
- Your AI Product Needs Evals – Hamel's Blog - Hamel Husainhamel.dev
- Harvey’s Momentum in Q3 | Harveyharvey.ai
- Crosby: The Inner Workings of a Neofirm — New Ontologiesnew-ontologies.com
- Senior SWE-Benchsenior-swe-bench.snorkel.ai
- Building Spectre: Internal Collaborative Cloud Agent Platform | Harveyharvey.ai
- Robocurve — Real-world evaluations of physical AIrobocurve.org
- EdgeBench | Scaling Laws of Environment Learningedge-bench.org