✳flâneur — a map of the web's best reading

Some Thoughts On Harvey's Launch of 'LAB,' An Open-Source, Long-Horizon Benchmark for Legal AI Agents | LawSites

lawnext.com · 1,240 words · saved by 1 readers

Harvey, the legal AI company whose valuation recently hit $11 billion, recently released what it is calling the Legal Agent Benchmark, or LAB — an open-source evaluation framework designed to measure...

Harvey, the legal AI company whose valuation recently hit $11 billion , recently released what it is calling the Legal Agent Benchmark, or LAB — an open-source evaluation framework designed to measure how well AI agents can perform extended, real-world legal work rather than the discrete reasoning tasks that have dominated legal AI benchmarks to date. Announced May 6 in a post by Harvey researchers Niko Grupen , Gabe Pereyra (Harvey’s cofounder), and Julio Pereyra , the first version of LAB contains more than 1,200 tasks spanning 24 legal practice areas, graded against more than 75,000 e

Explore this link on the map →

related reading