flâneur

UKGovernmentBEIS/inspect_ai: Inspect: A framework for large language model evaluations ·

github.com · 400 words · saved by 1 readers

Inspect: A framework for large language model evaluations

Welcome to Inspect, a framework for large language model evaluations created by the UK AI Security Institute . Inspect provides many built-in components, including facilities for prompt engineering, tool usage, multi-turn dialog, and model graded evaluations. Extensions to Inspect (e.g. to support new elicitation and scoring techniques) can be provided by other Python packages. To get started with Inspect, please see the documentation at https://inspect.aisi.org.uk/ . Inspect also includes a collection of over 200 pre-built evaluations ready to run on any model (learn more at https://inspect.a

related reading