✳flâneur — a map of the web's best reading

Tasks – Inspect

inspect.aisi.org.uk · 3,984 words · saved by 1 readers

This article documents both basic and advanced use of Inspect tasks, which are the fundamental unit of integration for datasets, solvers, and scorers. The following topics are explored: Tasks provide a recipe for an evaluation consisting minimally of a dataset, a solver, and a scorer (and possibly other options) and is returned from a function decorated with @task. For example: For convenience, tasks always define a default solver. That said, it is often desirable to design tasks that can work with any solver so that you can experiment with different strategies. The Solvers section below goes into depth on how to create tasks that can be flexibly used with any solver. While many tasks can be defined with only a dataset, solver, and scorer, there are lots of other useful Task options. We won’t describe these options in depth here, but rather provide a list along with links to other sections of the documentation that cover their usage: You by and large don’t need to worry about these opt

Tasks – Inspect Overview This article documents both basic and advanced use of Inspect tasks, which are the fundamental unit of integration for datasets, solvers, and scorers. The following topics are explored: Task Basics describes the core components and options of tasks. Parameters covers adding parameters to tasks to make them flexible and adaptable. Solvers describes how to create tasks that can be used with many different solvers. Task Reuse documents how to flexibly derive new tasks from existing task definitions. Configuration explains how to override task options at runtime with task_

Explore this link on the map →

related reading