Scoring rule
In decision theory, a scoring rule provides a summary measure for the evaluation of probabilistic predictions or forecasts. It is applicable to tasks in which predictions assign probabilities to events, i.e. one issues a probability distribution
Scoring rule - Wikipedia Jump to content From Wikipedia, the free encyclopedia Measure for evaluating probabilistic forecasts Not to be confused with Score voting . Visualization of the expected score under various predictions from some common scoring functions. Dashed black line: forecaster's true belief, red: linear, orange: spherical, purple: quadratic, green: log. In decision theory , both a scoring rule [ 1 ] as well as a scoring function [ 2 ] provide an ex post summary measure for the evaluation of the quality of a prediction or forecast. They assign a numeric score to a single predicti
Explore this link on the map →related reading
- Scoring rules part 3: Incentivizing precision – Unexpected Valuesericneyman.wordpress.com
- Brier score - Wikipediaen.wikipedia.org
- When pooling forecasts, use the geometric mean of odds — EA Forumforum.effectivealtruism.org
- Gregory Gundersengregorygundersen.com
- Fundamentals of predictionmlstory.org
- Probabilities are not the right concept — LessWronglesswrong.com
- Pitfalls in Evaluating Language Model Forecastersarxiv.org
- Sliced Score Matching: A Scalable Approach to Density and Score Estimation | Yang Songyang-song.github.io
- Generative Modeling by Estimating Gradients of the Data Distribution | Yang Songyang-song.github.io
- Forecasting: Principles and Practice (2nd ed)otexts.com
- Is Capability a Liability? More Capable Language Models Make Worse Forecasts When It Matters Mostarxiv.org
- Classificationfairmlbook.org