Brier score
The Brier score is a strictly proper scoring rule that measures the accuracy of probabilistic predictions. For unidimensional predictions, it is strictly equivalent to the mean squared error as applied to predicted probabilities.
Brier score - Wikipedia Jump to content From Wikipedia, the free encyclopedia Measure of the accuracy of probabilistic predictions The Brier score is a strictly proper scoring rule that measures the accuracy of probabilistic predictions . For unidimensional predictions, it is strictly equivalent to the mean squared error as applied to predicted probabilities. The Brier score is applicable to tasks in which predictions must assign probabilities to a set of mutually exclusive discrete outcomes or classes. The set of possible outcomes can be either binary or categorical in nature, and the probabi
related reading
- Gneiting2007jasa.pdfsites.stat.washington.edu
- Scoring rule - Wikipediaen.wikipedia.org
- Bradley–Terry model - Wikipediaen.wikipedia.org
- Scoring rules part 3: Incentivizing precision – Unexpected Valuesericneyman.wordpress.com
- Berkson's paradox - Wikipediaen.wikipedia.org
- A Technical Explanation of Technical Explanation – Eliezer S. Yudkowskyyudkowsky.net
- Pitfalls in Evaluating Language Model Forecastersarxiv.org
- Precision and recallen.wikipedia.org
- Interpretations of Probability (Stanford Encyclopedia of Philosophy)plato.stanford.edu
- 1406.2148arxiv.org
- Bayes' rule — LessWrongarbital.com
- When pooling forecasts, use the geometric mean of odds — EA Forumforum.effectivealtruism.org