Resorting Media Ratings · Gwern.net
gwern.net · 4,929 words · saved by 1 readers
Commandline tool providing interactive statistical pairwise ranking and sorting of items
--- title: Resorting Media Ratings description: Commandline tool providing interactive statistical pairwise ranking and sorting of items created: 2015-09-07 modified: 2018-08-15 status: finished confidence: likely importance: 3 css-extension: dropcaps-yinit ... > User-created datasets using ordinal scales (such as media ratings) have tendencies to drift or 'clump' towards the extremes and fail to be informative as possible, falling prey to ceiling effects and making it difficult to distinguish between the mediocre & excellent. > > This can be counteracted by rerating the dataset to create a un
related reading
- How Not To Sort By Average Rating – Evan Millerevanmiller.org
- Bradley–Terry model - Wikipediaen.wikipedia.org
- [2207.00076] Efficient computation of rankings from pairwise comparisonsar5iv.labs.arxiv.org
- 95%-ile isn't that gooddanluu.com
- Papers · Nikhil Garggargnikhil.com
- Note ranking algorithmcommunitynotes.twitter.com
- Robot Rankingsrobotsguide.com
- Ranking Questions: Dos and Don'ts - Qualtricsqualtrics.com
- A statistical approach to model evaluations \ Anthropicanthropic.com
- Elo rating system - Wikipediaen.wikipedia.org
- A better ranking algorithm – Herman's blogherman.bearblog.dev
- Anthropic/values-in-the-wild · Datasets at Hugging Facehuggingface.co