Whole-History Rating: A Bayesian Rating System for Players of Time-Varying Strength
Whole-History Rating (WHR) is a new method to estimate the time-varying strengths of players involved in paired comparisons. Like many variations of the Elo rating system, the whole-history approach is based on the dynamic Bradley-Terry model. But, instead of using incremental approximations, WHR directly computes the exact maximum a posteriori over the whole rating history of all players. This additional accuracy comes at a higher computational cost than traditional methods, but computation is still fast enough to be easily applied in real time to large-scale game servers (a new game is added in less than 0.001 second). Experiments demonstrate that, in comparison to Elo, Glicko, TrueSkill, and decayed-history algorithms, WHR produces better predictions.
Whole-History Rating: A Bayesian Rating System for Players of Time-Varying Strength Whole-History Rating: A Bayesian Rating System for Players of Time-Varying Strength by Rémi Coulom Abstract Whole-History Rating (WHR) is a new method to estimate the time-varying strengths of players involved in paired comparisons. Like many variations of the Elo rating system, the whole-history approach is based on the dynamic Bradley-Terry model. But, instead of using incremental approximations, WHR directly computes the exact maximum a posteriori over the whole rating history of all players. This additional
saved by
related reading
- AI Chess Leaderboard - dubesor AI projectdubesor.de
- Elo rating system - Wikipediaen.wikipedia.org
- Bradley–Terry model - Wikipediaen.wikipedia.org
- LoRA Without Regret - Thinking Machines Labthinkingmachines.ai
- [2207.00076] Efficient computation of rankings from pairwise comparisonsar5iv.labs.arxiv.org
- Automated Weak-to-Strong Researcheralignment.anthropic.com
- Paper Quality Assessment based on Individual Wisdom Metrics from Open Peer Reviewarxiv.org
- Resorting Media Ratings · Gwern.netgwern.net
- Measuring AI Ability to Complete Long Tasks - METRmetr.org
- Dynamic time warping - Wikipediaen.wikipedia.org
- The Promise of Hierarchical Reinforcement Learningthegradient.pub
- [1710.10044] Distributional Reinforcement Learning with Quantile Regressionarxiv.org