[2412.00543] Evaluating the Consistency of LLM Evaluators
Abstract:Large language models (LLMs) have shown potential as general evaluators along with the evident benefits of speed and cost. While their correlation against human annotators has been widely studied, consistency as evaluators is still understudied, raising concerns about the reliability of LLM evaluators. In this paper, we conduct extensive studies on the two aspects of consistency in LLM evaluations, Self-Consistency (SC) and Inter-scale Consistency (IC), on different scoring scales and criterion granularity with open-source and proprietary models. Our comprehensive analysis demonstrates that strong proprietary models are not necessarily consistent evaluators, highlighting the importance of considering consistency in assessing the capability of LLM evaluators.
Evaluating the Consistency of LLM Evaluators Noah Lee∗ Jiwoo Hong∗ James Thorne KAIST AI {noah.lee, jiwoo_hong, thorne}@kaist.ac.kr Abstract 2024; Li et al., 2024). However, the consistency of…
saved by
related reading
- Applying Statistics to LLM Evaluationscameronrwolfe.substack.com
- [2411.00640] Adding Error Bars to Evals: A Statistical Approach to Language Model Evaluationsarxiv.org
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org
- [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
- Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
- [2506.13023] A Practical Guide for Evaluating LLMs and LLM-Reliant Systemsarxiv.org
- [2506.17209] Fine-Tuning Lowers Safety and Disrupts Evaluation Consistencyarxiv.org
- Position: It's Time to Optimize for Self-Consistencytime-for-consistency.github.io
- Large Language Models Must Be Taught to Know What They Don't Knowarxiv.org
- Pitfalls in Evaluating Language Model Forecastersarxiv.org
- LLM Evaluation doesn't need to be complicatedphilschmid.de
- [2303.17548] Whose Opinions Do Language Models Reflect?arxiv.org