Thinking about High-Quality Human Data | Lil'Log

[Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper “Vox populi”) and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes from human annotation, such as classification task or RLHF labeling (which can be constructed as classification format) for LLM alignment training. Lots of ML techniques in the post can help with data quality, but fundamentally human data collection involves attention to details and careful execution. The community knows the value of high quality data, but somehow we have this subtle impression that “Everyone wants to do the model work, not the data work” (Sambasivan et al. 2021). Collecting human data involve a set of operation steps and every step contributes to the data quality: Vox populi (originally “Vox populi, vox Dei”), a Latin phrase, means the voice of people. A short paper named was the same name was published in 1907 on N

Table of Contents Human Raters ↔ Data Quality The Wisdom of the Crowd Rater Agreement Rater Disagreement & Two Paradigms Data Quality ↔ Model Training Influence Functions Prediction Changes during Training Noisy Cross-Validation Citation References [Special thank you to Ian Kivlichan for many useful pointers (E.g. the 100+ year old Nature paper "Vox populi") and nice feedback. 🙏 ] High-quality data is the fuel for modern data deep learning model training. Most of the task-specific labeled data comes from human annotation, such as classification task or RLHF labeling (which can be constructed

saved by

• Winnie Xu
• Samuel Lo
• KL Yap
• Dhruv Gautam
• Al-Ekram Elahee Hridoy

related reading

• Lil'Loglilianweng.github.io
• Illustrating Reinforcement Learning from Human Feedback (RLHF)huggingface.co
• RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
• Why you need to improve your training data, and how to do it << Pete Warden&#039;s blogpetewarden.com
• DataRater: Meta-Learned Dataset Curationarxiv.org
• [1706.04599] On Calibration of Modern Neural Networksarxiv.org
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc
• [2606.06614] Re-Centering Humans in LLM Personalizationarxiv.org
• A Bitter Lesson for Data Filteringarxiv.org
• A History of Large Language Modelsgregorygundersen.com
• [2303.17548] Whose Opinions Do Language Models Reflect?arxiv.org