Growing or Compressing Datasets · Introduction to Data-Centric AI
dcai.csail.mit.edu · 1,826 words · saved by 1 readers
Learn cost-effective ways to grow datasets and cost-effective ways to train models on large datasets.
Growing or Compressing Datasets · Introduction to Data-Centric AI Growing or Compressing Datasets Slides: [ pdf , pptx ] For supervised learning applications where training data have been annotated by humans, labeling is time-consuming and expensive. This lecture focuses on ways to more carefully select what examples to label and reduce the labeling burden of creating modern ML systems. Specifically, we look at the following approaches: Active learning as a way to intelligently select examples to label and grow datasets Core-set selection to compress datasets down to a representative su
related reading
- Learning with not Enough Data Part 2: Active Learninglilianweng.github.io
- Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io
- Why you need to improve your training data, and how to do it << Pete Warden's blogpetewarden.com
- Scaling Laws, Carefully | Lil'Loglilianweng.github.io
- Semi-Supervised Learning: Techniques & Examples [2024]v7labs.com
- DataRater: Meta-Learned Dataset Curationarxiv.org
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai
- Efficiently Learning at Test-Time: Active Fine-Tuning of LLMsarxiv.org
- The Little Book of Deep Learningfleuret.org
- An Overview of Deep Semi-Supervised Learningarxiv.org
- Dataset list - A list of the biggest machine learning datasetsdatasetlist.com
- MAI-Thinking-1: Building a Hill-Climbing Machinemicrosoft.ai