Majority-of-Three: The Simplest Optimal Learner?
Developing an optimal PAC learning algorithm in the realizable setting, where empirical risk minimization (ERM) is suboptimal, was a major open problem in learning theory for decades. The problem w...
[edit] Proceedings of Thirty Seventh Conference on Learning Theory, PMLR 247:22-45, 2024. Abstract Developing an optimal PAC learning algorithm in the realizable setting, where empirical risk minimization (ERM) is suboptimal, was a major open problem in learning theory for decades. The problem was finally resolved by Hanneke a few years ago. Unfortunately, Hanneke’s algorithm is quite complex as it returns the majority vote of many ERM classifiers that are trained on carefully selected subsets of the data. It is thus a natural goal to determine the simplest algorithm that is optimal. In…
saved by
related reading
- [2407.19777] Revisiting Agnostic PAC Learningarxiv.org
- catoni_draft2.pdfocatoni.perso.math.cnrs.fr
- Kearns-Vairani-1994-Introduction-to-Computational-Learning-Thoery-Ch01.pdfjeffreyheinz.net
- A Course in Machine Learningciml.info
- understanding-machine-learning-theory-algorithms.pdfcs.huji.ac.il
- Competing with sampling — Alignment Research Centeralignment.org
- course_stat_rl.pdfmit.edu
- [1906.01820] Risks from Learned Optimization in Advanced Machine Learning Systemsarxiv.org
- deeplearningbook.org/contents/ml.htmldeeplearningbook.org
- [arxiv] an algorithmic framework for fairness elicitationarxiv.org
- ARC progress update: Competing with sampling — LessWronglesswrong.com
- On-Demand Sampling: Learning Optimally from Multiple DistributionsAuthors are ordered alphabetically. Correspondence to eric.zh@berkeley.edu.arxiv.org