boosting, nearest neighbour classification
people.eecs.berkeley.edu · 2,654 words · saved by 1 readers
N/A
Boosting; Nearest Neighbor Classification 147 24 Boosting; Nearest Neighbor Classification ADABOOST (Yoav Freund and Robert Schapire, 1997) AdaBoost (“adaptive boosting”) is an ensemble method for classification (or regression) that – reduces bias [compare with random forests and other ensembles, which reduce variance]; – trains learners on weighted sample points [like bagging]; – uses di↵erent weights for each learner; – increases weights of misclassified training points; – gives bigger votes to more accurate learners. Input: n ⇥ d…
related reading
- AdaBoost.pdfcs.toronto.edu
- The Success of AdaBoost and Its Application in Portfolio Management.pdfarxiv.org
- Random forest - Wikipediaen.wikipedia.org
- Ensemble learning - Wikipediaen.wikipedia.org
- A Course in Machine Learningciml.info
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- decision trees and random forestspeople.eecs.berkeley.edu
- lecture_2.pdfcs231n.stanford.edu
- Support vector machine - Wikipediaen.wikipedia.org
- [2502.01131] Simple Linear Neuron Boostingarxiv.org
- Decision tree learning - Wikipediaen.wikipedia.org
- Support vector machine - Wikipediaen.wikipedia.org