Understanding Regularization for Logistic Regression | KNIME
knime.com · 1,491 words · saved by 1 readers
Learn about regularization for logistic regression and when to use L1, L2, Gauss, and Laplace.
Regularization can be used to avoid overfitting. But what actually is regularization, what are the common techniques, and how do they differ? Regularization is any modification we make to a learning algorithm that is intended to reduce its generalization error but not its training error. Ian Goodfellow Regularization can be used to train models that generalize better on unseen data, by preventing the algorithm from overfitting the training dataset. So how can we modify the logistic regression algorithm to reduce the generalization error? Common approaches I found are Gauss, Laplace, L1 and L2.
saved by
related reading
- L1 regularization: sparsity through singularitiesejenner.com
- Regularization (mathematics) - Wikipediaen.wikipedia.org
- Scaling Laws, Carefully | Lil'Loglilianweng.github.io
- What Is Logistic Regression? | IBMibm.com
- What Is Ridge Regression? | IBMibm.com
- 13.pdfpeople.eecs.berkeley.edu
- Linear Regressionmlu-explain.github.io
- Geometrical Interpretation of Linear Regression in Machine Learning versus Classical Statistics | Towards Data Sciencetowardsdatascience.com
- regressionpeople.eecs.berkeley.edu
- Lasso (statistics) - Wikipediaen.wikipedia.org
- Scaling laws of optimization – Machine Learning Research Blogfrancisbach.com
- Tips for Training Likelihood Modelsblog.evjang.com