more regression, newton's method, ROC curves

N/A

More Regression; Newton’s Method; ROC Curves 59 11 More Regression; Newton’s Method; ROC Curves LEAST-SQUARES POLYNOMIAL REGRESSION Replace each Xi with feature vector (Xi ) with all terms of degree 0 . . . p 2 e.g., (Xi ) = [Xi1 Xi1 Xi2 2 Xi2 Xi1 Xi2 1]> [Notice that we’ve added the fictitious dimension “1” here, so we don’t need to add it again to do linear or logistic regression. This basis covers all polynomials quadratic in Xi1 and Xi2 .] Otherwise just like linear or logistic regression.…

related reading

• Polynomial Regression - An Alternative For Neural Networks? | Towards Data Sciencetowardsdatascience.com
• regressionpeople.eecs.berkeley.edu
• [2007.12826] The Interpolation Phase Transition in Neural Networks: Memorization and Generalization under Lazy Trainingarxiv.org
• Understanding regularization for logistic regression | KNIMEknime.com
• Linear Regressionmlu-explain.github.io
• Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law | Jascha’s blogsohl-dickstein.github.io
• Why Momentum Really Worksdistill.pub
• med.stanford.edu/content/dam/sm/dbds/documents/biostats-workshop/paper-1-.pdfmed.stanford.edu
• Regularization (mathematics) - Wikipediaen.wikipedia.org
• Gregory Gundersengregorygundersen.com
• What Is Logistic Regression? | IBMibm.com
• deeplearningbook.org/contents/ml.htmldeeplearningbook.org