[2108.02497] How to avoid machine learning pitfalls: a guide for academic researchers
This document is a concise outline of some of the common mistakes that occur when using machine learning, and what can be done to avoid them. Whilst it should be accessible to anyone with a basic understanding of machine learning techniques, it was originally written for research students, and focuses on issues that are of particular concern within academic research, such as the need to do rigorous comparisons and reach valid conclusions. It covers five stages of the machine learning process: what to do before model building, how to reliably build models, how to robustly evaluate models, how to compare models fairly, and how to report results.
[2108.02497] How to avoid machine learning pitfalls: a guide for academic researchers --> Computer Science > Machine Learning arXiv:2108.02497 (cs) [Submitted on 5 Aug 2021 ( v1 ), last revised 29 Aug 2024 (this version, v5)] Title: How to avoid machine learning pitfalls: a guide for academic researchers Authors: Michael A. Lones View a PDF of the paper titled How to avoid machine learning pitfalls: a guide for academic researchers, by Michael A. Lones View PDF HTML (experimental) Abstract: Mistakes in machine learning practice are commonplace, and can result in a loss of confidence in the fin
saved by
related reading
- An Opinionated Guide to ML Researchjoschu.net
- Tips for Empirical Alignment Research — AI Alignment Forumalignmentforum.org
- [2401.05566] Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Trainingarxiv.org
- The More You Automate, the Less You See: Hidden Pitfalls of AI Scientist Systemsarxiv.org
- [1803.08823] A high-bias, low-variance introduction to Machine Learning for physicistsarxiv.org
- [2604.21691] There Will Be a Scientific Theory of Deep Learningarxiv.org
- an-unsolicited-guide-to-good-research.pdfemerge-lab.github.io
- Onboarding for Practical Machine Learning Researchsuzyahyah.github.io
- Highly Opinionated Advice on How to Write ML Papers — LessWronglesswrong.com
- [2109.13916] Unsolved Problems in ML Safetyarxiv.org
- [2405.07987] The Platonic Representation Hypothesisarxiv.org
- [2403.02327] Model Lakesarxiv.org