Classification vs. Prediction – Statistical Thinking
It is important to distinguish prediction and classification. In many decisionmaking contexts, classification represents a premature decision, because classification combines prediction and decision making and usurps the decision maker in specifying costs of wrong decisions. The classification rule must be reformulated if costs/utilities or sampling criteria change. Predictions are separate from decisions and can be used by any decision maker. Classification is best used with non-stochastic/deterministic outcomes that occur in say 0.3 - 0.7 of the observations, and not when the simplest classifer (always outputting “positive” or always outputting “negative”) is highly accurate or when two individuals with identical inputs can easily have different outcomes. For these situations, modeling tendencies (i.e., probabilities) is key. Classification should be used when outcomes are distinct and predictors are strong enough to provide, for all subjects, a probability near 1.0 for one of the
Classification vs. Prediction – Statistical Thinking It is important to distinguish prediction and classification. In many decisionmaking contexts, classification represents a premature decision, because classification combines prediction and decision making and usurps the decision maker in specifying costs of wrong decisions. The classification rule must be reformulated if costs/utilities or sampling criteria change. Predictions are separate from decisions and can be used by any decision maker. Classification is best used with non-stochastic/deterministic outcomes that occur in say 0.3 - 0.7
Explore this link on the map →related reading
- Classificationfairmlbook.org
- A Course in Machine Learningciml.info
- Fundamentals of predictionmlstory.org
- What Is Logistic Regression? | IBMibm.com
- Statistical Fairness - Turing Commonsalan-turing-institute.github.io
- Interestingness First Classifiers | Data Processing Clubdata-processing.club
- Bayesian Mindsetcold-takes.com
- Naive Bayes Classifiers - GeeksforGeeksgeeksforgeeks.org
- deeplearningbook.org/contents/ml.htmldeeplearningbook.org
- Top 10 Machine Learning Algorithms in 2026 - Analytics Vidhyaanalyticsvidhya.com
- The Value of Probabilistic Thinking: Spies, Crime, and Lightning Strikesfs.blog
- Random forest - Wikipediaen.wikipedia.org