Statistical Significance vs. Practical Significance of Research Results
At some point in the analysis of data from a study, researchers face the question, "How important are these results?" Tests of statistical significance and effect sizes are commonly invoked to provide the answer. Both approaches have merit but, as I demonstrate in this paper, their value for this particular purpose is quite limited. I propose several other forms of statistical analysis that are better for making judgments about the importance of research results. Research results can be important for theory development or for the improvement of practice. My concern in this paper is with the importance of research results for the improvement of practice&emdash;specifically, the improvement of educational practice. The question I am addressing is this: How should educational researchers go about determining the practical significance of their research results? My analysis focuses primarily on results obtained in quantitative research, but I extend my argument later in the paper to the pr
Statistical Significance vs. Practical Significance of Research Results M. Gall's home page FIRST DRAFT: DO NOT QUOTE Figuring out the Importance of Research Results: Statistical Significance versus Practical Significance M. D. Gall University of Oregon Paper to be presented at the 2001 annual meeting of the American Educational Research Association Introduction At some point in the analysis of data from a study, researchers face the question, "How important are these results?" Tests of statistical significance and effect sizes are commonly invoked to provide the answer. Both approaches have m
saved by
related reading
- What is Effect Size and Why Does It Matter? (Examples)scribbr.com
- Effect Size | Research Rundownsresearchrundowns.com
- Using Effect Size—or Why the P Value Is Not Enough - PMCncbi.nlm.nih.gov
- How Should We Critique Research? · Gwern.netgwern.net
- Principles of Effective Research – Michael Nielsenmichaelnielsen.org
- The P Value and Statistical Significance: Misunderstandings, Explanations, Challenges, and Alternativesncbi.nlm.nih.gov
- Applying Statistics to LLM Evaluationscameronrwolfe.substack.com
- How Should We Critique Research? · Gwern.netgwern.net
- A statistical approach to model evaluations \ Anthropicanthropic.com
- How to win a best paper award (or, an opinionated take on how to do important research)nicholas.carlini.com
- How much do you believe your results? — LessWronglesswrong.com
- Statistical tests, P values, confidence intervals, and power: a guide to misinterpretationsncbi.nlm.nih.gov