Collecting Metrics During Qualitative Studies
Don’t report descriptive statistics like success rates and averages unless you ran a quantitative study. Reported numbers must be qualified with statistical information such as confidence intervals or statistical significance.
3 Collecting Metrics During Qualitative Studies Kate Moran Kate Moran June 13, 2021 2021-06-13 Share Email article Share on LinkedIn Share on Twitter Summary: Don’t report descriptive statistics like success rates and averages unless you ran a quantitative study. Reported numbers must be qualified with statistical information such as confidence intervals or statistical significance. I’m often asked variations of this question: “Is it Ok to collect quantitative metrics (like task success and time on task) during qualitative usability testing studies?” The short answer is: Yes, as long as (1) yo
saved by
related reading
- When to Use Which User-Experience Research Methods - NN/Gnngroup.com
- Confidence Intervals, Margins of Error, and Confidence Levels in UX - NN/Gnngroup.com
- Why 5 Participants Are Okay in a Qualitative Study, but Not in a Quantitative One - NN/Gnngroup.com
- My favorite usability testing question | by Chris Gallello | Mediummedium.com
- Day in the Life Studies: A Unique Method for Gathering User Context - Dscoutdscout.com
- Summer Kim on the best ways to approach user research | MiroBlogmiro.com
- How Many Participants for Quantitative Usability Studies: A Summary of Sample-Size Recommendations - NN/Gnngroup.com
- How much do you believe your results? — LessWronglesswrong.com
- Beyond the NPS: Measuring Perceived Usability with the SUS, NASA-TLX, and the Single Ease Question After Tasks and Usability Tests - NN/Gnngroup.com
- How to Analyze Qualitative Data from UX Research: Thematic Analysis - NN/Gnngroup.com
- Choosing, refining, and tracking product metrics | Signals & Storiesmixpanel.com
- How Should We Critique Research? · Gwern.netgwern.net