Be good-argument-driven, not data-driven - Richard Marmorstein
’ve ranted previously about taking empirical research about software engineering practices with a grain of salt. Let’s dust off the old salt shaker and season up a related idea: the notion that software organizations ought to be “data-driven”, i.e. that all teams and projects should define metrics to evaluate their success; decisions should be generally be given some data-based justification; without data we can’t be objective; if we rely merely on reason and intuition, bias will creep in. Science! Truth! The American Way! There’s nothing wrong with a fondness for data. The trouble begins when you begin to favor bad arguments that involve data over good arguments that don’t, or insist that metrics be introduced in realms where data can’t realistically be the foundation of a good argument. Sometimes data-based arguments are perfectly acceptable. Let’s have a diagram! Let’s have some prose, too: Are all factors that drive your metric well-understood? Some things you can measure and ~comp
Be good-argument-driven, not data-driven by Richard Marmorstein - August 26, 2022 ← Home ’ve ranted previously about taking empirical research about software engineering practices with a grain of salt. Let’s dust off the old salt shaker and season up a related idea: the notion that software organizations ought to be “data-driven”, i.e. that all teams and projects should define metrics to evaluate their success; decisions should be generally be given some data-based justification; without data we can’t be objective; if we rely merely on reason and intuition, bias will creep in. Science! Truth!
saved by
related reading
- On idea-driven ideasvitalik.eth.limo
- Good engineers are right, a lotseangoedecke.com
- The Limits of Dataissues.org
- Building something no one else can measuresriramk.com
- Why is it so hard to buy things that work well?danluu.com
- Stop aggregating away the signal in your data - Stack Overflowstackoverflow.blog
- How To Write Quickly While Maintaining Epistemic Rigor — LessWronglesswrong.com
- Thoughts on the software industry | linus.coffeelinus.coffee
- Making Data Actionable: The Immense Challenge of Good Data Productsericdataproduct.substack.com
- Why I Stopped Arguing With Peoplewangcong.org
- Writing an engineering strategy. | Irrational Exuberancelethain.com
- How Should We Critique Research? · Gwern.netgwern.net