What's Wrong with Social Science and How to Fix It: Reflections After Reading 2578 Papers | Fantastic Anachronism
fantasticanachronism.com · 7,536 words · saved by 1 readers
Replication, citations, power, incentives, and more.
I've seen things you people wouldn't believe. Over the past year, I have skimmed through 2578 social science papers, spending about 2.5 minutes on each one. This was due to my participation in Replication Markets, a part of DARPA's SCORE program, whose goal is to evaluate the reliability of social science research. 3000 studies were split up into 10 rounds of ~300 studies each. Starting in August 2019, each round consisted of one week of surveys followed by two weeks of market trading. I finished in first place in 3 out 10 survey rounds and 6 out of 10 market rounds. In total, about…
related reading
- Half of social-science studies fail replication test in years-long projectnature.com
- Market Failures in Sciencemilan.cvitkovic.net
- How Life Sciences Actually Work: Findings of a Year-Long Investigation - Alexey Guzeyguzey.com
- Psychology Research Is Mostly Fineastralcodexten.com
- A Vision of Metasciencescienceplusplus.org
- A Vision of Metasciencescienceplusplus.org
- No, it’s not The Incentives—it’s you – [citation needed]talyarkoni.org
- An invitation to a secret society - by Adam Mastroianniexperimental-history.com
- The rise and fall of peer review - by Adam Mastroianniexperimentalhistory.substack.com
- Reproducibility and transparency: what’s going on and how can we helpnature.com
- Which Kind of Science Reformelevanth.org
- It’s the end of science as we know it, and I feel finestatnews.com