Link Rot and Digital Decay on Government, News and Other Webpages | Pew Research Center
Pew Research Center conducted the analysis to examine how often online content that once existed becomes inaccessible. One part of the study looks at a representative sample of webpages that existed over the past decade to see how many are still accessible today. For this analysis, we collected a sample of pages from the Common Crawl web repository for each year from 2013 to 2023. We then tried to access those pages to see how many still exist. A second part of the study looks at the links on existing webpages to see how many of those links are still functional. We did this by collecting a large sample of pages from government websites, news websites and the online encyclopedia Wikipedia. We identified relevant news domains using data from the audience metrics company comScore and relevant government domains (at multiple levels of government) using data from get.gov, the official administrator for the .gov domain. We collected the news and government pages via Common Crawl and the Wiki
Report | May 17, 2024 When Online Content Disappears 38% of webpages that existed in 2013 are no longer accessible a decade later X Facebook Threads LinkedIn WhatsApp Mail Add Us On Google By Athena Chapekis , Samuel Bestvater , Emma Remy and Gonzalo Rivero Table of Contents When Online Content Disappears Acknowledgments Methodology How we did this Pew Research Center conducted the analysis to examine how often online content that once existed becomes inaccessible. One part of the study looks at a representative sample of webpages that existed over the past decade to see how many are still acc
related reading
- This Page is Designed to Last: A Manifesto for Preserving Content on the Webjeffhuang.com
- Archiving URLs · Gwern.netgwern.net
- Webpage archivearchive.ph
- Wayback Machinemanuelohan.com
- A Website To End All Websites | Henry From Onlinehenry.codes
- Backing Up US Federal Databases | Azimuthjohncarlosbaez.wordpress.com
- Wayback Machinemaa.org
- Attention Traps - by Varun Shenoy - Varun's Notesvarunshenoy.substack.com
- Why the disappearance of digital third spaces mattersthedailystar.net
- The spread of true and false news online - PubMedpubmed.ncbi.nlm.nih.gov
- A Million Ways to Die on the Web - Archiveteamwiki.archiveteam.org
- The Social Recession: By the Numbersnovum.substack.com