flâneur — a map of the web's best reading

Link Rot and Digital Decay on Government, News and Other Webpages | Pew Research Center

pewresearch.org · 2,541 words · saved by 1 readers

Pew Research Center conducted the analysis to examine how often online content that once existed becomes inaccessible. One part of the study looks at a representative sample of webpages that existed over the past decade to see how many are still accessible today. For this analysis, we collected a sample of pages from the Common Crawl web repository for each year from 2013 to 2023. We then tried to access those pages to see how many still exist. A second part of the study looks at the links on existing webpages to see how many of those links are still functional. We did this by collecting a large sample of pages from government websites, news websites and the online encyclopedia Wikipedia. We identified relevant news domains using data from the audience metrics company comScore and relevant government domains (at multiple levels of government) using data from get.gov, the official administrator for the .gov domain. We collected the news and government pages via Common Crawl and the Wiki

Report | May 17, 2024 When Online Content Disappears 38% of webpages that existed in 2013 are no longer accessible a decade later X Facebook Threads LinkedIn WhatsApp Mail Add Us On Google By Athena Chapekis , Samuel Bestvater , Emma Remy and Gonzalo Rivero Table of Contents When Online Content Disappears Acknowledgments Methodology How we did this Pew Research Center conducted the analysis to examine how often online content that once existed becomes inaccessible. One part of the study looks at a representative sample of webpages that existed over the past decade to see how many are still acc

Explore this link on the map →

related reading