Is AI quietly killing itself - and the Internet?
University of Oxford’s Dr. Ilia Shumailov and the team of researchers discovered that when generative AI software relies solely on content produced by genAI, the responses begin to degrade, according to the study published in Nature last month. After the first two prompts, the answers steadily miss the mark, followed by a significant quality downgrade by the fifth attempt and a complete devolution to nonsensical pablum by the ninth consecutive query. The researchers dubbed this cyclical overdose on generative AI content model collapse—a steady decline in the learned responses of the AI that continually pollutes the training sets of repeating cycles until the output is a worthless distortion of reality. “It is surprising how fast model collapse kicks in and how elusive it can be. At first, it affects minority data—data that is badly represented. It then affects diversity of the outputs and the variance reduces. Sometimes, you observe small improvement for the majority data, that hides a
Published on September 3, 2024 Interest in artificial intelligence continues to surge, as Google searches over the past 12 months are at 92% of their all-time peak , but recent research suggests AI’s success could be its downfall. Amid the growth of AI content online, a group of researchers at Cambridge and Oxford universities set out to see what happens when generative AI tools query content produced by AI. What they found was alarming. University of Oxford’s Dr. Ilia Shumailov and the team of researchers discovered that when generative AI software relies solely on content produced by genAI,
Explore this link on the map →saved by
related reading
- The Dark Forest and Generative AImaggieappleton.com
- Generative AI’s Act Two | Sequoia Capitalsequoiacap.com
- When AI builds itself \ Anthropicanthropic.com
- The Impact of AI-Generated Text on the Internetai-on-the-internet.github.io
- How to Build a Truly Useful AI Productevery.to
- suchir.net/fair_use.htmlsuchir.net
- Generative AI’s Act Two | Sequoia Capitalsequoiacap.com
- AI #77: A Few Upgrades - by Zvi Mowshowitzthezvi.substack.com
- The AI Unbundling – Stratechery by Ben Thompsonstratechery.com
- [2404.01413v2] Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Dataarxiv.org
- Import AIjack-clark.net
- Mode collapse - Wikipediaen.wikipedia.org