Aggressive AI scrapers are making it kinda suck to run wikis | Weird Gloop
Bots are currently scraping the internet for LLM training data at unprecedented rates[1][2][3], driving up costs and destabilizing public-facing websites. I want to talk about how this has been particularly difficult for wikis, and has gotten much worse in the last few months.
Aggressive AI scrapers are making it kinda suck to run wikis | Weird Gloop ← Blog Aggressive AI scrapers are making it kinda suck to run wikis 13 March 2026 · cookmeplox Bots are currently scraping the internet for LLM training data at unprecedented rates [1] [2] [3] , driving up costs and destabilizing public-facing websites. I want to talk about how this has been particularly difficult for wikis , and has gotten much worse in the last few months. I run Weird Gloop , which hosts some of the biggest video game wikis ever, like Minecraft , OSRS and League . Over the last 3 years, we’ve had to s
Explore this link on the map →saved by
related reading
- Deep Dive: Building an AI-Native Company | Contrary Researchresearch.contrary.com
- Wikipedia:Signs of AI writing - Wikipediaen.wikipedia.org
- Making sure you're not a bot!iro.umontreal.ca
- Who Writes Wikipedia? (Aaron Swartz's Raw Thought)aaronsw.com
- What 2026 looks like — LessWronglesswrong.com
- Web Scraping and Crawling Are Perfectly Legal, Right?benbernardblog.com
- Crawling a billion web pages in just over 24 hoursandrewkchan.dev
- A website is a street cornergarbageday.email
- AI Agent Bankrupted Their Operator While Trying to Scan DN42 - Lan Tian @ Bloglantian.pub
- Strava declares war on scrapers ahead of IPO | TechCrunchtechcrunch.com
- Import AIjack-clark.net
- We were promised Strong AI, but instead we got metadata analysiscalpaterson.com