There Are No New Ideas in AI… Only New Datasets

LLMs were invented in four major developments... all of which were datasets

There Are No New Ideas in AI… Only New Datasets LLMs were invented in four major developments... all of which were datasets Jack Morris Apr 09, 2025 307 27 33 Share Most people know that AI has made unbelievable progress over the last fifteen years– especially in the last five. It might feel like that progress is *inevitable* – although large paradigm-shift-level breakthroughs are uncommon, we march on anyway through a stream of slow & steady progress. In fact, some researchers have recently declared a “Moore’s Law for AI” where the computer’s ability to do certain things (in this case, certai

saved by

• Anson Yu
• Rajan Agarwal
• Aryan Naik
• s j
• Nhật Nguyễn Thế
• Rikard Saqe
• Ada Ge
• Rohan Kanti
• Devin Plumb
• Ayman
• Aayush Gupta
• SUJASH AGRAWAL

related reading

• The Only Important Technology Is The Internet - Kevin Lukevinlu.ai
• Most Algorithmic Progress is Data Progressberen.io
• AI progress is about to speed up | Epoch AIepoch.ai
• AI Revolution - Transformers and Large Language Models (LLMs)blog.eladgil.com
• Lossy self-improvement - by Nathan Lambertinterconnects.ai
• A Short History of Artificial Intelligenceevery.to
• Import AI 455: AI systems are about to start building themselves.importai.substack.com
• What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
• Will scaling work?dwarkeshpatel.com
• The nature of LLM algorithmic progress (v2) — LessWronglesswrong.com
• Things we learned about LLMs in 2024simonwillison.net
• Stuff we figured out about AI in 2023simonwillison.net