What just happened, what is happening next
The current best estimates of the rate of improvement in Large Language Models show capabilities doubling ever 5 to 14 months. This incredibly rapid pace was on my mind as I put the finishing touches on my book (available at every major bookstore and now, with its bestseller status, apparently discounted 33% at Amazon) back at the end of December. Given that I knew it would release in April, I wrote it in a way that would be relatively timeless, but I also had to make a couple forecasts on where the future would be heading. Fortunately, I think I predicted correctly, and, as a result, the book still encompasses the current state-of-the-art. But that doesn’t mean that nothing has changed in the last four months. So, I wanted to go over the last few months of AI and take stock of what we have learned about what AI models can do, and especially, what AI might do soon. At the time I finished the book, there was one frontier model, GPT-4. Now have three GPT-4 class models, all of roughly si
The current best estimates of the rate of improvement in Large Language Models show capabilities doubling ever 5 to 14 months. This incredibly rapid pace was on my mind as I put the finishing touches on my book (available at every major bookstore and now, with its bestseller status, apparently discounted 33% at Amazon) back at the end of December. Given that I knew it would release in April, I wrote it in a way that would be relatively timeless, but I also had to make a couple forecasts on where the future would be heading. Fortunately, I think I predicted correctly, and, as a result, the…
related reading
- How fast is AI improving? - AI Digesttheaidigest.org
- I. From GPT-4 to AGI: Counting the OOMs - SITUATIONAL AWARENESSsituational-awareness.ai
- AI in 2025: gestalt — LessWronglesswrong.com
- AI progress is about to speed up | Epoch AIepoch.ai
- My picture of the present in AI — LessWronglesswrong.com
- Scaling: The State of Play in AIoneusefulthing.org
- Will scaling work?dwarkeshpatel.com
- Things we learned about LLMs in 2024simonwillison.net
- 2025: The year in LLMssimonwillison.net
- What will GPT-2030 look like? — AI Alignment Forumalignmentforum.org
- Stuff we figured out about AI in 2023simonwillison.net
- Why do people disagree about when powerful AI will arrive?blog.bluedot.org