Things we learned about LLMs in 2024
A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past …
Things we learned about LLMs in 2024 Simon Willison’s Weblog Subscribe Sponsored by: Microsoft - Agent projects stall between demo and production. Microsoft's MVP checklist closes that gap. Try it Things we learned about LLMs in 2024 31st December 2024 A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past twelve months, plus my attempt at identifying key themes and pivotal moments. This is a sequel to my review of 2023 . In this article: The GPT-4 barrier was comprehensively broken Some of those GP
saved by
related reading
- 2025: The year in LLMssimonwillison.net
- Stuff we figured out about AI in 2023simonwillison.net
- What We’ve Learned From A Year of Building with LLMs – Applied LLMsapplied-llms.org
- GitHub - brexhq/prompt-engineering: Tips and tricks for working with Large Language Models like OpenAI's GPT-4.github.com
- 2025 LLM Year in Review – karpathykarpathy.bearblog.dev
- GenAI Handbookgenai-handbook.github.io
- State of AI 2025: 100T Token LLM Usage Study | OpenRouteropenrouter.ai
- The last six months in LLMs, illustrated by pelicans on bicyclessimonwillison.net
- gpt-4.pdfcdn.openai.com
- Catching up on the weird world of LLMssimonwillison.net
- AI in 2025: gestalt — LessWronglesswrong.com
- Productizing Large Language Modelsblog.replit.com