✳flâneur — a map of the web's best reading

2025 LLM Year in Review | karpathy

karpathy.bearblog.dev · 1,775 words · saved by 16 readers

2025 Year in Review of LLM paradigm changes

2025 LLM Year in Review – karpathy 2025 LLM Year in Review 19 Dec, 2025 2025 has been a strong and eventful year of progress in LLMs. The following is a list of personally notable and mildly surprising "paradigm changes" - things that altered the landscape and stood out to me conceptually. 1. Reinforcement Learning from Verifiable Rewards (RLVR) At the start of 2025, the LLM production stack in all labs looked something like this: Pretraining (GPT-2/3 of ~2020) Supervised Finetuning (InstructGPT ~2022) and Reinforcement Learning from Human Feedback (RLHF ~2022) This was the stable and proven r

Explore this link on the map →

saved by

related reading