✳flâneur — a map of the web's best reading

Best explanations of how LLMs work | Roman Vorushin

vorushin.github.io · 809 words · saved by 2 readers

I maintain a set of best explanations1 of how LLMs train and work. “LLMs” here is a broad term for the frontier models that create value in 2026. They have more components than just a language model, but powerful language models are their necessary core. Universal explainers Considering: humans are universal explainers (Deutsch) - they use creativity to explain the world. Conjecture: LLMs are universal explainers on a non-biological substrate. That’s the opposite of the claim that LLMs are stochastic parrots - that they only imitate, without understanding or creating new knowledge. Creativity Creativity in humans Evolved to understand complex…

I maintain a set of best explanations 1 of how LLMs train and work. “LLMs” here is a broad term for the frontier models that create value in 2026. They have more components than just a language model, but powerful language models are their necessary core. Universal explainers Considering: humans are universal explainers (Deutsch) - they use creativity to explain the world. Conjecture: LLMs are universal explainers on a non-biological substrate. That’s the opposite of the claim that LLMs are stochastic parrots - that they only imitate, without understanding or creating new knowledge. Creativity

Explore this link on the map →

saved by

related reading