Against LLM Reductionism - LessWrong
SUMMARY * Large language models (henceforth, LLMs) are sometimes said to be "just" shallow pattern matchers, "just" massive look-up tables or "just" autocomplete engines. These comparisons amount to…
x Against LLM Reductionism — LessWrong Interpretability (ML & AI) Language Models (LLMs) AI Frontpage 140 Against LLM Reductionism by Erich_Grunewald 8th Mar 2023 Linkpost for www.erichgrunewald.com 21 min read 17 140 Summary Large language models (henceforth, LLMs) are sometimes said to be "just" shallow pattern matchers, "just" massive look-up tables or "just" autocomplete engines. These comparisons amount to a form of (methodological) reductionism. While there's some truth to them, I think they smuggle in corollaries that are either false or at least not obviously true. For example, they se
Explore this link on the map →saved by
related reading
- Against LLM Reductionismerichgrunewald.com
- LLM Daydreaming · Gwern.netgwern.net
- Guardian Angels: LLM Personalization for Productivity and Security · Gwern.netgwern.net
- Large Language Model: world models or surface statistics?thegradient.pub
- GenAI Handbookgenai-handbook.github.io
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
- The Future of Everything is Lies, I Guessaphyr.com
- LLMs and World Models, Part 1 - by Melanie Mitchellaiguide.substack.com
- How LLMs Work, Explained Without Math - miguelgrinberg.comblog.miguelgrinberg.com
- The Unintelligibility is Ours: Notes on Chain of Thought1a3orn.com