And Yet It Understands
borretti.me · 1,872 words · saved by 2 readers
In high-dimensional vector spaces, numerical optimization is omnipotent.
To think is to forget differences, to generalize, to abstract. — Jorge Luis Borges, Funes el memorioso The Lord knoweth the thoughts of man, that they are vanity. — Psalm 94:11 Someone, I think Bertrand Russell 1 , said we compare the mind to whatever is the most complex machine we know. Clocks, steam engines, telephone relays, digital computers. For AI, it’s the opposite: as capabilities increase, and our understanding of AI systems decreases, the analogies become more and more dismissive. In 1958, when Herbert Simon introduced his General Problem Solver , he famously said: “there are now in
saved by
related reading
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- As Rocks May Think | Eric Jangevjang.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- A Workaphile’s Apologymoalquraishi.wordpress.com
- How AI Is Learning to Think in Secretnickandresen.substack.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
- Meaningful | Slate Star Codexslatestarcodex.com
- To Understand Language is to Understand Generalization | Eric Jangevjang.com
- The Yale Review | Melanie Mitchell: The Dangerous Unknowns at the…yalereview.org
- Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
- 9 Open Problems and Directions about Intelligencema-lab-berkeley.github.io
- A Short History of Artificial Intelligenceevery.to