llms-cant-jump.pdf

N/A

Jan 27th, 2026 LLMs can’t jump Tom Zahavy, Google DeepMind How do we fundamentally discover new things? In a letter to Maurice Solovine, Albert Einstein con- ceptualized discovery as a cyclical process involving an intuitive ’jump’ from sensory experience to axioms, followed by logical deduction. While Generative AI has mastered Induction (statistical pattern matching) and is rapidly conquering Deduction (formal proof ), we argue it lacks the mechanism for Abduction—the generation of novel explanatory hypotheses. Using Einstein’s formulation of General Relativity as a computational…

saved by

• Arya G

related reading

• Hot Take: LLM can 'jump'yongzx.github.io
• the-illusion-of-thinking.pdfml-site.cdn-apple.com
• LLM Daydreaming · Gwern.netgwern.net
• Designing AI for Disruptive Scienceasimov.press
• Machina Mirabilis - Michael Hlamichaelhla.com
• pdfopenreview.net
• The Need for Verification in AI-Driven Scientific Discoveryalphaxiv.org
• Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com
• Thoughts on AI in academiatheinfinitesimal.substack.com
• The necessity of machine learning theory in mitigating AI riskmishabelkin.substack.com
• Can AI Solve Science?-Stephen Wolfram Writingswritings.stephenwolfram.com
• Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemsarxiv.org