Verifiability | karpathy
karpathy.bearblog.dev · 381 words · saved by 3 readers
The impact of verifiability on the jagged frontier of LLMs
karpathy 17 Nov, 2025 AI has been compared to various historical precedents: electricity, industrial revolution, etc., I think the strongest analogy is that of AI as a new computing paradigm because both are fundamentally about the automation of digital information processing. If you were to forecast the impact of computing on the job market in ~1980s, the most predictive feature of a task/job you'd look at is specifiability, i.e. are you just mechanically transforming information according to rote, easy to specify algorithm (examples being typing, bookkeeping, human calculators, etc.)?…
saved by
related reading
- 2025 LLM Year in Review – karpathykarpathy.bearblog.dev
- Asymmetry of verification and verifier’s rule - Jason Weijasonwei.net
- Software 2.0. I sometimes see people refer to neural… | by Andrej Karpathy | Mediumkarpathy.medium.com
- Malleable software in the age of LLMsgeoffreylitt.com
- A shallow dive into formal verificationvitalik.eth.limo
- When AI Writes the World's Software, Who Verifies It? — Leonardo de Mouraleodemoura.github.io
- The Compute Verification Postfirstscattering.com
- Automatic Formal Verification for Code Generationlogicalintelligence.com
- The Need for Verification in AI-Driven Scientific Discoveryalphaxiv.org
- Taking Jaggedness Seriouslyhelentoner.substack.com
- LLM-as-a-Verifier: A General-Purpose Verification Framework | alphaXivalphaxiv.org
- Human Judgment as a Specificationblog.brownplt.org