Do language models possess knowledge (soundness)? - HackMD

# Do language models possess knowledge (soundness)?  ### Author

Do language models possess knowledge (soundness)? - HackMD # Do language models possess knowledge (soundness)?  ### Authors: [Tarun Chitra](twitter.com/tarunchitra) and [Henry Prior](twitter.com/priorupdates) ([Gauntlet](gauntlet.network)) In this post we explore how interactive proofs, a concept of interest in theoretical computer science and cryptography, can be useful for testing capabilities of language models. We consider how a setup comprised of multiple language models could be used in place of prompt tuning for this purpose. Our goal is to try to und

saved by

• Ratan Kaliani

related reading

• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• The Unintelligibility is Ours: Notes on Chain of Thought1a3orn.com
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• 2212.03827arxiv.org
• Large Language Model: world models or surface statistics?thegradient.pub
• Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
• [2603.07267] How to Steal Reasoning Without Reasoning Tracesarxiv.org
• Productizing Large Language Modelsblog.replit.com
• Physics of LMs 3.1arxiv.org
• 2310.10631arxiv.org
• Thinking to recall: How reasoning unlocks parametric knowledge in LLMsresearch.google
• Against LLM Reductionism — LessWronglesswrong.com