Do language models possess knowledge (soundness)? - HackMD

# Do language models possess knowledge (soundness)?  ### Author

Do language models possess knowledge (soundness)? - HackMD # Do language models possess knowledge (soundness)?  ### Authors: [Tarun Chitra](twitter.com/tarunchitra) and [Henry Prior](twitter.com/priorupdates) ([Gauntlet](gauntlet.network)) In this post we explore how interactive proofs, a concept of interest in theoretical computer science and cryptography, can be useful for testing capabilities of language models. We consider how a setup comprised of multiple language models could be used in place of prompt tuning for this purpose. Our goal is to try to und

saved by

• Ratan Kaliani

related reading

• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
• Large Language Model: world models or surface statistics?thegradient.pub
• Large Language Models Must Be Taught to Know What They Don't Knowarxiv.org
• Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com
• [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
• Language Models can Solve Computer Tasksarxiv.org
• Productizing Large Language Modelsblog.replit.com
• [2207.05221] Language Models (Mostly) Know What They Knowarxiv.org
• arxiv.org/pdf/2505.24832arxiv.org
• Training Language Models to Explain Their Own Computationsarxiv.org