EWoK: Elements of World Knowledge

Elements of World Knowledge (EWoK): A cognition-inspired framework for evaluating basic world knowledge in language models

EWoK: Elements of World Knowledge 🌏 Elements of World Knowledge (EWoK): A cognition-inspired framework for evaluating basic world knowledge in language models --> Anna A Ivanova * 1 , Aalok Sathe * 2 , Benjamin Lipkin * 3 , --> Unnathi Kumar 1 , Setayesh Radkani 3 , Thomas H Clark 3 , Carina Kauf 3 , --> Jennifer Hu 4 , Pramod RT 3 , Gabriel Grand 3 , Vivian Paulun 3 , --> Maria Ryskina 5 , Ekin Akyürek 3 , Ethan Wilcox 6 , Nafisa Rashid 7 , Leshem Choshen 3,8 , --> Roger Levy 3 , Evelina Fedorenko 3 , Joshua Tenenbaum 3 , Jacob Andreas 3 --> 1 Georgia Tech, 2 Brown University, 3 MIT, 4 Johns

related reading

• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Evaluation-Conditioned Training: Teaching Models to Generalize to Stronger Oversight Regimesarxiv.org
• Self-Adapting Language Modelsarxiv.org
• [2210.13382] Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskarxiv.org
• Discovering Language Model Behaviors with Model-Written Evaluations — LessWronglesswrong.com
• Language Models can Solve Computer Tasksarxiv.org
• 2301.06627arxiv.org
• [2201.07207] Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentsarxiv.org
• Foundational Challenges in Assuring Alignment and Safety of Large Language Modelsarxiv.org
• 2026.mellm-1.2.pdfaclanthology.org
• Esoteric Language Modelsarxiv.org
• Language Model Compositionarxiv.org