Language Models as Knowledge Bases?

N/A

Language Models as Knowledge Bases? Fabio Petroni1 Tim Rocktäschel1,2 Patrick Lewis1,2 Anton Bakhtin1 Yuxiang Wu1,2 Alexander H. Miller1 Sebastian Riedel1,2 1 Facebook AI Research 2 University College London {fabiopetroni, rockt, plewis, yolo, yuxiangwu, ahm, sriedel}@fb.com Abstract Memory Query Answer…

related reading

• [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
• [2002.08909] REALM: Retrieval-Augmented Language Model Pre-Trainingarxiv.org
• Physics of LMs 3.1arxiv.org
• Language Models, World Models, and Human Model-Buildinglingo.csail.mit.edu
• [2605.15156] MeMo: Memory as a Modelarxiv.org
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• Generalized Language Models | Lil'Loglilianweng.github.io
• Transfer Learninglena-voita.github.io
• Can a Language Model Learn Facts Continually in Its Weights?labs.baseten.co
• 2212.03827arxiv.org
• The Illustrated BERT, ELMo, and co. (How NLP Cracked Transfer Learning) – Jay Alammar – Visualizing machine learning one concept at a time.jalammar.github.io
• 2112.04426arxiv.org