[2308.06374] Large Language Models and Knowledge Graphs: Opportunities and Challenges

Abstract:Large Language Models (LLMs) have taken Knowledge Representation -- and the world -- by storm. This inflection point marks a shift from explicit knowledge representation to a renewed focus on the hybrid representation of both explicit knowledge and parametric knowledge. In this position paper, we will discuss some of the common debate points within the community on LLMs (parametric knowledge) and Knowledge Graphs (explicit knowledge) and speculate on opportunities and visions that the renewed focus brings, as well as related research topics and challenges.

Large Language Models and Knowledge Graphs: Opportunities and Challenges Jeff Z. Pan # Ñ  The University of Edinburgh, United Kingdom Simon Razniewski # Bosch Center for AI, Germany Jan-Christoph Kalo # Vrije Universiteit Amsterdam, The Netherlands Sneha Singhania #…

related reading

• [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
• Patterns for Building LLM-based Systems & Productseugeneyan.com
• GenAI Handbookgenai-handbook.github.io
• [2303.13948] Knowledge Graphs: Opportunities and Challengesarxiv.org
• Thinking to recall: How reasoning unlocks parametric knowledge in LLMsresearch.google
• Large Language Model: world models or surface statistics?thegradient.pub
• Retrieval-Augmented Generation for Large Language Models: A Surveyarxiv.org
• Andrej Karpathy on X: "LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating" / Xx.com
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Do language models possess knowledge (soundness)? - HackMDhackmd.io
• Fine-tuning vs. RAG for LLMsneo4j.com
• [2605.15156] MeMo: Memory as a Modelarxiv.org