[2308.06374] Large Language Models and Knowledge Graphs: Opportunities and Challenges

Abstract:Large Language Models (LLMs) have taken Knowledge Representation -- and the world -- by storm. This inflection point marks a shift from explicit knowledge representation to a renewed focus on the hybrid representation of both explicit knowledge and parametric knowledge. In this position paper, we will discuss some of the common debate points within the community on LLMs (parametric knowledge) and Knowledge Graphs (explicit knowledge) and speculate on opportunities and visions that the renewed focus brings, as well as related research topics and challenges.

related reading

• [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
• LLM Daydreaming · Gwern.netgwern.net
• GenAI Handbookgenai-handbook.github.io
• Large Language Model: world models or surface statistics?thegradient.pub
• [2605.15156] MeMo: Memory as a Modelarxiv.org
• Andrej Karpathy on X: "LLM Knowledge Bases Something I'm finding very useful recently: using LLMs to build personal knowledge bases for various topics of research interest. In this way, a large fraction of my recent token throughput is going less into manipulating code, and more into manipulating" / Xx.com
• Do language models possess knowledge (soundness)? - HackMDhackmd.io
• Fine-tuning vs. RAG for LLMsneo4j.com
• Retrieval-Augmented Generation for Large Language Models: A Surveyarxiv.org
• Reasoning Models Reason Well, Until They Don'tarxiv.org
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• Generated Knowledge Prompting | Prompt Engineering Guidepromptingguide.ai