[2308.06374] Large Language Models and Knowledge Graphs: Opportunities and Challenges

Abstract:Large Language Models (LLMs) have taken Knowledge Representation -- and the world -- by storm. This inflection point marks a shift from explicit knowledge representation to a renewed focus on the hybrid representation of both explicit knowledge and parametric knowledge. In this position paper, we will discuss some of the common debate points within the community on LLMs (parametric knowledge) and Knowledge Graphs (explicit knowledge) and speculate on opportunities and visions that the renewed focus brings, as well as related research topics and challenges.

Large Language Models and Knowledge Graphs: Opportunities and Challenges Jeff Z. Pan # Ñ  The University of Edinburgh, United Kingdom Simon Razniewski # Bosch Center for AI, Germany Jan-Christoph Kalo # Vrije Universiteit Amsterdam, The Netherlands Sneha Singhania #…

related reading

• [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
• [2201.11903] Chain of Thought Prompting Elicits Reasoning in Large Language Modelsarxiv.org
• [2303.13948] Knowledge Graphs: Opportunities and Challengesarxiv.org
• Language Models can Solve Computer Tasksarxiv.org
• Large Language Diffusion Modelsarxiv.org
• Large Language Models Must Be Taught to Know What They Don't Knowarxiv.org
• Foundational Challenges in Assuring Alignment and Safety of Large Language Modelsarxiv.org
• Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com
• 2402.07927arxiv.org
• Let Your Graph Do the Talking: Encoding Structured Data for LLMsarxiv.org
• 2310.10631arxiv.org
• 2301.06627arxiv.org