[2502.09956] KGGen: Extracting Knowledge Graphs from Plain Text with Language Models
Abstract:Recent interest in building foundation models for KGs has highlighted a fundamental challenge: knowledge-graph data is relatively scarce. The best-known KGs are primarily human-labeled, created by pattern-matching, or extracted using early NLP techniques. While human-generated KGs are in short supply, automatically extracted KGs are of questionable quality. We present a solution to this data scarcity problem in the form of a text-to-KG generator (KGGen), a package that uses language models to create high-quality graphs from plaintext. Unlike other KG extractors, KGGen clusters related entities to reduce sparsity in extracted KGs. KGGen is available as a Python library (\texttt{pip install kg-gen}), making it accessible to everyone. Along with KGGen, we release the first benchmark, Measure of of Information in Nodes and Edges (MINE), that tests an extractor's ability to produce a useful KG from plain text. We benchmark our new tool against existing extractors and demonstrate far superior performance.
View PDF HTML (experimental) Abstract:Recent interest in building foundation models for KGs has highlighted a fundamental challenge: knowledge-graph data is relatively scarce. The best-known KGs are primarily human-labeled, created by pattern-matching, or extracted using early NLP techniques. While human-generated KGs are in short supply, automatically extracted KGs are of questionable quality. We present a solution to this data scarcity problem in the form of a text-to-KG generator (KGGen), a package that uses language models to create high-quality graphs from plaintext. Unlike other KG…
saved by
related reading
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- [2005.14165] Language Models are Few-Shot Learnersarxiv.org
- [2303.13948] Knowledge Graphs: Opportunities and Challengesarxiv.org
- Retrieval Augmented Generation: Streamlining the creation of intelligent natural language processing modelsai.facebook.com
- The GraphRAG manifesto: Adding knowledge to GenAIneo4j.com
- [2506.06266] Cartridges: Lightweight and general-purpose long context representations via self-studyarxiv.org
- Efficient Guided Generation for Large Language Modelsarxiv.org
- [2003.02320] Knowledge Graphsarxiv.org
- [2308.06374] Large Language Models and Knowledge Graphs: Opportunities and Challengesarxiv.org
- GraphRAG: New tool for complex data discovery now on GitHub - Microsoft Researchmicrosoft.com
- Let Your Graph Do the Talking: Encoding Structured Data for LLMsarxiv.org
- Retrieval-Augmented Generation for Large Language Models: A Surveyarxiv.org