Retrieval-Augmented Generation for Large Language Models: A Survey
This is experimental HTML to improve accessibility. We invite you to report rendering errors. Use Alt+Y to toggle on accessible reporting links and Alt+Shift+Y to toggle off. Learn more about this project and help improve conversions. Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating knowledge from external databases. This enhances the accuracy and credibility of the generation, particularly for knowledge-intensive tasks, and allows for continuous knowledge updates and integration of domain-specific information. RAG synergistically merges LLMs’ intrinsic knowledge with the vast, dynamic repositories of external databases. This comprehensive review paper offers a detailed examination of the progression of RAG paradigms, encompassing the Naive RAG, the Advanced RAG, and
Retrieval-Augmented Generation for Large Language Models: A Survey Yunfan Gao Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University Yun Xiong Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University Xinyu Gao Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University Kangxiang Jia Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University Jinliu Pan Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University Yuxi Bi College of Design and Innovation, Tongji Un
saved by
related reading
- [2005.11401] Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasksarxiv.org
- Advanced RAG Techniques: What They Are & How to Use Themfalkordb.com
- Retrieval Augmented Generation: Streamlining the creation of intelligent natural language processing modelsai.facebook.com
- Patterns for Building LLM-based Systems & Productseugeneyan.com
- Retrieval-augmented generation - Wikipediaen.wikipedia.org
- Code a simple RAG from scratchhuggingface.co
- What is Retrieval Augmented Generation (RAG)? | Databricksdatabricks.com
- RAG Architecture Deep Divelinkedin.com
- Large Language Diffusion Modelsarxiv.org
- 10 Ways to Improve the Performance of Retrieval Augmented Generation Systems | Towards Data Sciencetowardsdatascience.com
- 2025.acl-long.896.pdfaclanthology.org
- Retrieval Augmented Generation Research: 2017-2024scalingknowledge.substack.com