A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models
Paper · 2025 · Qinggang Zhang, Shengyuan Chen, Yuanchen Bei et al.
Summary
General-purpose LLMs often fall short in specialized fields. Their domain knowledge is shallow, they struggle with long chains of rule-bound reasoning, and they misread terms whose meaning depends on context. Fine-tuning on domain data can introduce hallucinations and catastrophic forgetting. Classic RAG avoids retraining, but because it retrieves flat text chunks it has its own problems. It handles complex queries poorly, cannot link knowledge spread across many sources, is constrained by the LLM's context window, and scales badly. This survey, by authors from The Hong Kong Polytechnic University and Jilin University, reviews Graph-based RAG (GraphRAG) as a remedy. GraphRAG stores knowledge as graphs of entities and relations, retrieves it with structure-aware and multi-hop methods, and feeds the result into generation. The authors organize the field around knowledge organization, retrieval and integration. They also review applications, open-source projects and benchmark datasets, and they outline open problems in knowledge quality, efficiency, generalization and security. The survey offers no new experiments. Its value is a structured map of the field and a curated resource list.
Key points
- The survey sorts GraphRAG into three families:
- knowledge-based, where the graph itself carries the knowledge;
- index-based, where the graph serves as an index pointing back to raw text;
- hybrid, which combines the two.
- It names four weaknesses of flat-text RAG:
- difficulty understanding complex queries, e.g. missing intermediate concepts B and C when linking A to D;
- poor integration of knowledge from distributed sources;
- LLM context windows of roughly 2K–32K tokens;
- efficiency and scalability bottlenecks.
- The core chapters cover:
- structured knowledge organization through knowledge carrier graphs and index graphs;
- graph retrieval techniques;
- methods for integrating retrieved knowledge into LLMs.
- The benchmarks surveyed include WebQSP, CWQ, MetaQA, GrailQA, HotpotQA, KQAPro, FACTKG and UltraDomain. The representative systems covered include Microsoft-style GraphRAG, LightRAG, ToG, RoG, G-Retriever, GNN-RAG and MedGraphRAG.
- Papers, datasets and projects are collected in the GitHub repository DEEP-PolyU/Awesome-GraphRAG.
Institutions
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 9,085 worksArtificial Intelligence · 8,888 worksArts and Humanities · 9,296 worksLanguage and Linguistics · 9,206 worksComputer Vision and Pattern Recognition · 1,282 worksInformation Systems · 523 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1,344 worksInformation retrieval & search · 146 works
Cite
Cite as Qinggang Zhang, Shengyuan Chen, Yuanchen Bei, Zheng Yuan, Huachi Zhou, Zijin Hong, Hao Chen, Yilin Xiao, Chuang Zhou, Junnan Dong, Yi Chang and Xiao Huang. 2025. A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models. arXiv:2501.13958.
@misc{zhang2025survey,
title = {{A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models}},
author = {Qinggang Zhang, Shengyuan Chen, Yuanchen Bei, Zheng Yuan, Huachi Zhou, Zijin Hong, Hao Chen, Yilin Xiao, Chuang Zhou, Junnan Dong, Yi Chang and Xiao Huang},
year = {2025},
doi = {10.48550/arxiv.2501.13958},
eprint = {2501.13958},
archivePrefix = {arXiv},
url = {https://doi.org/10.48550/arxiv.2501.13958}
}References
- [3] D. Khashabi, S. Min, T. Khot, and et al., “Unifiedqa: Crossing format boundaries with a single qa system,” in Findings of Empirical Methods in Natural Language Processing, 2020. [4] A. Chowdhery, S. Narang, J. Devlin, and et al., “Palm: Scaling language modeling with pathways,” Journal of Machin…
- [29] T. T. Procko and O. Ochoa, “Graph retrieval-augmented generation for large language models: A survey,” in Conference on AI, Science, Engineering, and Technology (AIxSET), 2024. [30] H. Han, Y. Wang, H. Shomer, and et al., “Retrieval-augmented generation with graphs (graphrag),” arXiv preprint a…
- [54] J. Wang, J. Fu, R. Wang, and et al., “Pike-rag: specialized knowledge and rationale augmented generation,” arXiv preprint arXiv:2501.11551, 2025. [55] K. Sharma, P. Kumar, and Y. Li, “Og-rag: Ontology-grounded retrieval-augmented generation for large language models,” arXiv preprint arXiv:2412.…
- [79] M. Gubanov, A. Pyayt, and A. Karolak, “Cancerkg. org-a web-scale, interactive, verifiable knowledge graph-llm hybrid for assisting with optimal cancer treatment and care,” in International Conference on Information and Knowledge Management, 2024. [80] X. He, Y. Tian, Y. Sun, and et al., “G-retr… — G-Retriever: Retrieval-Augmented Generation for Textual Graph Understanding and Question Answering
- [104] R. Ye, C. Zhang, R. Wang, and et al., “Language is all a graph needs,” in Findings of Association for Computational Linguistics, 2024. [105] R. Chen, T. Zhao, A. K. JAISWAL, and et al., “LLaGA: Large language and graph assistant,” in International Conference on Machine Learning, 2024. [106] N.… find
- [128] G. Angeli, M. J. J. Premkumar, and C. D. Manning, “Leveraging linguistic structure for open domain information extraction,” in Association for Computational Linguistics and International Joint Conference on Natural Language Processing, 2015. [129] W. Li, H. Zhou, J. Dong, and et al., “Construc…
- [152] W. Hamilton, Z. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” in Advances in Neural Information Processing Systems, 2017. [153] Y. Bei, S. Zhou, Q. Tan, and et al., “Reinforcement neighborhood selection for unsupervised graph anomaly detection,” in International C…
- [177] X. Lin, W. Wang, Y. Li, and et al., “Data-efficient fine-tuning for llm-based recommendation,” in Conference on Information Retrieval, 2024. [178] J. He, M. Rungta, D. Koleczek, and et al., “Does prompt formatting have any impact on llm performance?” arXiv preprint arXiv:2411.10541, 2024. [179… — ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge
- [203] S. Xu, L. Pang, H. Shen, and et al., “Search-in-the-chain: Interactively enhancing large language models with search for knowledge-intensive tasks,” in International World Wide Web Conference, 2024. [204] S. Geng, Z. Fu, Y. Ge, and et al., “Improving personalized explanation generation through… find
- [229] Y. Gu, S. Kase, M. Vanni, and et al., “Beyond iid: three levels of generalization for question answering on knowledge bases,” in International World Wide Web Conference, 2021. [230] Y. Lyu, Z. Li, S. Niu, and et al., “Crud-rag: A comprehensive chinese benchmark for retrieval-augmented generati… find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/zhang-2025-survey-graph-retrieval-augmented-generation/