Elamur Research⌕
☰
home / papers / REALM: Retrieval-Augmented Language Model… / cited by

Who cites «REALM: Retrieval-Augmented Language Model Pre-Training»

1,085 papers of our library cite it (of the 149,439 whose bibliographies we read) · 219 with a page here, the most cited first · page 1 of 3 · 1–100 · ← back to «REALM: Retrieval-Augmented Language Model Pre-Training»

1 2 3

  1. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
  2. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksarXiv:2005.11401Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.2020 · 6,256 citations
  3. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing SurveysPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,423 citations
  4. Dense Passage Retrieval for Open-Domain Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Vladimir Karpukhin, Barlas Oguz, Sewon Min, et al.2020 · 5,421 citations
  5. PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
  6. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information SystemsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,231 citations
  7. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  8. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
  9. Emergent Abilities of Large Language ModelsarXiv:2206.07682Jason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,269 citations
  10. Toolformer: Language Models Can Teach Themselves to Use ToolsConference on Neural Information Processing Systems (NeurIPS)Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, et al.2023 · 2,065 citations
  11. Training Compute-Optimal Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.2022 · 2,032 citations
  12. Leveraging Passage Retrieval with Generative Models for Open Domain Question AnsweringConference of the European Chapter of the Association for Computational Linguistics (EACL)Gautier Izacard, Edouard Grave2021 · 1,692 citations
  13. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
  14. Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data EngineeringShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,551 citations
  15. LaMDA: Language Models for Dialog ApplicationsarXiv:2201.08239Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,344 citations
  16. Big Bird: Transformers for Longer SequencesConference on Neural Information Processing Systems (NeurIPS)Manzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 1,023 citations
  17. A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language ModelsACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)Wenqi Fan; Yujuan Ding; Liangbo Ning; Shijie Wang; Hengyun Li; Dawei Yin; Tat-Seng Chua;, Qing Li2024 · 1,010 citations
  18. C-Pack: Packed Resources For General Chinese EmbeddingsInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Shitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 922 citations
  19. Active Retrieval Augmented GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Zhengbao Jiang, Frank Xu, Luyu Gao, et al.2023 · 872 citations
  20. Unsupervised Dense Information Retrieval with Contrastive LearningarXiv:2112.09118Gautier Izacard, Mathilde Caron, Lucas Hosseini, et al.2021 · 836 citations
  21. In-Context Retrieval-Augmented Language ModelsTransactions of the Association for Computational Linguistics (TACL)Ori Ram, Yoav Levine, Itay Dalmedigos, et al.2023 · 793 citations
  22. Learning To Retrieve Prompts for In-Context LearningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Ohad Rubin, Jonathan Herzig, Jonathan Berant2021 · 724 citations
  23. WebGPT: Browser-assisted question-answering with human feedbackarXiv:2112.09332Reiichiro Nakano, Jacob Hilton, Suchir Balaji, et al.2021 · 721 citations
  24. Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsAnnual Meeting of the Association for Computational Linguistics (ACL)Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.2022 · 716 citations
  25. Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text RetrievalarXiv:2007.00808Lee Xiong, Chenyan Xiong, Ye Li, et al.2020 · 688 citations
  26. KILT: a Benchmark for Knowledge Intensive Language TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Fabio Petroni, Aleksandra Piktus, Angela Fan, et al.2020 · 678 citations
  27. Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionarXiv:2310.11511Akari Asai, Zeqiu Wu, Yizhong Wang, et al.2023 · 677 citations
  28. Atlas: Few-shot Learning with Retrieval Augmented Language ModelsarXiv:2208.03299Gautier Izacard, Patrick Lewis, Maria Lomeli, et al.2022 · 673 citations
  29. Benchmarking Large Language Models in Retrieval-Augmented GenerationProceedings of the AAAI Conference on Artificial IntelligenceJiawei Chen, Hongyu Lin, Xianpei Han, et al.2023 · 629 citations
  30. RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question AnsweringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yingqi Qu, Yuchen Ding, Jing Liu, et al.2021 · 603 citations
  31. Improving Factuality and Reasoning in Language Models through Multiagent DebatearXiv:2305.14325Yilun Du, Shuang Li, Antonio Torralba, et al.2023 · 587 citations
  32. SPLADE: Sparse Lexical and Expansion Model for First Stage RankingInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Thibault Formal, Benjamin Piwowarski, Stéphane Clinchant2021 · 512 citations
  33. REPLUG: Retrieval-Augmented Black-Box Language ModelsarXiv:2301.12652Weijia Shi, Sewon Min, Michihiro Yasunaga, et al.2023 · 492 citations
  34. Enabling Large Language Models to Generate Text with CitationsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Howard Yen, Jiatong Yu, et al.2023 · 485 citations
  35. ColBERTv2: Effective and Efficient Retrieval via Lightweight Late InteractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Keshav Santhanam, Omar Khattab, Jon Saad-Falcon, et al.2022 · 485 citations
  36. LinkBERT: Pretraining Language Models with Document LinksAnnual Meeting of the Association for Computational Linguistics (ACL)Michihiro Yasunaga, Jure Leskovec, Percy Liang2022 · 458 citations
  37. GPT-NER: Named Entity Recognition via Large Language ModelsFindings of the Association for Computational LinguisticsShuhe Wang, Xiaofei Sun, Xiaoya Li, et al.2025 · 436 citations
  38. Long Range Arena: A Benchmark for Efficient TransformersarXiv:2011.04006Yi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 414 citations
  39. Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Shamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, et al.2023 · 403 citations
  40. Retrieval Augmentation Reduces Hallucination in ConversationarXiv:2104.07567Kurt Shuster, Spencer Poff, Moya Chen, et al.2021 · 392 citations
  41. Query Rewriting in Retrieval-Augmented Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Xinbei Ma, Yeyun Gong, Pengcheng He, et al.2023 · 384 citations
  42. Towards General Text Embeddings with Multi-stage Contrastive LearningarXiv:2308.03281Zehan Li, Xin Zhang, Yanzhao Zhang, et al.2023 · 384 citations
  43. A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Pradeep Dasigi, Kyle Lo, Iz Beltagy, et al.2021 · 384 citations
  44. Tool Learning with Foundation ModelsACM Computing SurveysYujia Qin, Shengding Hu, Yankai Lin, et al.2023 · 383 citations
  45. Augmented Language Models: a SurveyarXiv:2302.07842Grégoire Mialon, Roberto Dessì, Maria Lomeli, et al.2023 · 369 citations
  46. Revisiting Few-sample BERT Fine-tuningarXiv:2006.05987Tianyi Zhang, Felix Wu, Arzoo Katiyar, et al.2020 · 368 citations
  47. Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated FeedbackarXiv:2302.12813Baolin Peng, Michel Galley, Pengcheng He, et al.2023 · 363 citations
  48. RARR: Researching and Revising What Language Models Say, Using Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Luyu Gao, Zhuyun Dai, Panupong Pasupat, et al.2023 · 359 citations
  49. Towards Mitigating LLM Hallucination via Self ReflectionFindings of the Association for Computational LinguisticsZiwei Ji, Tiezheng Yu, Yan Xu, et al.2023 · 354 citations
  50. Internet-Augmented Dialogue GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Mojtaba Komeili, Kurt Shuster, Jason Weston2022 · 354 citations
  51. Time-Aware Language Models as Temporal Knowledge BasesTransactions of the Association for Computational Linguistics (TACL)Bhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, et al.2022 · 349 citations
  52. Large Language Models for Information Retrieval: A SurveyACM Transactions on Information SystemsYutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen2023 · 339 citations
  53. Unsupervised Corpus Aware Language Model Pre-training for Dense Passage RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Luyu Gao, Jamie Callan2022 · 328 citations
  54. CRITIC: Large Language Models Can Self-Correct with Tool-Interactive CritiquingarXiv:2305.11738Zhibin Gou, Zhihong Shao, Yeyun Gong, et al.2023 · 326 citations
  55. Text and Code Embeddings by Contrastive Pre-TrainingarXiv:2201.10005Arvind Neelakantan, Tao Xu, Raul Puri, et al.2022 · 323 citations
  56. The Power of Noise: Redefining Retrieval for RAG SystemsInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Florin Cuconasu, Giovanni Trappolini, Federico Siciliano, et al.2024 · 312 citations
  57. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)arXiv:2309.17421Zhengyuan Yang, Linjie Li, Kevin Lin, et al.2023 · 311 citations
  58. Retrieval-Augmented Generation for AI-Generated Content: A SurveyarXiv:2402.19473Penghao Zhao, Hailin Zhang, Qinhan Yu, et al.2024 · 301 citations
  59. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
  60. Entity-Based Knowledge Conflicts in Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Shayne Longpre, Kartik Perisetla, Anthony Chen, et al.2021 · 298 citations
  61. PAQ: 65 Million Probably-Asked Questions and What You Can Do With ThemTransactions of the Association for Computational Linguistics (TACL)Patrick Lewis, Yuxiang Wu, Linqing Liu, et al.2021 · 288 citations
  62. DSPy: Compiling Declarative Language Model Calls into Self-Improving PipelinesarXiv:2310.03714Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, et al.2023 · 285 citations
  63. Ragas: Automated Evaluation of Retrieval Augmented GenerationarXiv:2309.15217Shahul Es, Jithin James, Luis Espinosa-Anke, et al.2023 · 283 citations
  64. Corrective Retrieval Augmented GenerationarXiv:2401.15884Shi-Qi Yan, Jia-Chen Gu, Yun Zhu, et al.2024 · 273 citations
  65. Hallucination-Free? Assessing the Reliability of Leading AI Legal Research ToolsarXiv:2405.20362Varun Magesh, Faiz Surani, Matthew Dahl, et al.2024 · 271 citations
  66. LongLoRA: Efficient Fine-tuning of Long-Context Large Language ModelsarXiv:2309.12307Yukang Chen, Shengju Qian, Haotian Tang, et al.2023 · 268 citations
  67. Condenser: a Pre-training Architecture for Dense RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Luyu Gao, Jamie Callan2021 · 261 citations
  68. Multimodal Few-Shot Learning with Frozen Language ModelsarXiv:2106.13884Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.2021 · 258 citations
  69. RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-rankingConference on Empirical Methods in Natural Language Processing (EMNLP)Ruiyang Ren, Yingqi Qu, Jing Liu, et al.2021 · 256 citations
  70. LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kaiyu Yang, Aidan M. Swope, Alex Gu, et al.2023 · 253 citations
  71. Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-trainingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Oshin Agarwal, Heming Ge, Siamak Shakeri, et al.2021 · 239 citations
  72. TrustLLM: Trustworthiness in Large Language ModelsarXiv:2401.05561Yue Huang, Lichao Sun, Haoran Wang, et al.2024 · 237 citations
  73. How Context Affects Language Models' Factual PredictionsarXiv:2005.04611Fabio Petroni, Patrick Lewis, Aleksandra Piktus, et al.2020 · 234 citations
  74. Hurdles to Progress in Long-form Question AnsweringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kalpesh Krishna, Aurko Roy, Mohit Iyyer2021 · 233 citations
  75. GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical InformationBioinformaticsQiao Jin, Yifan Yang, Qingyu Chen, et al.2023 · 223 citations
  76. Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentarXiv:2308.05374Yang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 223 citations
  77. Transformer Memory as a Differentiable Search IndexConference on Neural Information Processing Systems (NeurIPS)Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.2022 · 223 citations
  78. NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding ModelsarXiv:2405.17428Chankyu Lee, Rajarshi Roy, Mengyao Xu, et al.2024 · 222 citations
  79. Teaching language models to support answers with verified quotesarXiv:2203.11147Jacob Menick, Maja Trebacz, Vladimir Mikulik, et al.2022 · 218 citations
  80. Prompting GPT-3 To Be ReliablearXiv:2210.09150Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.2022 · 210 citations
  81. Internet-augmented language models through few-shot prompting for open-domain question answeringarXiv:2203.05115Angeliki Lazaridou, Elena Gribovskaya, Wojciech Stokowiec, et al.2022 · 209 citations
  82. Entities as Experts: Sparse Memory Access with Entity SupervisionConference on Empirical Methods in Natural Language Processing (EMNLP)Thibault Févry, Livio Baldini Soares, Nicholas FitzGerald, et al.2020 · 208 citations
  83. MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and TextConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Hexiang Hu, Xi Chen, et al.2022 · 199 citations
  84. COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingarXiv:2102.08473Yu Meng, Chenyan Xiong, Payal Bajaj, et al.2021 · 198 citations
  85. Making Retrieval-Augmented Language Models Robust to Irrelevant ContextarXiv:2310.01558Ori Yoran, Tomer Wolfson, Ori Ram, et al.2023 · 195 citations
  86. RAPTOR: Recursive Abstractive Processing for Tree-Organized RetrievalarXiv:2401.18059Parth Sarthi, Salman Abdullah, Aditi Tuli, et al.2024 · 193 citations
  87. Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.2022 · 190 citations
  88. Pre-training via ParaphrasingarXiv:2006.15020Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.2020 · 187 citations
  89. Re2G: Retrieve, Rerank, GenerateConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Michael Glass, Gaetano Rossiello, Md Faisal Mahbub Chowdhury, et al.2022 · 184 citations
  90. Knowledge Conflicts for LLMs: A SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Rongwu Xu, Zehan Qi, Zhijiang Guo, et al.2024 · 182 citations
  91. Adapting Language Models to Compress ContextsConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 182 citations
  92. RealTime QA: What's the Answer Right Now?Conference on Neural Information Processing Systems (NeurIPS)Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, et al.2022 · 181 citations
  93. Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Nora Kassner, Philipp Dufter, Hinrich Schütze2021 · 180 citations
  94. Planning with Learned Entity Prompts for Abstractive SummarizationTransactions of the Association for Computational Linguistics (TACL)Shashi Narayan, Yao Zhao, Joshua Maynez, et al.2021 · 180 citations
  95. On the Risk of Misinformation Pollution with Large Language ModelsFindings of the Association for Computational LinguisticsYikang Pan, Liangming Pan, Wenhu Chen, et al.2023 · 179 citations
  96. Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
  97. Simple Entity-Centric Questions Challenge Dense RetrieversConference on Empirical Methods in Natural Language Processing (EMNLP)Christopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, et al.2021 · 169 citations
  98. Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge ConflictsarXiv:2305.13300Jian Xie, Kai Zhang, Jiangjie Chen, et al.2023 · 168 citations
  99. Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language ModelsBioinformaticsMinbyul Jeong, Jiwoong Sohn, Mujeen Sung, et al.2024 · 164 citations
  100. Large Language Models with Controllable Working MemoryFindings of the Association for Computational LinguisticsDaliang Li, Ankit Singh Rawat, Manzil Zaheer, et al.2023 · 158 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/