Elamur Research⌕
☰
home / papers / Longformer: The Long-Document Transformer / cited by

Who cites «Longformer: The Long-Document Transformer»

1,737 papers of our library cite it (of the 140,884 whose bibliographies we read) · 101 with a page here, the most cited first · page 1 of 2 · 1–100 · ← the paper

1 2

  1. Transformers: State-of-the-Art Natural Language ProcessingThomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,591 citations
  2. Survey of Hallucination in Natural Language GenerationZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,947 citations
  3. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,221 citations
  4. On the Opportunities and Risks of Foundation ModelsRishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,044 citations
  5. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
  6. Lost in the Middle: How Language Models Use Long ContextsNelson F. Liu, Kevin Lin, John Hewitt, et al.2023 · 2,540 citations
  7. Making Pre-trained Language Models Better Few-shot LearnersTianyu Gao, Adam Fisch, Danqi Chen2021 · 1,952 citations
  8. DeBERTa: Decoding-enhanced BERT with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,800 citations
  9. Qwen Technical ReportJinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,643 citations
  10. Unifying Large Language Models and Knowledge Graphs: A RoadmapShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,545 citations
  11. Efficient Transformers: A SurveyYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,513 citations
  12. Code Llama: Open Foundation Models for CodeBaptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
  13. Recipes for Building an Open-Domain ChatbotStephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,206 citations
  14. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze2021 · 1,118 citations
  15. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 992 citations
  16. Can Large Language Models Transform Computational Social Science?Caleb Ziems, William Held, Omar Shaikh, et al.2023 · 776 citations
  17. Fact or Fiction: Verifying Scientific ClaimsDavid Wadden, Shanchuan Lin, Kyle Lo, et al.2020 · 706 citations
  18. FNet: Mixing Tokens with Fourier TransformsJames Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 593 citations
  19. FinQA: A Dataset of Numerical Reasoning over Financial DataZhiyu Chen, Wenhu Chen, Charese Smiley, et al.2021 · 510 citations
  20. LongBench: A Bilingual, Multitask Benchmark for Long Context UnderstandingYushi Bai, Xin Lv, Jiajie Zhang, et al.2023 · 505 citations
  21. Large Language Models: A SurveyShervin Minaee, Tomas Mikolov, Narjes Nikzad, et al.2024 · 467 citations
  22. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsYanis Labrak, Adrien Bazoge, Emmanuel Morin, et al.2024 · 406 citations
  23. LongT5: Efficient Text-To-Text Transformer for Long SequencesMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 398 citations
  24. Long Range Arena: A Benchmark for Efficient TransformersYi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 396 citations
  25. ♫ MuSiQue: Multihop Questions via Single-hop Question CompositionHarsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.2022 · 384 citations
  26. Aligning AI With Shared Human ValuesDan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 382 citations
  27. ETC: Encoding Long and Structured Inputs in TransformersJoshua Ainslie, Santiago Ontañón, Chris Alberti, et al.2020 · 377 citations
  28. A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersPradeep Dasigi, Kyle Lo, Iz Beltagy, et al.2021 · 372 citations
  29. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 355 citations
  30. Efficient Attentions for Long Document SummarizationLuyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 334 citations
  31. LongLoRA: Efficient Fine-tuning of Long-Context Large Language ModelsYukang Chen, Shengju Qian, Haotian Tang, et al.2023 · 265 citations
  32. Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic ParsingXi Victoria Lin, Richard Socher, Caiming Xiong2020 · 261 citations
  33. LexGLUE: A Benchmark Dataset for Legal Language Understanding in EnglishIlias Chalkidis; Abhik Jana; Dirk Hartung; Michael Bommarito; Ion Androutsopoulos; Daniel Martin Katz;, Nikolaos Aletras2021 · 256 citations
  34. ILDC for CJPE: Indian Legal Documents Corpus for Court Judgment Prediction and ExplanationVijit Malik, Rishabh Sanjay, Shubham Kumar Nigam, et al.2021 · 251 citations
  35. Perceiver: General Perception with Iterative AttentionAndrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 238 citations
  36. Detecting Hallucinated Content in Conditional Neural Sequence GenerationChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 229 citations
  37. TrustLLM: Trustworthiness in Large Language ModelsYue Huang, Lichao Sun, Haoran Wang, et al.2024 · 226 citations
  38. Fine-Grained Human Feedback Gives Better Rewards for Language Model TrainingZeqiu Wu, Yushi Hu, Weijia Shi, et al.2023 · 212 citations
  39. Compressing Context to Enhance Inference Efficiency of Large Language ModelsYucheng Li, Bo Dong, Frank Guerin, et al.2023 · 208 citations
  40. PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document SummarizationWen Xiao, Iz Beltagy, Giuseppe Carenini, et al.2022 · 204 citations
  41. Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue SummarizationJiaao Chen, Diyi Yang2020 · 202 citations
  42. MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionHuiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 197 citations
  43. RAPTOR: Recursive Abstractive Processing for Tree-Organized RetrievalParth Sarthi, Salman Abdullah, Aditi Tuli, et al.2024 · 191 citations
  44. Supervised and Unsupervised Neural Approaches to Text ReadabilityMatej Martinc, Senja Pollak, Marko Robnik-Šikonja2021 · 190 citations
  45. Learning to Compress Prompts with Gist TokensJesse Mu, Xiang Lisa Li, Noah Goodman2023 · 170 citations
  46. Generative Representational Instruction TuningNiklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 165 citations
  47. SCROLLS: Standardized CompaRison Over Long Language SequencesUri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 162 citations
  48. QuALITY: Question Answering with Long Input Texts, Yes!Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi, et al.2022 · 161 citations
  49. DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer ModelsSam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.2023 · 159 citations
  50. WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMsSeungju Han, Kavel Rao, Allyson Ettinger, et al.2024 · 155 citations
  51. Word-Level Coreference ResolutionVladimir Dobrovolskii2021 · 146 citations
  52. Fact-Checking Complex Claims with Program-Guided ReasoningLiangming Pan, Xiaobao Wu, Xinyuan Lu, et al.2023 · 145 citations
  53. SummScreen: A Dataset for Abstractive Screenplay SummarizationMingda Chen, Zewei Chu, Sam Wiseman, et al.2022 · 136 citations
  54. Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse AttentionJingyang Yuan, Huazuo Gao, Damai Dai, et al.2025 · 135 citations
  55. Retrieval meets Long Context Large Language ModelsPeng Xu, Wei Ping, Xianchao Wu, et al.2023 · 129 citations
  56. Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction BenchmarkJoel Niklaus, Ilias Chalkidis, Matthias Stürmer2021 · 129 citations
  57. InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context MemoryChaojun Xiao, Pengle Zhang, Xu Han, et al.2024 · 125 citations
  58. LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal DomainJoel Niklaus, Veton Matoshi, Pooja Rani, et al.2023 · 122 citations
  59. DocNLI: A Large-scale Dataset for Document-level Natural Language InferenceWenpeng Yin, Dragomir Radev, Caiming Xiong2021 · 121 citations
  60. RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective AugmentationFangyuan Xu, Weijia Shi, Eunsol Choi2023 · 114 citations
  61. Olmo 3Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 109 citations
  62. DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsGuangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 109 citations
  63. Coreference Resolution without Span RepresentationsYuval Kirstain, Ori Ram, Omer Levy2021 · 109 citations
  64. On Generalization in Coreference ResolutionShubham Toshniwal, Patrick Xia, Sam Wiseman, et al.2021 · 62 citations
  65. LingMess: Linguistically Informed Multi Expert Scorers for Coreference ResolutionShon Otmazgin, Arie Cattan, Yoav Goldberg2023 · 54 citations
  66. DiscoScore: Evaluating Text Generation with BERT and Discourse CoherenceWei Zhao, Michael Strube, Steffen Eger2023 · 53 citations
  67. Scaling Laws of RoPE-based ExtrapolationXiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 53 citations
  68. F-coref: Fast, Accurate and Easy to Use Coreference ResolutionShon Otmazgin, Arie Cattan, Yoav Goldberg2022 · 45 citations
  69. Extractive Summarization Considering Discourse and Coreference Relations based on Heterogeneous GraphYin Jou Huang, Sadao Kurohashi2021 · 41 citations
  70. Maverick: Efficient and Accurate Coreference Resolution Defying Recent TrendsGiuliano Martinelli, Edoardo Barba, Roberto Navigli2024 · 36 citations
  71. Sequential Cross-Document Coreference ResolutionEmily Allaway, Shuai Wang, Miguel Ballesteros2021 · 22 citations
  72. Discourse Analysis via Questions and Answers: Parsing Dependency Structures of Questions Under DiscussionWei-Jen Ko, Yating Wu, Cutter Dalton, et al.2023 · 21 citations
  73. QUDeval: The Evaluation of Questions Under Discussion Discourse ParsingYating Wu, Ritika Mangla, Greg Durrett, et al.2023 · 21 citations
  74. What happens before and after: Multi-Event Commonsense in Event Coreference ResolutionSahithya Ravi, Chris Tanner, Raymond Ng, et al.2023 · 21 citations
  75. Robustifying Multi-hop QA through Pseudo-Evidentiality TrainingKyungjae Lee, Seung-won Hwang, Sang-eun Han, et al.2021 · 19 citations
  76. What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act RecognitionPiotr Żelasko, Raghavendra Pappagari, Najim Dehak2021 · 19 citations
  77. A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference ResolutionBowen Ding, Qingkai Min, Shengkun Ma, et al.2024 · 17 citations
  78. 2*n is better than n²: Decomposing Event Coreference Resolution into Two Tractable ProblemsShafiuddin Rehan Ahmed, Abhijnan Nath, James H. Martin, et al.2023 · 17 citations
  79. Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge DistillationAbhijnan Nath, Shadi Manafi Avari, Avyakta Chelle, et al.2024 · 16 citations
  80. HeRo: RoBERTa and Longformer Hebrew Language ModelsVitaly Shalumov, Harel Haskey2023 · 15 citations
  81. Improving Event Coreference Resolution Using Document-level and Topic-level InformationSheng Xu, Peifeng Li, Qiaoming Zhu2022 · 15 citations
  82. Major Entity Identification: A Generalizable Alternative to Coreference ResolutionKawshik Manikantan, Shubham Toshniwal, Makarand Tapaswi, et al.2024 · 13 citations
  83. Dual Cache for Long Document Neural Coreference ResolutionQipeng Guo, Xiangkun Hu, Yue Zhang, et al.2023 · 12 citations
  84. DiBiMT: A Gold Evaluation Benchmark for Studying Lexical Ambiguity in Machine TranslationFederico Martelli, Stefano Perrella, Niccolò Campolungo, et al.2025 · 11 citations
  85. On the Importance of Tokenization in Arabic Embedding ModelsMohamed Alkaoud, Mairaj Syed2020 · 11 citations
  86. Challenges to Evaluating the Generalization of Coreference Resolution Models: A Measurement Modeling PerspectiveIan Porada, Alexandra Olteanu, Kaheer Suleman, et al.2024 · 10 citations
  87. Linear Cross-document Event Coreference Resolution with X-AMRShafiuddin Rehan Ahmed, George Arthur Baker, Evi Judge, et al.2024 · 9 citations
  88. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language UnderstandingAbbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 9 citations
  89. A Controlled Reevaluation of Coreference Resolution ModelsIan Porada, Xiyuan Zou, Jackie Chi Kit Cheung2024 · 7 citations
  90. Multilingual Coreference Resolution in Low-resource South Asian LanguagesRitwik Mishra, Pooja Desur, Rajiv Ratn Shah, et al.2024 · 7 citations
  91. Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality EnsemblesAbhijnan Nath, Huma Jamil, Shafiuddin Rehan Ahmed, et al.2024 · 7 citations
  92. Arabic Text Diacritization In The Age Of Transfer Learning: Token Classification Is All You NeedAbderrahman Skiredj, Ismail Berrada2024 · 3 citations
  93. Spotlights and Blindspots: Evaluating Machine-Generated Text DetectionKevin Stowe, Kailash Patil2026 · 1 citation
  94. When Consistency Becomes Bias: Interviewer Effects in Semi-Structured Clinical InterviewsHasindri Watawana, Sergio Burdisso, Diego A. Moreno-Galván, et al.2026 · 1 citation
  95. LCHAIM - Investigating Long Context Reasoning in HebrewEhud Malul, Oriel Perets, Ziv Mor, et al.2025 · 1 citation
  96. Entity-Level Sentiment Analysis with Sentence Relevance DetectionEgil Rønningstad, Roman Klinger, Lilja Øvrelid, et al.2026
  97. Identifying Imaging Follow-Up in Radiology Reports: A Comparative Analysis of Traditional ML and LLM ApproachesNamu Park, Giridhar Kaushik Ramachandran, Kevin Lybarger, et al.2026
  98. Is There Anything More Deceptive than an Obvious Fact? Investigating Implicitness in User-Generated Argumentative TextEkaterina Sviridova, Elena Cabrio, Serena Villata2026
  99. SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language ModelsDong Liu, Yanxuan Yu2026
  100. Survey on Key Technologies for Large Language Model Pre-training Systems (大语言模型预训练系统关键技术综述)Yanjie Gao (高彦杰), Yueguo Chen (陈跃国)2025

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/cited-by/