Who cites David Belanger
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsIEEE/CVF International Conference on Computer Vision (ICCV)Ze Liu, Yutong Lin, Yue Cao, et al.2021 · 33,968 citations
- PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
- On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
- RoFormer: Enhanced Transformer with Rotary Position EmbeddingarXiv:2104.09864Jianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 3,028 citations
- Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
- FlashAttention-2: Faster Attention with Better Parallelism and Work PartitioningarXiv:2307.08691Tri Dao2023 · 1,240 citations
- A Unified MRC Framework for Named Entity RecognitionAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoya Li, Jingrong Feng, Yuxian Meng, et al.2020 · 840 citations
- FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
- Named Entity Recognition as Dependency ParsingAnnual Meeting of the Association for Computational Linguistics (ACL)Juntao Yu, Bernd Bohnet, Massimo Poesio2020 · 596 citations
- AudioLM: a Language Modeling Approach to Audio GenerationIEEE/ACM Transactions on Audio Speech and Language ProcessingZalan Borsos, Raphael Marinier, Damien Vincent, et al.2022 · 581 citations
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelarXiv:2401.09417Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.2024 · 500 citations
- Double Embeddings and CNN-based Sequence Labeling for Aspect ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Hu Xu, Bing Liu, Lei Shu, et al.2018 · 499 citations
- Template-Based Named Entity Recognition Using BARTFindings of the Association for Computational LinguisticsLeyang Cui, Yu Wu, Jian Liu, et al.2021 · 421 citations
- Long Range Arena: A Benchmark for Efficient TransformersarXiv:2011.04006Yi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 414 citations
- FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
- LongT5: Efficient Text-To-Text Transformer for Long SequencesFindings of the Association for Computational LinguisticsMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 399 citations
- A Neural Layered Model for Nested Named Entity RecognitionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Meizhi Ju, Makoto Miwa, Sophia Ananiadou2018 · 379 citations
- Simultaneously Self-Attending to All Mentions for Full-Abstract Biological Relation ExtractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Patrick Verga, Emma Strubell, Andrew McCallum2018 · 353 citations
- Efficient Attentions for Long Document SummarizationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Luyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 336 citations
- Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationTransactions of the Association for Computational Linguistics (TACL)Jonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 301 citations
- Deep Exhaustive Model for Nested Named Entity RecognitionConference on Empirical Methods in Natural Language Processing (EMNLP)Mohammad Golam Sohrab, Makoto Miwa2018 · 300 citations
- Entity Linking via Joint Encoding of Types, Descriptions, and ContextConference on Empirical Methods in Natural Language Processing (EMNLP)Nitish Gupta, Sameer Singh, Dan Roth2017 · 299 citations
- xLSTM: Extended Long Short-Term MemoryConference on Neural Information Processing Systems (NeurIPS)Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.2024 · 296 citations
- Perceiver: General Perception with Iterative AttentionarXiv:2103.03206Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 269 citations
- Transformers learn in-context by gradient descentarXiv:2212.07677Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, et al.2022 · 247 citations
- NCRF++: An Open-source Neural Sequence Labeling ToolkitAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Yang, Yue Zhang2018 · 245 citations
- Design Challenges and Misconceptions in Neural Sequence LabelingInternational Conference on Computational Linguistics (COLING)Jie Yang, Shuailong Liang, Yue Zhang2018 · 197 citations
- Charformer: Fast Character Transformers via Gradient-based Subword TokenizationarXiv:2106.12672Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 186 citations
- Adapting Language Models to Compress ContextsConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 182 citations
- Zero-Shot Cross-Lingual Transfer with Meta LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Farhad Nooralahzadeh, Giannis Bekoulis, Johannes Bjerva, et al.2020 · 171 citations
- SCROLLS: Standardized CompaRison Over Long Language SequencesConference on Empirical Methods in Natural Language Processing (EMNLP)Uri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 165 citations
- Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
- Learning Distributed Representations of Texts and Entities from Knowledge BaseTransactions of the Association for Computational Linguistics (TACL)Ikuya Yamada, Hiroyuki Shindo, Hideaki Takeda, et al.2017 · 125 citations
- H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language ModelsarXiv:2306.14048Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.2023 · 124 citations
- LongNet: Scaling Transformers to 1,000,000,000 TokensarXiv:2307.02486Jiayu Ding, Shuming Ma, Li Dong, et al.2023 · 123 citations
- A Length-Extrapolatable TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Yutao Sun, Li Dong, Barun Patra, et al.2023 · 118 citations
- In-context Autoencoder for Context Compression in a Large Language ModelarXiv:2307.06945Tao Ge, Jing Hu, Lei Wang, et al.2023 · 114 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Unlimiformer: Long-Range Transformers with Unlimited Length InputConference on Neural Information Processing Systems (NeurIPS)Amanda Bertsch, Uri Alon, Graham Neubig, et al.2023 · 111 citations
- Linear Transformers Are Secretly Fast Weight ProgrammersarXiv:2102.11174Imanol Schlag, Kazuki Irie, Jurgen Schmidhuber2021 · 111 citations
- Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
- Do Long-Range Language Models Actually Use Long-Range Context?Conference on Empirical Methods in Natural Language Processing (EMNLP)Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, et al.2021 · 101 citations
- Transformer Quality in Linear TimearXiv:2202.10447Weizhe Hua, Zihang Dai, Hanxiao Liu, et al.2022 · 99 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- Landmark Attention: Random-Access Infinite Context Length for TransformersarXiv:2305.16300Amirkeivan Mohtashami, Martin Jaggi2023 · 88 citations
- Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?Findings of the Association for Computational LinguisticsYi Tay, Mostafa Dehghani, Samira Abnar, et al.2023 · 86 citations
- MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
- Domain Adaptation with Pre-trained Transformers for Query-Focused Abstractive Text SummarizationComputational LinguisticsMd Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang2022 · 76 citations
- SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
- The Devil in Linear TransformerConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Qin, Xiaodong Han, Weixuan Sun, et al.2022 · 67 citations
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
- Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
- Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
- Long-Context Language Modeling with Parallel Context EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Howard Yen, Tianyu Gao, Danqi Chen2024 · 44 citations
- TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormerarXiv:2307.14995Zhen Qin, Dong Li, Weigao Sun, et al.2023 · 33 citations
- TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked TextConference on Empirical Methods in Natural Language Processing (EMNLP)Songshuo Lu, Hua Wang, Yutian Rong, et al.2025 · 32 citations
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language ModelsarXiv:2401.04658Zhen Qin, Weigao Sun, Dong Li, et al.2024 · 31 citations
- Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 27 citations
- Block-State TransformersarXiv:2306.09539Mahan Fathi, Jonathan Pilault, Orhan Firat, et al.2023 · 20 citations
- Modeling Speech Acts in Asynchronous Conversations: A Neural-CRF ApproachShafiq Joty, Tasnim Mohiuddin2018 · 20 citations
- Linearizing Large Language ModelsarXiv:2405.06640Jean Mercat, Igor Vasiljevic, Sedrick Keh, et al.2024 · 16 citations
- Rewarding Coreference Resolvers for Being Consistent with World KnowledgeConference on Empirical Methods in Natural Language Processing (EMNLP)Rahul Aralikatte, Heather Lent, Ana Valeria Gonzalez, et al.2019 · 16 citations
- Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhisong Zhang, Yan Wang, Xinting Huang, et al.2025 · 14 citations
- New Insights into Cross-Document Event Coreference: Systematic Comparison and a Simplified ApproachWorkshop on Narrative UnderstandingAndres Cremisini, Mark Finlayson2020 · 13 citations
- PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
- Towards JointUD: Part-of-speech Tagging and Lemmatization using Recurrent Neural NetworksGor Arakelyan, Karen Hambardzumyan, Hrant Khachatrian2018 · 10 citations
- Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language UnderstandingarXiv:2205.10687Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 9 citations
- Just read twice: closing the recall gap for recurrent language modelsarXiv:2407.05483Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re2024 · 8 citations
- An End-to-End OCR Framework for Robust Arabic-Handwriting Recognition using a Novel Transformers-based Model and an Innovative 270 Million-Words Multi-Font Corpus of Classical Arabic with DiacriticsarXiv:2208.11484Aly Mostafa, Omar Mohamed, Ali Ashraf, et al.2022 · 3 citations
- Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
- MiniMax Sparse AttentionarXiv:2606.13392Xunhao Lai, Weiqi Xu, Yufeng Yang, et al.2026 · 2 citations
- A Survey of Retentive NetworkFindings of the Association for Computational LinguisticsHaiqi Yang, Zhiyuan Li, Yi Chang, et al.2026
- From Logical to Computational Sparsity: Structure-Aware Block-Sparse Attention for Long-Code CompletionAnnual Meeting of the Association for Computational Linguistics (ACL)Yanli Wang, Yanlin Wang, Bowen Zhang, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/david-belanger/cited-by/