🧑‍🔬 Who cites Andreea Gane

452 citations of their works from 452 papers of our library (of the 149,439 whose bibliographies we read) · 73 with a page here, the most cited first · ← Andreea Gane

1. Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsIEEE/CVF International Conference on Computer Vision (ICCV)Ze Liu, Yutong Lin, Yue Cao, et al.2021 · 33,968 citations
2. PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
3. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
4. RoFormer: Enhanced Transformer with Rotary Position EmbeddingarXiv:2104.09864Jianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 3,028 citations
5. Personalizing Dialogue Agents: I have a dog, do you have pets too?Annual Meeting of the Association for Computational Linguistics (ACL)Saizheng Zhang, Emily Dinan, Jack Urbanek, et al.2018 · 1,854 citations
6. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
7. FlashAttention-2: Faster Attention with Better Parallelism and Work PartitioningarXiv:2307.08691Tri Dao2023 · 1,240 citations
8. DailyDialog: A Manually Labelled Multi-turn Dialogue DatasetarXiv:1710.03957Yanran Li, Hui Su, Xiaoyu Shen, et al.2017 · 1,206 citations
9. Wizard of Wikipedia: Knowledge-Powered Conversational agentsarXiv:1811.01241Emily Dinan, Stephen Roller, Kurt Shuster, et al.2018 · 1,067 citations
10. FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
11. AudioLM: a Language Modeling Approach to Audio GenerationIEEE/ACM Transactions on Audio Speech and Language ProcessingZalan Borsos, Raphael Marinier, Damien Vincent, et al.2022 · 581 citations
12. Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelarXiv:2401.09417Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.2024 · 500 citations
13. Deal or No Deal? End-to-End Learning of Negotiation DialoguesConference on Empirical Methods in Natural Language Processing (EMNLP)Mike Lewis, Denis Yarats, Yann Dauphin, et al.2017 · 423 citations
14. Long Range Arena: A Benchmark for Efficient TransformersarXiv:2011.04006Yi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 414 citations
15. FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
16. LongT5: Efficient Text-To-Text Transformer for Long SequencesFindings of the Association for Computational LinguisticsMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 399 citations
17. Efficient Attentions for Long Document SummarizationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Luyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 336 citations
18. Training Millions of Personalized Dialogue AgentsConference on Empirical Methods in Natural Language Processing (EMNLP)Pierre-Emmanuel Mazaré, Samuel Humeau, Martin Raison, et al.2018 · 336 citations
19. Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
20. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
21. Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationTransactions of the Association for Computational Linguistics (TACL)Jonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 301 citations
22. xLSTM: Extended Long Short-Term MemoryConference on Neural Information Processing Systems (NeurIPS)Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.2024 · 296 citations
23. Perceiver: General Perception with Iterative AttentionarXiv:2103.03206Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 269 citations
24. Transformers learn in-context by gradient descentarXiv:2212.07677Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, et al.2022 · 247 citations
25. Towards Exploiting Background Knowledge for Building Conversation SystemsConference on Empirical Methods in Natural Language Processing (EMNLP)Nikita Moghe, Siddhartha Arora, Suman Banerjee, et al.2018 · 244 citations
26. Towards Conversational Recommendation over Multi-Type DialogsAnnual Meeting of the Association for Computational Linguistics (ACL)Zeming Liu, Haifeng Wang, Zheng-Yu Niu, et al.2020 · 230 citations
27. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationarXiv:2106.12672Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 186 citations
28. Adapting Language Models to Compress ContextsConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 182 citations
29. Improving Neural Language Models with a Continuous CachearXiv:1612.04426Edouard Grave, Armand Joulin, Nicolas Usunier2016 · 179 citations
30. SCROLLS: Standardized CompaRison Over Long Language SequencesConference on Empirical Methods in Natural Language Processing (EMNLP)Uri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 165 citations
31. Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
32. H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language ModelsarXiv:2306.14048Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.2023 · 124 citations
33. LongNet: Scaling Transformers to 1,000,000,000 TokensarXiv:2307.02486Jiayu Ding, Shuming Ma, Li Dong, et al.2023 · 123 citations
34. A Length-Extrapolatable TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Yutao Sun, Li Dong, Barun Patra, et al.2023 · 118 citations
35. In-context Autoencoder for Context Compression in a Large Language ModelarXiv:2307.06945Tao Ge, Jing Hu, Lei Wang, et al.2023 · 114 citations
36. A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
37. Unlimiformer: Long-Range Transformers with Unlimited Length InputConference on Neural Information Processing Systems (NeurIPS)Amanda Bertsch, Uri Alon, Graham Neubig, et al.2023 · 111 citations
38. Linear Transformers Are Secretly Fast Weight ProgrammersarXiv:2102.11174Imanol Schlag, Kazuki Irie, Jurgen Schmidhuber2021 · 111 citations
39. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
40. Do Long-Range Language Models Actually Use Long-Range Context?Conference on Empirical Methods in Natural Language Processing (EMNLP)Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, et al.2021 · 101 citations
41. Transformer Quality in Linear TimearXiv:2202.10447Weizhe Hua, Zihang Dai, Hanxiao Liu, et al.2022 · 99 citations
42. CoDraw: Collaborative Drawing as a Testbed for Grounded Goal-driven CommunicationAnnual Meeting of the Association for Computational Linguistics (ACL)Jin-Hwa Kim, Nikita Kitaev, Xinlei Chen, et al.2019 · 94 citations
43. How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
44. Landmark Attention: Random-Access Infinite Context Length for TransformersarXiv:2305.16300Amirkeivan Mohtashami, Martin Jaggi2023 · 88 citations
45. Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?Findings of the Association for Computational LinguisticsYi Tay, Mostafa Dehghani, Samira Abnar, et al.2023 · 86 citations
46. MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
47. Domain Adaptation with Pre-trained Transformers for Query-Focused Abstractive Text SummarizationComputational LinguisticsMd Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang2022 · 76 citations
48. SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
49. The Devil in Linear TransformerConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Qin, Xiaodong Han, Weixuan Sun, et al.2022 · 67 citations
50. MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
51. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
52. Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
53. Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
54. Chinese Zero Pronoun Resolution with Deep Memory NetworkConference on Empirical Methods in Natural Language Processing (EMNLP)Qingyu Yin, Yu Zhang, Weinan Zhang, et al.2017 · 55 citations
55. Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
56. Long-Context Language Modeling with Parallel Context EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Howard Yen, Tianyu Gao, Danqi Chen2024 · 44 citations
57. TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormerarXiv:2307.14995Zhen Qin, Dong Li, Weigao Sun, et al.2023 · 33 citations
58. TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked TextConference on Empirical Methods in Natural Language Processing (EMNLP)Songshuo Lu, Hua Wang, Yutian Rong, et al.2025 · 32 citations
59. Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language ModelsarXiv:2401.04658Zhen Qin, Weigao Sun, Dong Li, et al.2024 · 31 citations
60. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 27 citations
61. Block-State TransformersarXiv:2306.09539Mahan Fathi, Jonathan Pilault, Orhan Firat, et al.2023 · 20 citations
62. Linearizing Large Language ModelsarXiv:2405.06640Jean Mercat, Igor Vasiljevic, Sedrick Keh, et al.2024 · 16 citations
63. Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhisong Zhang, Yan Wang, Xinting Huang, et al.2025 · 14 citations
64. PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
65. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language UnderstandingarXiv:2205.10687Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 9 citations
66. Just read twice: closing the recall gap for recurrent language modelsarXiv:2407.05483Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re2024 · 8 citations
67. An End-to-End OCR Framework for Robust Arabic-Handwriting Recognition using a Novel Transformers-based Model and an Innovative 270 Million-Words Multi-Font Corpus of Classical Arabic with DiacriticsarXiv:2208.11484Aly Mostafa, Omar Mohamed, Ali Ashraf, et al.2022 · 3 citations
68. Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
69. MiniMax Sparse AttentionarXiv:2606.13392Xunhao Lai, Weiqi Xu, Yufeng Yang, et al.2026 · 2 citations
70. A Survey of Retentive NetworkFindings of the Association for Computational LinguisticsHaiqi Yang, Zhiyuan Li, Yi Chang, et al.2026
71. From Benchmarks to Skills: Low-Rank Factors for LLM EvaluationTransactions of the Association for Computational Linguistics (TACL)Aviya Maimon, Amir David Nisan Cohen, Gal Vishne, et al.2026
72. From Logical to Computational Sparsity: Structure-Aware Block-Sparse Attention for Long-Code CompletionAnnual Meeting of the Association for Computational Linguistics (ACL)Yanli Wang, Yanlin Wang, Bowen Zhang, et al.2026
73. SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language ModelsJoint Conference on Lexical and Computational Semantics (*SEM)Dong Liu, Yanxuan Yu2026

379 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/andreea-gane/cited-by/