🔗 Who cites «Adaptive Input Representations for Neural Language Modeling»

129 papers of our library cite it (of the 149,439 whose bibliographies we read) · 28 with a page here, the most cited first · ← back to «Adaptive Input Representations for Neural Language Modeling»

1. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScalearXiv:2010.11929Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.2020 · 23,726 citations
2. fairseq: A Fast, Extensible Toolkit for Sequence ModelingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Myle Ott, Sergey Edunov, Alexei Baevski, et al.2019 · 3,984 citations
3. XLNet: Generalized Autoregressive Pretraining for Language UnderstandingarXiv:1906.08237Zhilin Yang, Zihang Dai, Yiming Yang, et al.2019 · 3,857 citations
4. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
5. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsarXiv:1909.11942Zhenzhong Lan, Mingda Chen, Sebastian Goodman, et al.2019 · 2,806 citations
6. Multimodal Transformer for Unaligned Multimodal Language SequencesAnnual Meeting of the Association for Computational Linguistics (ACL)Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.2019 · 2,193 citations
7. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsConference on Neural Information Processing Systems (NeurIPS)Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.2020 · 1,421 citations
8. A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
9. Multi-News: A Large-Scale Multi-Document Summarization Dataset and Abstractive Hierarchical ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Alexander Fabbri, Irene Li, Tianwei She, et al.2019 · 750 citations
10. Efficient Content-Based Sparse Attention with Routing TransformersTransactions of the Association for Computational Linguistics (TACL)Aurko Roy, Mohammad Saffar, Ashish Vaswani, et al.2020 · 677 citations
11. Reducing Transformer Depth on Demand with Structured DropoutarXiv:1909.11556Angela Fan, Edouard Grave, Armand Joulin2019 · 560 citations
12. Neural Text Generation with Unlikelihood TrainingarXiv:1908.04319Sean Welleck, Ilia Kulikov, Stephen Roller, et al.2019 · 513 citations
13. Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary SpaceConference on Empirical Methods in Natural Language Processing (EMNLP)Mor Geva, Avi Caciularu, Kevin Ro Wang, et al.2022 · 346 citations
14. Compressive Transformers for Long-Range Sequence ModellingarXiv:1911.05507Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, et al.2019 · 340 citations
15. Cloze-driven Pretraining of Self-attention NetworksarXiv:1903.07785Alexei Baevski, Sergey Edunov, Yinhan Liu, et al.2019 · 286 citations
16. Understanding the Difficulty of Training TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Liyuan Liu, Xiaodong Liu, Jianfeng Gao, et al.2020 · 231 citations
17. Structured Pruning of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ziheng Wang, Jeremy Wohlwend, Tao Lei2020 · 202 citations
18. On The Evaluation of Machine Translation Systems Trained With Back-TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, et al.2020 · 140 citations
19. Efficient Nearest Neighbor Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick2021 · 130 citations
20. A Systematic Evaluation of Large Language Models of CodearXiv:2202.13169Frank F. Xu, Uri Alon, Graham Neubig, et al.2022 · 125 citations
21. XLM-V: Overcoming the Vocabulary Bottleneck in Multilingual Masked Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Davis Liang, Hila Gonen, Yuning Mao, et al.2023 · 120 citations
22. Efficient Large Scale Language Modeling with Mixtures of ExpertsarXiv:2112.10684Mikel Artetxe, Shruti Bhosale, Naman Goyal, et al.2021 · 113 citations
23. Transformer Language Models without Positional Encodings Still Learn Positional InformationarXiv:2203.16634Adi Haviv, Ori Ram, Ofir Press, et al.2022 · 111 citations
24. Linear Transformers Are Secretly Fast Weight ProgrammersarXiv:2102.11174Imanol Schlag, Kazuki Irie, Jurgen Schmidhuber2021 · 111 citations
25. Simple and Effective Noisy Channel Modeling for Neural Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP)Kyra Yee, Yann Dauphin, Michael Auli2019 · 104 citations
26. Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion TokensarXiv:2401.17377Jiacheng Liu, Sewon Min, Luke Zettlemoyer, et al.2024 · 62 citations
27. MiniMax-01: Scaling Foundation Models with Lightning AttentionarXiv:2501.08313MiniMax, Aonian Li, Bangwei Gong, et al.2025 · 50 citations
28. ERNIE-Doc: A Retrospective Long-Document Modeling TransformerarXiv:2012.15688Siyu Ding, Junyuan Shang, Shuohuan Wang, et al.2020 · 27 citations

101 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/baevski-2018-adaptive-input-representations-neural-language/cited-by/