🔗 Who cites «Transformers without Tears: Improving the Normalization of Self-Attention»

73 papers of our library cite it (of the 149,439 whose bibliographies we read) · 13 with a page here, the most cited first · ← back to «Transformers without Tears: Improving the Normalization of Self-Attention»

1. Conformer: Convolution-augmented Transformer for Speech RecognitionInterspeechAnmol Gulati, James Qin, Chung-Cheng Chiu, et al.2020 · 3,475 citations
2. A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
3. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelBigScience Episode – Workshop on Challenges & Perspectives in Creating Large Language ModelsSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 831 citations
4. Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelarXiv:2201.11990Shaden Smith, Mostofa Patwary, Brandon Norick, et al.2022 · 615 citations
5. Masked Language Model ScoringAnnual Meeting of the Association for Computational Linguistics (ACL)Julian Salazar, Davis Liang, Toan Q. Nguyen, et al.2020 · 447 citations
6. FlauBERT: Unsupervised Language Model Pre-training for FrencharXiv:1912.05372Hang Le, Loïc Vial, Jibril Frej, et al.2019 · 299 citations
7. Understanding the Difficulty of Training TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Liyuan Liu, Xiaodong Liu, Jianfeng Gao, et al.2020 · 231 citations
8. Transformer Quality in Linear TimearXiv:2202.10447Weizhe Hua, Zihang Dai, Hanxiao Liu, et al.2022 · 99 citations
9. BERT Busters: Outlier Dimensions that Disrupt TransformersFindings of the Association for Computational LinguisticsOlga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, et al.2021 · 90 citations
10. Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long DocumentsarXiv:2310.19923Michael Gunther, Jackmin Ong, Isabelle Mohr, et al.2023 · 75 citations
11. Distillation Scaling LawsarXiv:2502.08606Dan Busbridge, Amitis Shidani, Floris Weers, et al.2025 · 26 citations
12. Joint Universal Syntactic and Semantic ParsingTransactions of the Association for Computational Linguistics (TACL)Elias Stengel-Eskin, Kenton Murray, Sheng Zhang, et al.2021 · 16 citations
13. Pangu Ultra: Pushing the Limits of Dense Large Language Models on Ascend NPUsarXiv:2504.07866Yichun Yin, Wenyong Huang, Kaikai Song, et al.2025 · 6 citations

60 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/nguyen-2019-transformers-tears-improving-normalization-self/cited-by/