🧑‍🔬 Noam Shazeer — all works

30 works · ← Noam Shazeer

1. Attention Is All You NeedarXiv:1706.03762Ashish Vaswani, Noam Shazeer, Niki Parmar, et al.2017 · 17,458 citations
2. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
3. Scheduled Sampling for Sequence Prediction with Recurrent Neural Networks ↗arXiv:1506.03099 · no summary yetSamy Bengio et al.2015 · 1,884 citations
4. LaMDA: Language Models for Dialog ApplicationsarXiv:2201.08239Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,344 citations
5. Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity ↗arXiv:2101.03961 · no summary yetWilliam Fedus, Barret Zoph, Noam Shazeer2021 · 1,271 citations
6. Gemma 3 Technical Report ↗arXiv:2503.19786 · no summary yetGemma Team et al.2025 · 1,147 citations
7. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer ↗arXiv:1701.06538 · no summary yetNoam Shazeer et al.2017 · 1,111 citations
8. How Much Knowledge Can You Pack Into the Parameters of a Language Model? ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetAdam Roberts, Colin Raffel, Noam Shazeer2020 · 1,100 citations
9. Exploring the Limits of Language Modeling ↗arXiv:1602.02410 · no summary yetRafal Jozefowicz et al.2016 · 1,091 citations
10. GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding ↗arXiv:2006.16668 · no summary yetDmitry Lepikhin et al.2020 · 894 citations
11. The Best of Both Worlds: Combining Recent Advances in Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Mia Xu Chen, Orhan Firat, Ankur Bapna, et al.2018 · 559 citations
12. Image Transformer ↗arXiv (Cornell University) · no summary yetNiki Parmar et al.2018 · 342 citations
13. Generating Wikipedia by Summarizing Long SequencesarXiv:1801.10198Peter J. Liu, Mohammad Saleh, Etienne Pot, et al.2018 · 334 citations
14. Music Transformer: Generating Music with Long-Term Structure ↗International Conference on Learning Representations · no summary yetCheng-Zhi Anna Huang et al.2019 · 314 citations
15. One Model To Learn Them All ↗arXiv (Cornell University) · no summary yetŁukasz Kaiser et al.2017 · 277 citations
16. Corpora Generation for Grammatical Error Correction ↗Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · no summary yetJared Lichtarge et al.2019 · 213 citations
17. Fast Decoding in Sequence Models using Discrete Latent Variables ↗arXiv (Cornell University) · no summary yetŁukasz Kaiser et al.2018 · 213 citations
18. ST-MoE: Designing Stable and Transferable Sparse Expert Models ↗arXiv:2202.08906 · no summary yetBarret Zoph et al.2022 · 205 citations
19. Mesh-TensorFlow: Deep Learning for SupercomputersarXiv:1811.02084Noam Shazeer, Youlong Cheng, Niki Parmar, et al.2018 · 203 citations
20. Tensor2Tensor for Neural Machine TranslationConference of the Association for Machine Translation in the Americas (AMTA)Ashish Vaswani, Samy Bengio, Eugene Brevdo, et al.2018 · 191 citations
21. Blockwise Parallel Decoding for Deep Autoregressive Models ↗arXiv (Cornell University) · no summary yetMitchell Stern, Noam Shazeer, Jakob Uszkoreit2018 · 143 citations
22. Scaling Up Models and Data with t5x and seqio ↗arXiv:2203.17189 · no summary yetAdam Roberts et al.2022 · 130 citations
23. Do Transformer Modifications Transfer Across Implementations and Applications? ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetSharan Narang et al.2021 · 123 citations
24. GSPMD: General and Scalable Parallelization for ML Computation Graphs ↗arXiv (Cornell University) · no summary yetYuanzhong Xu et al.2021 · 119 citations
25. Music Transformer ↗arXiv (Cornell University) · no summary yetCheng-Zhi Anna Huang et al.2018 · 117 citations
26. Searching for Efficient Transformers for Language Modeling ↗neural information processing systems · no summary yetDavid R. So et al.2021 · 51 citations
27. Primer: Searching for Efficient Transformers for Language Modeling ↗arXiv (Cornell University) · no summary yetDavid R. So et al.2021 · 39 citations
28. High Resolution Medical Image Analysis with Spatial Partitioning ↗arXiv:1909.03108 · no summary yetLe Hou et al.2019 · 33 citations
29. Weakly Supervised Grammatical Error Correction using Iterative Decoding ↗arXiv (Cornell University) · no summary yetJared Lichtarge et al.2018 · 30 citations
30. Large Scale Multi-Domain Multi-Task Learning with MultiModel ↗no summary yetŁukasz Kaiser et al.2018

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/noam-shazeer/works/