🧑‍🔬 Ashish Vaswani — all works

52 works · ← Ashish Vaswani

1. Attention Is All You NeedarXiv:1706.03762Ashish Vaswani, Noam Shazeer, Niki Parmar, et al.2017 · 17,458 citations
2. Self-Attention with Relative Position RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Peter Shaw, Jakob Uszkoreit, Ashish Vaswani2018 · 2,848 citations
3. Bottleneck Transformers for Visual Recognition ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetAravind Srinivas et al.2021 · 1,310 citations
4. Attention Augmented Convolutional Networks ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetIrwan Bello et al.2019 · 1,246 citations
5. Efficient Content-Based Sparse Attention with Routing TransformersTransactions of the Association for Computational Linguistics (TACL)Aurko Roy, Mohammad Saffar, Ashish Vaswani, et al.2020 · 677 citations
6. The Best of Both Worlds: Combining Recent Advances in Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Mia Xu Chen, Orhan Firat, Ankur Bapna, et al.2018 · 559 citations
7. Scaling Local Self-Attention for Parameter Efficient Visual Backbones ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetAshish Vaswani et al.2021 · 476 citations
8. Learning Whom to Trust with MACEConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Dirk Hovy, Taylor Berg-Kirkpatrick, Ashish Vaswani, et al.2013 · 473 citations
9. Image Transformer ↗arXiv (Cornell University) · no summary yetNiki Parmar et al.2018 · 342 citations
10. Decoding with Large-Scale Neural Language Models Improves TranslationConference on Empirical Methods in Natural Language Processing (EMNLP)Ashish Vaswani, Yinggong Zhao, Victoria Fossum, et al.2013 · 318 citations
11. Music Transformer: Generating Music with Long-Term Structure ↗International Conference on Learning Representations · no summary yetCheng-Zhi Anna Huang et al.2019 · 314 citations
12. One Model To Learn Them All ↗arXiv (Cornell University) · no summary yetŁukasz Kaiser et al.2017 · 277 citations
13. Stand-Alone Self-Attention in Vision Models ↗arXiv (Cornell University) · no summary yetPrajit Ramachandran et al.2019 · 267 citations
14. Fast Decoding in Sequence Models using Discrete Latent Variables ↗arXiv (Cornell University) · no summary yetŁukasz Kaiser et al.2018 · 213 citations
15. Stay on the Path: Instruction Fidelity in Vision-and-Language Navigation ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetVihan Jain et al.2019 · 205 citations
16. Mesh-TensorFlow: Deep Learning for SupercomputersarXiv:1811.02084Noam Shazeer, Youlong Cheng, Niki Parmar, et al.2018 · 203 citations
17. Tensor2Tensor for Neural Machine TranslationConference of the Association for Machine Translation in the Americas (AMTA)Ashish Vaswani, Samy Bengio, Eugene Brevdo, et al.2018 · 191 citations
18. DeepConsensus improves the accuracy of sequences with a gap-aware sequence transformer ↗Nature Biotechnology · no summary yetGunjan Baid et al.2022 · 150 citations
19. Aligning context-based statistical models of language with brain activity during reading ↗Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetLeila Wehbe et al.2014 · 122 citations
20. Music Transformer ↗arXiv (Cornell University) · no summary yetCheng-Zhi Anna Huang et al.2018 · 117 citations
21. Supertagging With LSTMs ↗Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetAshish Vaswani et al.2016 · 107 citations
22. Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers ↗arXiv (Cornell University) · no summary yetYi Tay et al.2021 · 104 citations
23. Unsupervised Neural Hidden Markov Models ↗Proceedings of the Workshop on Structured Prediction for NLP · no summary yetKe M. Tran et al.2016 · 81 citations
24. Theory and Experiments on Vector Quantized Autoencoders ↗arXiv (Cornell University) · no summary yetAurko Roy et al.2018 · 67 citations
25. The Efficiency Misnomer ↗arXiv (Cornell University) · no summary yetMostafa Dehghani et al.2021 · 50 citations
26. Simple, Fast Noise-Contrastive Estimation for Large RNN Vocabularies ↗Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetBarret Zoph et al.2016 · 45 citations
27. Name Tagging for Low-resource Incident Languages based on Expectation-driven Learning ↗Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetBoliang Zhang et al.2016 · 44 citations
28. Hassan: A Virtual Human for Tactical Questioning ↗Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue · no summary yetDavid Traum et al.2007 · 42 citations
29. Smaller Alignment Models for Better Translations: Unsupervised Word Alignment with the l0-norm ↗Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetAshish Vaswani, Liang Huang, David Chiang2012 · 37 citations
30. Unifying Bayesian Inference and Vector Space Models for Improved Decipherment ↗Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetQing Dou et al.2015 · 28 citations
31. Beyond Parallel Data: Joint Word Alignment and Decipherment Improves Machine Translation ↗Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetQing Dou, Ashish Vaswani, Kevin Knight2014 · 27 citations
32. Radiobot-CFF: a spoken dialogue system for military training ↗Interspeech (USB) · no summary yetAntonio Roque et al.2006 · 25 citations
33. Rule Markov Models for Fast Tree-to-String Translation ↗Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies · no summary yetAshish Vaswani et al.2011 · 21 citations
34. Efficient Structured Inference for Transition-Based Parsing with Neural Networks and Error States ↗Transactions of the Association for Computational Linguistics · no summary yetAshish Vaswani, Kenji Sagae2016 · 20 citations
35. Model Invertibility Regularization: Sequence Alignment With or Without Parallel Data ↗Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetTomer Levinboim, Ashish Vaswani, David Chiang2015 · 20 citations
36. Models and Training for Unsupervised Preposition Sense Disambiguation ↗Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies · no summary yetDirk Hovy et al.2011 · 17 citations
37. Rethinking Reflection in Pre-TrainingarXiv:2504.04022Essential AI: Darsh J Shah, Peter Rushton, Somanshu Singla, et al.2025 · 15 citations
38. Fast, Greedy Model Minimization for Unsupervised Tagging ↗Proceedings of the 23rd International Conference on Computational Linguistics (Coling 2010) · no summary yetSujith Ravi et al.2010 · 15 citations
39. Efficient Optimization of an MDL-Inspired Objective Function for Unsupervised Part-Of-Speech Tagging ↗Proceedings of the ACL 2010 Conference Short Papers · no summary yetAshish Vaswani, Adam Pauls, David Chiang2010 · 15 citations
40. Towards a better understanding of Vector Quantized Autoencoders ↗no summary yetAurko Roy et al.2018 · 13 citations
41. Evaluation of a Spoken Dialogue System for Virtual Reality Call for Fire Training ↗no summary yetSusan M. Robinson et al.2007 · 12 citations
42. Practical Efficiency of Muon for Pretraining ↗arXiv (Cornell University) · no summary yetEssential AI et al.2025 · 10 citations
43. Simple and Efficient ways to Improve REALM ↗Proceedings of the 3rd Workshop on Machine Reading for Question Answering · no summary yetVidhisha Balachandran et al.2021 · 9 citations
44. A Virtual Human for Tactical Questioning ↗Borås Academic Digital Archive (University of Borås) · no summary yetBilyana Martinovski et al.2007 · 9 citations
45. Essential-Web v1.0: 24T tokens of organized web data ↗arXiv · no summary yetEssential AI et al.2025 · 3 citations
46. Studying Stand-Alone Self-Attention in Vision Models ↗no summary yetPrajit Ramachandran et al.2019 · 3 citations
47. Visualizing Music Self-Attention ↗no summary yetAnna Huang et al.2018 · 3 citations
48. A Training-Time Diagnostic for Generalization via the Log-Alignment Ratio ↗arXiv (Cornell University) · no summary yetAli Shehper, Ashish Vaswani2026
49. OTel: Open Telco AI Datasets, Benchmarks, and Models ↗arXiv (Cornell University) · no summary yetFarbod Tavakkoli et al.2026
50. Before They Can Solve: Predicting Post-Training Coding-Agent Performance from Base Models ↗arXiv (Cornell University) · no summary yetTan Yu et al.2026
51. Large Scale Multi-Domain Multi-Task Learning with MultiModel ↗no summary yetŁukasz Kaiser et al.2018
52. Smaller, faster and accurate models for statistical machine translation ↗University of Southern California Digital Library · no summary yetAshish Vaswani2014

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/ashish-vaswani/works/