Afroz Mohiuddin
Afroz Mohiuddin has 2 papers in our library, in 2020–2022; often with Adam Roberts, Aitor Lewkowycz, Andreea Gane.
OpenAlex · ORCID · h-index 6 · 11 works · 1,453 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 2,775 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #3740
Affiliations
🏢GoogleMountain View ·
United States2020–2022 · 7 papers🎓Indian Institute of Technology KanpurKanpur ·
India2005–2010Education 2005–2010 · Masters & Bachelor of Technology, Computer Science
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
Works by year
2020s
Papers
- Rethinking Attention with Performers (2020 · 491 citations)
The standard Transformer scales poorly to long sequences: the attention mechanism requires time and memory that grow quadratically with the number of tokens L. - Scaling Up Models and Data with t5x and seqio (2022 · 130 citations)
Training language models with hundreds of billions of parameters usually requires custom, hand-tuned infrastructure. That slows down experimentation and makes fair comparisons between models difficult. This paper presents two open-source Google libraries meant to lower that barrier.
All works
- Rethinking Attention with PerformersarXiv:2009.14794Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, et al.2020 · 491 citations
- Model-Based Reinforcement Learning for Atari ↗arXiv (Cornell University) · no summary yetŁukasz Kaiser et al.2019 · 429 citations
- Scaling Up Models and Data with t5x and seqioarXiv:2203.17189Adam Roberts, Hyung Won Chung, Anselm Levskaya, et al.2022 · 130 citations
- Sparse is Enough in Scaling Transformers ↗arXiv (Cornell University) · no summary yetSebastian Jaszczur et al.2021 · 30 citations
- Q-Value Weighted Regression: Reinforcement Learning with Limited Data ↗2022 International Joint Conference on Neural Networks (IJCNN) · no summary yetPiotr Kozakowski et al.2022 · 3 citations
- Forecasting Deep Learning Dynamics with Applications to Hyperparameter Tuning ↗no summary yetPiotr Kozakowski, Łukasz Kaiser, Afroz Mohiuddin2019 · 2 citations
Co-authors here
- Adam Roberts
- Aitor Lewkowycz
- Andreea Gane
- Anselm Levskaya
- Brian Lester
- Daniel Andor
- David Belanger
- David Dohan
- Gaurav Mishra
- Hyung Won Chung
- James Bradbury
- Krzysztof Choromanski
Venues
- 2022 International Joint Conference on Neural Networks (IJCNN)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/afroz-mohiuddin/