🧑‍🔬 Sanjiv Kumar

🏛️ Affiliations

🎓K.L.E. Academy of Higher Education and Research Institute of Physiotherapy, BelagaviBelagavi · India2012–2026 · 39 paperscurrent🎓KLE Academy of Higher Education and ResearchBelagavi · India2012–2026 · 32 paperscurrent🏢GoogleMountain View · United States2007–2025 · 105 papers🎓Carnegie Mellon UniversityPittsburgh · United States1999–2006 · 13 papers🎓King George's Medical UniversityLucknow · India2023 · 3 papers🏢Google DeepMindLondon · United Kingdom2025 · 2 papers🏢Abu Dhabi National OilAbu Dhabi · United Arab Emirates2022–2024 · 2 papers🎓Princeton UniversityPrinceton · United States2023–2024 · 2 papers🏢Saudi AramcoDhahran · Saudi Arabia2014–2022 · 2 papers🏢Saudi AramcoHouston · United States2014–2022 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 15 more institutions on single bylines are not listed.

🧭 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📅 Works by year

2020s

2010s

📄 Papers

The most cited first (OpenAlex and our library).

1. On the Convergence of Adam and Beyond (2019 · 1,598 citations)
   Adaptive optimizers such as RMSProp, Adam, AdaDelta and NAdam scale each gradient coordinate by the root of an exponential moving average of past squared gradients.
2. Large Language Models with Controllable Working Memory (2023 · 158 citations)
   LLMs often receive a supporting context in the prompt, but it is unclear how that text interacts with facts stored in their weights.
3. Are Transformers universal approximators of sequence-to-sequence functions? (2019 · 97 citations)
   Transformers are widely used for NLP, but it has been unclear which sequence-to-sequence mappings they can actually represent.

All works

6 works of theirs in our library, the most cited first; 3 with a page here, the others link their original until we summarise them.

1. On the Convergence of Adam and BeyondarXiv:1904.09237Sashank J. Reddi, Satyen Kale, Sanjiv Kumar2019 · 1,598 citations
2. Learning Binary Codes for High-Dimensional Data Using Bilinear Projections ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYunchao Gong et al.2013 · 168 citations
3. Large Language Models with Controllable Working MemoryFindings of the Association for Computational LinguisticsDaliang Li, Ankit Singh Rawat, Manzil Zaheer, et al.2023 · 158 citations
4. Are Transformers universal approximators of sequence-to-sequence functions?arXiv:1912.10077Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, et al.2019 · 97 citations
5. On sampling-based approximate spectral decomposition ↗International Conference on Machine Learning · no summary yetSanjiv Kumar, Mehryar Mohri, Ameet Talwalkar2009 · 88 citations
6. Reasoning with Latent Thoughts: On the Power of Looped Transformers ↗arXiv:2502.17416 · no summary yetNikunj Saunshi et al.2025 · 44 citations

🤝 Co-authors here

5 co-authors with a page, the most papers together first.

• Ankit Singh Rawat ×2
• Sashank Jakkam Reddi ×2
• Manzil Zaheer
• Satyen Kale
• Xin Wang

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

• Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2023
• IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
• International Conference on Machine Learning

🔗 Cited by

Papers of our library cite their works 332 times (of the 149,439 papers whose bibliographies we read); 64 citing papers with a page here →.

Updated 2 November 2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/sanjiv-kumar/