David Uthus
David Uthus has 2 papers in our library, in 2022–2023; often with Joshua Ainslie, Mandy Guo, Santiago Ontañón.
OpenAlex · h-index 9 · 33 works · 527 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 225 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #3432
Affiliations
🏢GoogleMountain View ·
United States2013–2023 · 12 papers🔬United States Naval Research LaboratoryWashington ·
United States2011–2013 · 4 papers🎓University of AucklandAuckland ·
New Zealand2008–2009 · 3 papers
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
Works by year
2020s
20231 paperCoLT5: Faster Long-Range Transformers with Conditional Computation20221 paperLongT5: Efficient Text-To-Text Transformer for Long Sequences
Papers
- LongT5: Efficient Text-To-Text Transformer for Long Sequences (2022 · 398 citations)
Standard Transformers such as T5 scale poorly to long documents because full self-attention grows quadratically with input length. - CoLT5: Faster Long-Range Transformers with Conditional Computation (2023 · 83 citations)
Encoding long documents with Transformers is costly. Sparse attention reduces the quadratic attention cost, but the feedforward and projection layers still run on every token and dominate compute in larger models. CoLT5 (Conditional LongT5), from Google Research, extends LongT5 with conditional computation. Each…
All works
- LongT5: Efficient Text-To-Text Transformer for Long SequencesMandy Guo, Joshua Ainslie, David Uthus, et al.Findings of the Association for Computational Linguistics · 398 citations
- CoLT5: Faster Long-Range Transformers with Conditional ComputationJoshua Ainslie, Tao Lei, Michiel de Jong, et al.Conference on Empirical Methods in Natural Language Processing (EMNLP) · 83 citations
- Dr Genre: Reinforcement Learning from Decoupled LLM Feedback for Generic Text Rewriting · original ↗ · no summary yet · arXiv:2503.06781Yufei Li et al.2025 · 3 citations
Co-authors here
- Joshua Ainslie ×2
- Mandy Guo ×2
- Santiago Ontañón ×2
- Yun-Hsuan Sung ×2
- James Lee-Thorp
- Jianmo Ni
- Michiel de Jong
- Siddhartha Brahma
- Sumit Sanghai
- Tao Lei
- Yi Tay
- Yinfei Yang
Venues
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2023
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2022
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/david-uthus/