Andrew Tao
Andrew Tao has 2 papers in our library, in 2023–2025, most of them on Language models & pretraining, Vision & language; often with Aarti Basant, Abhinav Khattar, Adithya Renduchintala.
OpenAlex · h-index 20 · 62 works · 8,558 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 265 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #4241
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workVision & language · 1 work
Works by year
2020s
Papers
- VILA: On Pre-training for Visual Language Models (2023 · 381 citations)
Most work on visual language models (VLMs) has focused on instruction tuning. The pre-training stage, where an LLM first learns to handle images and text together, has received far less systematic study. This paper addresses that gap. Starting from Llama-2, the authors build auto-regressive VLMs, in which image… - Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models (2025 · 38 citations)
Self-attention costs grow with sequence length, both in compute per generated token and in KV-cache memory.
All works
- Improving Semantic Segmentation via Video Propagation and Label Relaxation ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYi Zhu et al.2019 · 420 citations
- VILA: On Pre-training for Visual Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJi Lin, Hongxu Yin, Wei Ping, et al.2023 · 381 citations
- Graphical Contrastive Losses for Scene Graph Parsing ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetJi Zhang et al.2019 · 261 citations
- Dual Contrastive Loss and Attention for GANs ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetNing Yu et al.2021 · 53 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- Wolf: Dense Video Captioning with a World Summarization Framework ↗arXiv (Cornell University) · no summary yetBoyi Li et al.2024 · 6 citations
Co-authors here
- Aarti Basant
- Abhinav Khattar
- Adithya Renduchintala
- Akhiad Bercovich
- Aleksander Ficek
- Ameya Sunil Mahabaleshwarkar
- Jan Kautz
- Mohammad Shoeybi
- NVIDIA: Aaron Blakeman
- Song Han
- Wei Ping
- Yao Lu
Venues
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings ×2
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition: IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2023
- IEEE/CVF International Conference on Computer Vision (ICCV)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/andrew-tao/