🧑‍🔬 Jan Kautz

🏛️ Affiliations

🏢NvidiaSanta Clara · United States2013–2026 · 199 papersEmployment since 2013current🏢NvidiaReading · United Kingdom2014–2026 · 149 paperscurrent🎓University College LondonLondon · United Kingdom2006–2015 · 91 papersEmployment🔬Max Planck Institute for InformaticsSaarbrücken · Germany2000–2023 · 44 papersEducation🔬Max Planck SocietyMunich · Germany2000–2011 · 22 papers🎓Massachusetts Institute of TechnologyCambridge · United States2003–2024 · 14 papers🎓Georgia Institute of TechnologyAtlanta · United States2017–2025 · 4 papers🔬MIT Computer Science and Artificial Intelligence LaboratoryCambridge · United States2003–2024 · 4 papers🎓Carnegie Mellon UniversityPittsburgh · United States2016–2025 · 3 papers🎓University of Maryland, College ParkCollege Park · United States2024–2026 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 14 more institutions on single bylines are not listed.

🧭 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📅 Works by year

2020s

📄 Papers

The most cited first (OpenAlex and our library).

1. VILA: On Pre-training for Visual Language Models (2023 · 381 citations)
   Most work on visual language models (VLMs) has focused on instruction tuning. The pre-training stage, where an LLM first learns to handle images and text together, has received far less systematic study. This paper addresses that gap. Starting from Llama-2, the authors build auto-regressive VLMs, in which image…
2. Hymba: A Hybrid-head Architecture for Small Language Models (2024 · 50 citations)
   Small language models must balance accuracy against memory and speed. Transformers recall context well, but their compute cost and KV cache grow quickly with sequence length. State space models such as Mamba run cheaply but recall poorly. Earlier hybrids stacked the two layer types one after another, so a weak layer…

All works

36 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

1. Importance Estimation for Neural Network Pruning ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetPavlo A. Molchanov et al.2019 · 1,023 citations
2. Joint Discriminative and Generative Learning for Person Re-Identification ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetZhedong Zheng et al.2019 · 864 citations
3. Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetPavlo A. Molchanov et al.2016 · 697 citations
4. Few-Shot Unsupervised Image-to-Image Translation ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetMing-Yu Liu et al.2019 · 653 citations
5. GroupViT: Semantic Segmentation Emerges from Text Supervision ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetJiarui Xu et al.2022 · 483 citations
6. NVAE: A Deep Hierarchical Variational Autoencoder ↗neural information processing systems · no summary yetArash Vahdat, Jan Kautz2020 · 388 citations
7. VILA: On Pre-training for Visual Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJi Lin, Hongxu Yin, Wei Ping, et al.2023 · 381 citations
8. A-ViT: Adaptive Tokens for Efficient Vision Transformer ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetHongxu Yin et al.2022 · 361 citations
9. FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objects ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetBowen Wen et al.2024 · 357 citations
10. Pixel-Adaptive Convolutional Neural Networks ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetHang Su et al.2019 · 331 citations
11. Learning Linear Transformations for Fast Image and Video Style Transfer ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetXueting Li et al.2019 · 303 citations
12. PlaneRCNN: 3D Plane Detection and Reconstruction From a Single Image ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetChen Liu et al.2019 · 245 citations
13. PhysDiff: Physics-Guided Human Motion Diffusion Model ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetYe Yuan et al.2023 · 243 citations
14. Few-Shot Adaptive Gaze Estimation ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetSeonwook Park et al.2019 · 218 citations
15. Extreme View Synthesis ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetInchang Choi et al.2019 · 188 citations
16. Polarimetric Multi-view Stereo ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetZhaopeng Cui et al.2017 · 138 citations
17. Dynamic Facial Analysis: From Bayesian Filtering to Recurrent Neural Network ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetJinwei Gu et al.2017 · 126 citations
18. GR00T N1: An Open Foundation Model for Generalist Humanoid Robots ↗arXiv:2503.14734 · no summary yetNVIDIA et al.2025 · 123 citations
19. Multilayer and Multimodal Fusion of Deep Neural Networks for Video Classification ↗ACM International Conference on Multimedia (ACM MM) · no summary yetXiaodong Yang, Pavlo A. Molchanov, Jan Kautz2016 · 116 citations
20. NVILA: Efficient Frontier Visual Language Models ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetZhijian Liu et al.2025 · 73 citations
21. Accelerated Generative Models for 3D Point Cloud Data ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetBen Eckart et al.2016 · 72 citations
22. An Empirical Study of Mamba-based Language Models ↗arXiv:2406.07887 · no summary yetRoger Waleffe et al.2024 · 67 citations
23. ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models ↗arXiv:2505.24864 · no summary yetMingjie Liu et al.2025 · 58 citations
24. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
25. LongVILA: Scaling Long-Context Visual Language Models for Long Videos ↗arXiv:2408.10188 · no summary yetYukang Chen et al.2024 · 49 citations

See all 36 works by Jan Kautz →

🤝 Co-authors here

12 co-authors with a page, the most papers together first.

• Ameya Sunil Mahabaleshwarkar
• Andrew Tao
• Mohammad Shoeybi
• Shizhe Diao
• Song Han
• Wei Ping
• Xin Dong
• Yao Lu
• Yingyan Celine Lin
• Yonggan Fu
• Yoshi Suhara
• Zijia Chen

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

• IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings ×14
• IEEE/CVF International Conference on Computer Vision (ICCV) ×4
• IEEE Computer Society Conference on Computer Vision and Pattern Recognition: IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2023
• ACM International Conference on Multimedia (ACM MM)
• Proceedings of the Fourth Workshop on Neural Generation and Translation
• neural information processing systems

🔗 Cited by

Papers of our library cite their works 934 times (of the 149,439 papers whose bibliographies we read); 102 citing papers with a page here →.

Updated 1 November 2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/jan-kautz/