Yuke Zhu — all works
- Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer VisionRanjay Krishna, Yuke Zhu, Oliver Groth, et al.2016 · 5,876 citations
- Scene Graph Generation by Iterative Message Passing ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetDanfei Xu et al.2017 · 1,290 citations
- DenseFusion: 6D Object Pose Estimation by Iterative Dense Fusion ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetChen Wang et al.2019 · 1,168 citations
- Visual7W: Grounded Question Answering in ImagesIEEE Computer Society Conference on Computer Vision and Pattern RecognitionYuke Zhu, Oliver Groth, Michael Bernstein, et al.2015 · 952 citations
- Voyager: An Open-Ended Embodied Agent with Large Language Models ↗arXiv:2305.16291 · no summary yetGuanzhi Wang et al.2023 · 639 citations
- AI2-THOR: An Interactive 3D Environment for Visual AI ↗arXiv:1712.05474 · no summary yetEric Kolve et al.2017 · 421 citations
- Reinforcement and Imitation Learning for Diverse Visuomotor Skills ↗arXiv:1802.09564 · no summary yetYuke Zhu et al.2018 · 280 citations
- LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning ↗neural information processing systems · no summary yetBo Liu et al.2023 · 235 citations
- Reasoning about Object Affordances in a Knowledge Base Representation ↗Lecture notes in computer science · no summary yetYuke Zhu, Alireza Fathi, Li Fei-Fei2014 · 219 citations
- Open X-Embodiment: Robotic Learning Datasets and RT-X Models ↗arXiv:2310.08864 · no summary yetEmbodiment Collaboration et al.2023 · 204 citations
- Multi-Stage Learning for Grasp-Constrained Object Manipulation with a Simulated Panda Robot ↗arXiv (Cornell University) · no summary yetYuke Zhu et al.2020 · 185 citations
- MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge ↗arXiv:2206.08853 · no summary yetLinxi Fan et al.2022 · 149 citations
- Visual Semantic Planning Using Deep Successor Representations ↗IEEE International Conference on Computer Vision (ICCV) · no summary yetYuke Zhu et al.2017 · 143 citations
- Eureka: Human-Level Reward Design via Coding Large Language Models ↗arXiv:2310.12931 · no summary yetYecheng Jason Ma et al.2023 · 142 citations
- Coopernaut: End-to-End Driving with Cooperative Perception for Networked Vehicles ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetJiaxun Cui et al.2022 · 138 citations
- Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations ↗arXiv:2104.01542 · no summary yetZhenyu Jiang et al.2021 · 128 citations
- Pre-Trained Language Models for Interactive Decision-Making ↗arXiv:2202.01771 · no summary yetShuang Li et al.2022 · 124 citations
- What Matters in Learning from Offline Human Demonstrations for Robot Manipulation ↗arXiv:2108.03298 · no summary yetAjay Mandlekar et al.2021 · 124 citations
- Neural Task Graphs: Generalizing to Unseen Tasks From a Single Video Demonstration ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetDe-An Huang et al.2019 · 124 citations
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots ↗arXiv:2503.14734 · no summary yetNVIDIA et al.2025 · 123 citations
- VIMA: General Robot Manipulation with Multimodal Prompts ↗arXiv:2210.03094 · no summary yetYunfan Jiang et al.2022 · 117 citations
- SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark ↗Conference on Robot Learning · no summary yetLinxi Fan et al.2018 · 117 citations
- DiscoBox: Weakly Supervised Instance Segmentation and Semantic Correspondence from Box Supervision ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetShiyi Lan et al.2021 · 112 citations
- Ditto: Building Digital Twins of Articulated Objects from Interaction ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetZhenyu Jiang, Cheng-Chun Hsu, Yuke Zhu2022 · 95 citations
- RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation ↗arXiv (Cornell University) · no summary yetAjay Mandlekar et al.2018 · 77 citations
- RubiksNet: Learnable 3D-Shift for Efficient Video Action Recognition ↗Lecture notes in computer science · no summary yetLinxi Fan et al.2020 · 69 citations
- Action Recognition by Hierarchical Mid-Level Action Elements ↗IEEE International Conference on Computer Vision (ICCV) · no summary yetTian Lan et al.2015 · 66 citations
- ASAP: Aligning Simulation and Real-World Physics for Learning Agile Humanoid Whole-Body Skills ↗arXiv:2502.01143 · no summary yetTairan He et al.2025 · 62 citations
- Situational Fusion of Visual Representation for Visual Navigation ↗IEEE/CVF International Conference on Computer Vision (ICCV) · no summary yetWilliam Shen et al.2019 · 61 citations
- LongVILA: Scaling Long-Context Visual Language Models for Long Videos ↗arXiv:2408.10188 · no summary yetYukang Chen et al.2024 · 49 citations
- Knowledge Acquisition for Visual Question Answering via Iterative Querying ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYuke Zhu, Joseph J. Lim, Li Fei-Fei2017 · 49 citations
- Building a Large-scale Multimodal Knowledge Base System for Answering Visual Queries ↗arXiv (Cornell University) · no summary yetYuke Zhu et al.2015 · 45 citations
- DrEureka: Language Model Guided Sim-To-Real Transfer ↗arXiv:2406.01967 · no summary yetYecheng Jason Ma et al.2024 · 44 citations
- Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning ↗Findings of the Association for Computational Linguistics: EMNLP 2023 · no summary yetZhuolin Yang et al.2023 · 44 citations
- MimicPlay: Long-Horizon Imitation Learning by Watching Human Play ↗arXiv (Cornell University) · no summary yetChen Wang et al.2023 · 43 citations
- MultiBench: Multiscale Benchmarks for Multimodal Representation Learning ↗PubMed · no summary yetPaul Pu Liang et al.2021 · 42 citations
- Causal Induction from Visual Observations for Goal Directed Tasks ↗arXiv (Cornell University) · no summary yetSuraj Nair et al.2019 · 42 citations
- StrokeBank: Automating Personalized Chinese Handwriting Generation ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetAlfred Zong, Yuke Zhu2014 · 42 citations
- Isaac Lab: A GPU-Accelerated Simulation Framework for Multi-Modal Robot Learning ↗arXiv:2511.04831 · no summary yetNVIDIA: Mayank Mittal et al.2025 · 40 citations
- Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning ↗arXiv (Cornell University) · no summary yetWeili Nie et al.2020 · 36 citations
- RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots ↗arXiv (Cornell University) · no summary yetSoroush Nasiriany et al.2024 · 33 citations
- Foundation Models in Robotics: Applications, Challenges, and the Future ↗arXiv (Cornell University) · no summary yetRoya Firoozi et al.2023 · 33 citations
- MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations ↗arXiv (Cornell University) · no summary yetAjay Mandlekar et al.2023 · 33 citations
- Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetHuaizu Jiang et al.2022 · 33 citations
- ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulation ↗arXiv:2203.06856 · no summary yetBokui Shen et al.2022 · 33 citations
- VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors ↗arXiv (Cornell University) · no summary yetYifeng Zhu et al.2022 · 31 citations
- Dynamics Learning with Cascaded Variational Inference for Multi-Step Manipulation ↗arXiv (Cornell University) · no summary yetKuan Fang et al.2019 · 30 citations
- Few-View Object Reconstruction with Unknown Categories and Camera Poses ↗International Conference on 3D Vision (3DV) · no summary yetHanwen Jiang et al.2022 · 27 citations
- Learning a Contact-Adaptive Controller for Robust, Efficient Legged Locomotion ↗arXiv (Cornell University) · no summary yetXingye Da et al.2020 · 27 citations
- Modelling relational statistics with Bayes Nets ↗Machine Learning · no summary yetOliver Schulte et al.2013 · 25 citations
- Human-in-the-Loop Imitation Learning using Remote Teleoperation ↗arXiv (Cornell University) · no summary yetAjay Mandlekar et al.2020 · 22 citations
- PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs ↗arXiv (Cornell University) · no summary yetSoroush Nasiriany et al.2024 · 21 citations
- Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervision ↗arXiv (Cornell University) · no summary yetKuan Fang et al.2018 · 20 citations
- INTERPRET: Interactive Predicate Learning from Language Feedback for Generalizable Task Planning ↗arXiv:2405.19758 · no summary yetMuzhi Han et al.2024 · 17 citations
- Regression Planning Networks ↗arXiv (Cornell University) · no summary yetDanfei Xu et al.2019 · 17 citations
- SECANT: Self-Expert Cloning for Zero-Shot Generalization of Visual Policies ↗arXiv (Cornell University) · no summary yetFan, Linxi et al.2021 · 16 citations
- DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos ↗arXiv (Cornell University) · no summary yetShenyuan Gao et al.2026 · 15 citations
- FLARE: Robot Learning with Implicit World Modeling ↗arXiv (Cornell University) · no summary yetRuijie Zheng et al.2025 · 15 citations
- MUTEX: Learning Unified Policies from Multimodal Task Specifications ↗arXiv (Cornell University) · no summary yetRutav Shah, Roberto Martín-Martín, Yuke Zhu2023 · 14 citations
- DreamGen: Unlocking Generalization in Robot Learning through Video World Models ↗arXiv (Cornell University) · no summary yetJoel Jang et al.2025 · 12 citations
- Learning and Retrieval from Prior Data for Skill-based Imitation Learning ↗arXiv (Cornell University) · no summary yetSoroush Nasiriany et al.2022 · 12 citations
- Coach-Player Multi-Agent Reinforcement Learning for Dynamic Team Composition ↗arXiv (Cornell University) · no summary yetBo Liu et al.2021 · 12 citations
- Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetWei Fu Dong et al.2023 · 10 citations
- DualSMC: Tunneling Differentiable Filtering and Planning under Continuous POMDPs ↗International Joint Conference on Artificial Intelligence · no summary yetYunbo Wang et al.2020 · 10 citations
- Causal Dynamics Learning for Task-Independent State Abstraction ↗arXiv (Cornell University) · no summary yetZizhao Wang et al.2022 · 9 citations
- Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids ↗arXiv (Cornell University) · no summary yetLin, Toru et al.2025 · 8 citations
- AMAGO: Scalable In-Context Reinforcement Learning for Adaptive Agents ↗arXiv (Cornell University) · no summary yetJake Grigsby, Linxi Fan, Yuke Zhu2023 · 8 citations
- CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation ↗arXiv (Cornell University) · no summary yetMax Fu et al.2026 · 7 citations
- Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulation ↗arXiv (Cornell University) · no summary yetAbhiram Maddukuri et al.2025 · 7 citations
- Interactive Robot Learning from Verbal Correction ↗arXiv (Cornell University) · no summary yetHuihan Liu et al.2023 · 7 citations
- RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning ↗CaltechAUTHORS (California Institute of Technology) · no summary yetMa, Xiaojian et al.2022 · 7 citations
- Discovering Generalizable Skills via Automated Generation of Diverse Tasks ↗arXiv:2106.13935 · no summary yetKuan Fang et al.2021 · 7 citations
- Wolf: Dense Video Captioning with a World Summarization Framework ↗arXiv (Cornell University) · no summary yetBoyi Li et al.2024 · 6 citations
- Adversarial Skill Chaining for Long-Horizon Robot Manipulation via Terminal State Regularization ↗CaltechAUTHORS (California Institute of Technology) · no summary yetYoungwoon Lee et al.2021 · 6 citations
- NitroGen: An Open Foundation Model for Generalist Gaming Agents ↗arXiv (Cornell University) · no summary yetLoïc Magne et al.2026 · 5 citations
- RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robots ↗arXiv (Cornell University) · no summary yetSoroush Nasiriany et al.2026 · 5 citations
- ENPIRE: Agentic Robot Policy Self-Improvement in the Real World ↗arXiv (Cornell University) · no summary yetWenli Xiao et al.2026 · 5 citations
- Self-Improving Vision-Language-Action Models with Data Generation via Residual RL ↗arXiv (Cornell University) · no summary yetWenli Xiao et al.2025 · 5 citations
- One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillation ↗arXiv (Cornell University) · no summary yetZhendong Wang et al.2024 · 5 citations
- Cross-Episodic Curriculum for Transformer Agents ↗neural information processing systems · no summary yetLucy Xiaoyang Shi et al.2023 · 5 citations
- Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment ↗arXiv (Cornell University) · no summary yetHuihan Liu et al.2022 · 5 citations
- Tesseract: Tensorised Actors for Multi-Agent Reinforcement Learning ↗arXiv (Cornell University) · no summary yetAnuj Mahajan et al.2021 · 5 citations
- Adaptive Procedural Task Generation for Hard-Exploration Problems ↗arXiv (Cornell University) · no summary yetKuan Fang et al.2020 · 5 citations
- EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Data ↗arXiv (Cornell University) · no summary yetRuijie Zheng et al.2026 · 4 citations
- VIRAL: Visual Sim-to-Real at Scale for Humanoid Loco-Manipulation ↗arXiv:2511.15200 · no summary yetTairan He; Zi Wang; Haoru Xue; Qingwei Ben; Zhengyi Luo; Wenli Xiao; Ye Yuan; Xingye Da; Fernando Castaneda; Shankar Sastry; Changliu Liu; Guanya Shi; Linxi Fan;, Yuke Zhu2025 · 4 citations
- Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer ↗arXiv:2512.01061 · no summary yetHaoru Xue et al.2025 · 3 citations
- OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitation ↗arXiv (Cornell University) · no summary yetJinhan Li et al.2024 · 3 citations
- Learning Generalizable Manipulation Policies with Object-Centric 3D Representations ↗arXiv (Cornell University) · no summary yetYifeng Zhu et al.2023 · 3 citations
- The PokeAgent Challenge: Competitive and Long-Context Learning at Scale ↗arXiv (Cornell University) · no summary yetSeth Karten et al.2026 · 2 citations
- Agentic Laboratories of the Future: Towards World Models for Scientific Discovery ↗Preprints.org · no summary yetFu Kelsey et al.2026 · 2 citations
- ASPIRE: Agentic /Skills Discovery for Robotics ↗arXiv (Cornell University) · no summary yetRunyu Lu et al.2026 · 2 citations
- AMAGO-2: Breaking the Multi-Task Barrier in Meta-Reinforcement Learning with Transformers ↗neural information processing systems · no summary yetJake Grigsby et al.2024 · 2 citations
- Harmon: Whole-Body Motion Generation of Humanoid Robots from Language Descriptions ↗arXiv (Cornell University) · no summary yetZhenyu Jiang et al.2024 · 2 citations
- Multi-Task Interactive Robot Fleet Learning with Visual World Models ↗arXiv (Cornell University) · no summary yetHuihan Liu et al.2024 · 2 citations
- Building Minimal and Reusable Causal State Abstractions for Reinforcement Learning ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetZizhao Wang et al.2024 · 2 citations
- OCEAN: Online Task Inference for Compositional Tasks with Context Adaptation ↗arXiv (Cornell University) · no summary yetHongyu Ren et al.2020 · 2 citations
- SURREAL-System: Fully-Integrated Stack for Distributed Deep Reinforcement Learning ↗arXiv:1909.12989 · no summary yetLinxi Fan et al.2019 · 2 citations
- GaP: A Graph-as-Policy Multi-Agent Self-Learning Harness For Variational Automation Tasks ↗arXiv (Cornell University) · no summary yetKaiyuan Chen et al.2026 · 1 citation
- RoboTTT: Context Scaling for Robot Policies ↗arXiv (Cornell University) · no summary yetYunfan Jiang et al.2026 · 1 citation
- Scaling Short-Term Memory of Visuomotor Policies for Long-Horizon Tasks ↗arXiv (Cornell University) · no summary yetRutav Shah et al.2026 · 1 citation
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yuke-zhu/works/