🧑‍🔬 Chunyuan Li — all works

43 works · ← Chunyuan Li

1. Visual Instruction TuningarXiv:2304.08485Haotian Liu, Chunyuan Li, Qingyang Wu, et al.2023 · 2,617 citations
2. Improved Baselines with Visual Instruction TuningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionHaotian Liu, Chunyuan Li, Yuheng Li, et al.2023 · 2,614 citations
3. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
4. Grounded Language-Image Pre-training ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetLiunian Harold Li et al.2022 · 1,207 citations
5. A whole-slide foundation model for digital pathology from real-world data ↗Nature · no summary yetHanwen Xu et al.2024 · 904 citations
6. LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One DayConference on Neural Information Processing Systems (NeurIPS)Chunyuan Li, Cliff Wong, Sheng Zhang, et al.2023 · 692 citations
7. Instruction Tuning with GPT-4arXiv:2304.03277Baolin Peng, Chunyuan Li, Pengcheng He, et al.2023 · 662 citations
8. RegionCLIP: Region-based Language-Image Pretraining ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYiwu Zhong et al.2022 · 639 citations
9. GLIGEN: Open-Set Grounded Text-to-Image Generation ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYuheng Li et al.2023 · 615 citations
10. LLaVA-OneVision: Easy Visual Task TransferarXiv:2408.03326Bo Li, Yuanhan Zhang, Dong Guo, et al.2024 · 477 citations
11. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object DetectionarXiv:2303.05499Shilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.2023 · 472 citations
12. MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsarXiv:2310.02255Pan Lu, Hritik Bansal, Tony Xia, et al.2023 · 468 citations
13. Joint Embedding of Words and Labels for Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Guoyin Wang, Chunyuan Li, Wenlin Wang, et al.2018 · 465 citations
14. Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling MechanismsAnnual Meeting of the Association for Computational Linguistics (ACL)Dinghan Shen, Guoyin Wang, Wenlin Wang, et al.2018 · 386 citations
15. OCRBench: On the Hidden Mystery of OCR in Large Multimodal ModelsScience China Information SciencesYuliang Liu, Zhang Li, Mingxin Huang, et al.2023 · 306 citations
16. Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing ↗Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · no summary yetHao Fu et al.2019 · 280 citations
17. Few-shot Natural Language Generation for Task-Oriented DialogFindings of the Association for Computational LinguisticsBaolin Peng, Chenguang Zhu, Chunyuan Li, et al.2020 · 256 citations
18. Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetChunyuan Li et al.2016 · 237 citations
19. Generalized Decoding for Pixel, Image, and Language ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetXueyan Zou et al.2023 · 219 citations
20. Unified Contrastive Learning in Image-Text-Label Space ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetJianwei Yang et al.2022 · 219 citations
21. Towards Language-Free Training for Text-to-Image Generation ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYufan Zhou et al.2022 · 216 citations
22. Optimus: Organizing Sentences via Pre-trained Modeling of a Latent SpaceConference on Empirical Methods in Natural Language Processing (EMNLP)Chunyuan Li, Xiang Gao, Yuan Li, et al.2020 · 208 citations
23. Aligning Large Multimodal Models with Factually Augmented RLHFarXiv:2309.14525Zhiqing Sun, Sheng Shen, Shengcao Cao, et al.2023 · 176 citations
24. Measuring the Intrinsic Dimension of Objective Landscapes ↗arXiv:1804.08838 · no summary yetChunyuan Li et al.2018 · 143 citations
25. Few-Shot Named Entity Recognition: An Empirical Baseline Study ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetJiaxin Huang et al.2021 · 140 citations
26. Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V ↗arXiv:2310.11441 · no summary yetJianwei Yang et al.2023 · 137 citations
27. Aligning Large Multimodal Models with Factually Augmented RLHF ↗Findings of the Association for Computational Linguistics: ACL 2024 · no summary yetZhiqing Sun et al.2024 · 136 citations
28. Towards Building The Federatedgpt: Federated Instruction Tuning ↗IEEE International Conference on Acoustics Speech and Signal Processing · no summary yetJianyi Zhang et al.2024 · 129 citations
29. LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models ↗arXiv:2407.07895 · no summary yetFeng Li et al.2024 · 127 citations
30. Learning Generic Sentence Representations Using Convolutional Neural Networks ↗Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · no summary yetZhe Gan et al.2017 · 118 citations
31. POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetYizhe Zhang et al.2020 · 116 citations
32. Robust Navigation with Language Pretraining and Stochastic Sampling ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetXiujun Li et al.2019 · 116 citations
33. LMMs-Eval: Reality Check on the Evaluation of Large Multimodal ModelsFindings of the Association for Computational LinguisticsKaichen Zhang, Bo Li, Peiyuan Zhang, et al.2025 · 115 citations
34. Focal Attention for Long-Range Interactions in Vision Transformers ↗neural information processing systems · no summary yetJianwei Yang et al.2021 · 85 citations
35. Long Context Transfer from Language to Vision ↗arXiv:2406.16852 · no summary yetPeiyuan Zhang et al.2024 · 73 citations
36. Scaling Vision-Language Models with Sparse Mixture of Experts ↗Findings of the Association for Computational Linguistics: EMNLP 2023 · no summary yetSheng Shen et al.2023 · 70 citations
37. MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding ↗arXiv (Cornell University) · no summary yetFei Wang et al.2024 · 48 citations
38. Learning Customized Visual Models with Retrieval-Augmented Knowledge ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetHaotian Liu et al.2023 · 45 citations
39. Direct Preference Optimization of Video Large Multimodal Models from Language Model RewardConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Ruohong Zhang, Liangke Gui, Zhiqing Sun, et al.2025 · 32 citations
40. DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain ↗Proceedings of the 18th BioNLP Workshop and Shared Task · no summary yetYichong Xu et al.2019 · 22 citations
41. An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models ↗arXiv (Cornell University) · no summary yetYadong Lu et al.2023 · 18 citations
42. BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys ↗arXiv (Cornell University) · no summary yetYu Gu et al.2023 · 16 citations
43. Rethinking Sentiment Style Transfer ↗Findings of the Association for Computational Linguistics: EMNLP 2021 · no summary yetPing Yu et al.2021 · 8 citations

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/chunyuan-li/works/