Who cites Nan Ding
- Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- UNITER: UNiversal Image-TExt Representation LearningLecture notes in computer scienceYen-Chun Chen, Linjie Li, Licheng Yu, et al.2019 · 2,418 citations
- ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language TasksarXiv:1908.02265Jiasen Lu, Dhruv Batra, Devi Parikh, et al.2019 · 2,302 citations
- Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,246 citations
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsarXiv:2301.12597Junnan Li, Dongxu Li, Silvio Savarese, et al.2023 · 2,219 citations
- Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
- Scaling Up Visual and Vision-Language Representation Learning With Noisy Text SupervisionInternational Conference on Machine Learning (ICML)Chao Jia, Yinfei Yang, Ye Xia, et al.2021 · 1,615 citations
- VisualBERT: A Simple and Performant Baseline for Vision and LanguagearXiv:1908.03557Liunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,568 citations
- Zero-Shot Text-to-Image GenerationarXiv:2102.12092Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.2021 · 1,528 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationarXiv:2201.12086Junnan Li, Dongxu Li, Caiming Xiong, et al.2022 · 1,523 citations
- LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,485 citations
- MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsarXiv:2304.10592Deyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,141 citations
- VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsarXiv:1908.08530Weijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,066 citations
- Vision-Language Models for Vision Tasks: A SurveyIEEE Transactions on Pattern Analysis and Machine IntelligenceJingyi Zhang, Jiaxing Huang, Sheng Jin, et al.2023 · 1,047 citations
- Evaluating Object Hallucination in Large Vision-Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Yifan Li, Yifan Du, Kun Zhou, et al.2023 · 1,004 citations
- Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and BeyondarXiv:2308.12966Jinze Bai, Shuai Bai, Shusheng Yang, et al.2023 · 970 citations
- ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionarXiv:2102.03334Wonjae Kim, Bokyung Son, Ildoo Kim2021 · 804 citations
- Reproducible scaling laws for contrastive language-image learningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 769 citations
- Video-LLaVA: Learning United Visual Representation by Alignment Before ProjectionConference on Empirical Methods in Natural Language Processing (EMNLP)Bin Lin, Yang Ye, Bin Zhu, et al.2023 · 628 citations
- FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
- A-OKVQA: A Benchmark for Visual Question Answering using World KnowledgeLecture notes in computer scienceDustin Schwenk, Apoorv Khandelwal, Christopher Clark, et al.2022 · 509 citations
- SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionarXiv:2108.10904Zirui Wang, Jiahui Yu, Adams Wei Yu, et al.2021 · 481 citations
- Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object DetectionarXiv:2303.05499Shilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.2023 · 472 citations
- CogView: Mastering Text-to-Image Generation via TransformersarXiv:2105.13290Ming Ding, Zhuoyi Yang, Wenyi Hong, et al.2021 · 469 citations
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsarXiv:2310.02255Pan Lu, Hritik Bansal, Tony Xia, et al.2023 · 468 citations
- OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkarXiv:2202.03052Peng Wang, An Yang, Rui Men, et al.2022 · 467 citations
- MVBench: A Comprehensive Multi-modal Video Understanding BenchmarkIEEE Computer Society Conference on Computer Vision and Pattern RecognitionKunchang Li, Yali Wang, Yinan He, et al.2023 · 463 citations
- ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLecture notes in computer scienceLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 454 citations
- Experience Grounds LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Yonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 439 citations
- InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksarXiv:2312.14238Zhe Chen, Jiannan Wu, Wenhai Wang, et al.2023 · 435 citations
- mPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityarXiv:2304.14178Qinghao Ye, Haiyang Xu, Guohai Xu, et al.2023 · 427 citations
- The Hateful Memes Challenge: Detecting Hate Speech in Multimodal MemesarXiv:2005.04790Douwe Kiela, Hamed Firooz, Aravind Mohan, et al.2020 · 420 citations
- PaLI: A Jointly-Scaled Multilingual Language-Image ModelarXiv:2209.06794Xi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 371 citations
- VideoChat: Chat-Centric Video UnderstandingScience China Information SciencesKunChang Li, Yinan He, Yi Wang, et al.2023 · 365 citations
- UL2: Unifying Language Learning ParadigmsarXiv:2205.05131Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 347 citations
- MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesarXiv:2308.02490Weihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 344 citations
- TextCaps: a Dataset for Image Captioning with Reading ComprehensionLecture notes in computer scienceOleksii Sidorov, Ronghang Hu, Marcus Rohrbach, et al.2020 · 331 citations
- Language Is Not All You Need: Aligning Perception with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shaohan Huang, Li Dong, Wenhui Wang, et al.2023 · 330 citations
- MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
- WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine LearningInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Krishna Srinivasan, Karthik Raman, Jiecao Chen, et al.2021 · 315 citations
- UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Wei Li, Can Gao, Guocheng Niu, et al.2021 · 308 citations
- Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
- Are We on the Right Way for Evaluating Large Vision-Language Models?Conference on Neural Information Processing Systems (NeurIPS)Lin Chen, Jinsong Li, Xiaoyi Dong, et al.2024 · 277 citations
- MiniCPM-V: A GPT-4V Level MLLM on Your PhonearXiv:2408.01800Yuan Yao, Tianyu Yu, Ao Zhang, et al.2024 · 269 citations
- SEED-Bench: Benchmarking Multimodal LLMs with Generative ComprehensionarXiv:2307.16125Bohao Li, Rui Wang, Guangzhi Wang, et al.2023 · 265 citations
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language ModelsLecture notes in computer scienceYanwei Li, Chengyao Wang, Jiaya Jia2023 · 262 citations
- Multimodal Few-Shot Learning with Frozen Language ModelsarXiv:2106.13884Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.2021 · 258 citations
- Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingarXiv:2306.02858Hang Zhang, Xin Li, Lidong Bing2023 · 238 citations
- LLaMA-Adapter V2: Parameter-Efficient Visual Instruction ModelarXiv:2304.15010Peng Gao, Jiaming Han, Renrui Zhang, et al.2023 · 229 citations
- DataComp: In search of the next generation of multimodal datasetsConference on Neural Information Processing Systems (NeurIPS)Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, et al.2023 · 224 citations
- Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionZhang Li, Biao Yang, Qiang Liu, et al.2023 · 222 citations
- What matters when building vision-language models?Conference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 212 citations
- Ring Attention with Blockwise Transformers for Near-Infinite ContextarXiv:2310.01889Hao Liu, Matei Zaharia, Pieter Abbeel2023 · 212 citations
- NExT-GPT: Any-to-Any Multimodal LLMarXiv:2309.05519Shengqiong Wu, Hao Fei, Leigang Qu, et al.2023 · 207 citations
- MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningarXiv:2310.09478Jun Chen, Deyao Zhu, Xiaoqian Shen, et al.2023 · 199 citations
- MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and TextConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Hexiang Hu, Xi Chen, et al.2022 · 199 citations
- OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
- Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction TuningarXiv:2306.14565Fuxiao Liu, Kevin Lin, Linjie Li, et al.2023 · 189 citations
- AudioCaps: Generating Captions for Audios in The WildConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chris Dongjoo Kim, Byeongchang Kim, Hyunmin Lee, et al.2019 · 187 citations
- Detecting Harmful Memes and Their TargetsFindings of the Association for Computational LinguisticsShraman Pramanick, Dimitar Dimitrov, Rituparna Mukherjee, et al.2021 · 171 citations
- Pix2Struct: Screenshot Parsing as Pretraining for Visual Language UnderstandingarXiv:2210.03347Kenton Lee, Mandar Joshi, Iulia Turc, et al.2022 · 158 citations
- Are aligned neural networks adversarially aligned?Conference on Neural Information Processing Systems (NeurIPS)Nicholas Carlini, Milad Nasr, Christopher A. Choquette-Choo, et al.2023 · 157 citations
- ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene GrapharXiv:2006.16934Fei Yu, Jiji Tang, Weichong Yin, et al.2020 · 152 citations
- Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTsTransactions of the Association for Computational Linguistics (TACL)Emanuele Bugliarello, Ryan Cotterell, Naoaki Okazaki, et al.2021 · 141 citations
- Decontextualization: Making Sentences Stand-AloneTransactions of the Association for Computational Linguistics (TACL)Eunsol Choi, Jennimaria Palomaki, Matthew Lamm, et al.2021 · 137 citations
- Analyzing and Mitigating Object Hallucination in Large Vision-Language ModelsarXiv:2310.00754Yiyang Zhou, Chenhang Cui, Jaehong Yoon, et al.2023 · 134 citations
- Generalization in NLI: Ways (Not) To Go Beyond Simple HeuristicsWorkshop on Insights from Negative Results in NLPPrajjwal Bhargava, Aleksandr Drozd, Anna Rogers2021 · 131 citations
- LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal ModelsarXiv:2407.07895Feng Li, Renrui Zhang, Hao Zhang, et al.2024 · 127 citations
- Mini-Gemini: Mining the Potential of Multi-modality Vision Language ModelsIEEE Transactions on Pattern Analysis and Machine IntelligenceYanwei Li, Yuechen Zhang, Chengyao Wang, et al.2024 · 123 citations
- mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document UnderstandingFindings of the Association for Computational LinguisticsAnwen Hu, Haiyang Xu, Jiabo Ye, et al.2024 · 111 citations
- Transformer Quality in Linear TimearXiv:2202.10447Weizhe Hua, Zihang Dai, Hanxiao Liu, et al.2022 · 99 citations
- Sparse Upcycling: Training Mixture-of-Experts from Dense CheckpointsarXiv:2212.05055Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, et al.2022 · 98 citations
- Crossmodal-3600: A Massively Multilingual Multimodal Evaluation DatasetConference on Empirical Methods in Natural Language Processing (EMNLP)Ashish V. Thapliyal, Jordi Pont Tuset, Xi Chen, et al.2022 · 95 citations
- InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large ModelarXiv:2401.16420Xiaoyi Dong, Pan Zhang, Yuhang Zang, et al.2024 · 94 citations
- InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and CompositionarXiv:2309.15112Pan Zhang, Xiaoyi Dong, Bin Wang, et al.2023 · 87 citations
- Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?Findings of the Association for Computational LinguisticsYi Tay, Mostafa Dehghani, Samira Abnar, et al.2023 · 86 citations
- ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language ModelsarXiv:2402.11684Guiming Hardy Chen, Shunian Chen, Ruifei Zhang, et al.2024 · 62 citations
- MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language BenchmarkarXiv:2402.04788Dongping Chen, Ruoxi Chen, Shilin Zhang, et al.2024 · 60 citations
- Investigating the Catastrophic Forgetting in Multimodal Large Language ModelsarXiv:2309.10313Yuexiang Zhai, Shengbang Tong, Xiao Li, et al.2023 · 59 citations
- MMICL: Empowering Vision-language Model with Multi-Modal In-Context LearningarXiv:2309.07915Haozhe Zhao, Zefan Cai, Shuzheng Si, et al.2023 · 58 citations
- InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDConference on Neural Information Processing Systems (NeurIPS)Xiaoyi Dong, Pan Zhang, Yuhang Zang, et al.2024 · 54 citations
- SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific GraphsarXiv:2308.03349Shengzhi Li, Nima Tajbakhsh2023 · 50 citations
- NVLM: Open Frontier-Class Multimodal LLMsarXiv:2409.11402Wenliang Dai, Nayeon Lee, Boxin Wang, et al.2024 · 44 citations
- Large Multilingual Models Pivot Zero-Shot Multimodal Learning across LanguagesarXiv:2308.12038Jinyi Hu, Yuan Yao, Chongyi Wang, et al.2023 · 43 citations
- InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and OutputarXiv:2407.03320Pan Zhang, Xiaoyi Dong, Yuhang Zang, et al.2024 · 39 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling ApproachesFindings of the Association for Computational LinguisticsDaniel Fried, Nicholas Tomlin, Jennifer Hu, et al.2023 · 38 citations
- ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language GenerationarXiv:2112.15283Han Zhang, Weichong Yin, Yewei Fang, et al.2021 · 33 citations
- Peacock: A Family of Arabic Multimodal Large Language Models and BenchmarksAnnual Meeting of the Association for Computational Linguistics (ACL)Fakhraddin Alwajih, El Moatez Billah Nagoudi, Gagan Bhatia, et al.2024 · 28 citations
- Word Representation Learning in Multimodal Pre-Trained Transformers: An Intrinsic EvaluationTransactions of the Association for Computational Linguistics (TACL)Sandro Pezzelle, Ece Takmaz, Raquel Fernández2021 · 25 citations
- Maintaining Common Ground in Dynamic EnvironmentsTransactions of the Association for Computational Linguistics (TACL)Takuma Udagawa, Akiko Aizawa2021 · 13 citations
- Why do LLaVA Vision-Language Models Reply to Images in English?Findings of the Association for Computational LinguisticsMusashi Hinck, Carolin Holtermann, Matthew Lyle Olson, et al.2024 · 12 citations
- Acquired TASTE: Multimodal Stance Detection with Textual and Structural EmbeddingsInternational Conference on Computational Linguistics (COLING)Guy Barel, Oren Tsur, Dan Vilenchik2025 · 8 citations
- TrimTokenator: Towards Adaptive Visual Token Pruning for Large Multimodal ModelsFindings of the Association for Computational LinguisticsHao Zhang, Lyu Mengsi, Chenrui He, et al.2026 · 6 citations
- GRAVL-BERT: Graphical Visual-Linguistic Representations for Multimodal Coreference ResolutionInternational Conference on Computational Linguistics (COLING)Danfeng Guo, Arpit Gupta, Sanchit Agarwal, et al.2022 · 6 citations
- RRHF-V: Ranking Responses to Mitigate Hallucinations in Multimodal Large Language Models with Human FeedbackInternational Conference on Computational Linguistics (COLING)Guoqing Chen, Fu Zhang, Jinghao Lin, et al.2025 · 5 citations
- Through the Magnifying Glass: Adaptive Perception Magnification for Hallucination-Free VLM DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Shunqi Mao, Chaoyi Zhang, Weidong Cai2026 · 4 citations
- Gained in Translation: Privileged Pairwise Judges Enhance Multilingual ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Lintang Sutawika, Gokul Swamy, Steven Wu, et al.2026 · 2 citations
- When Vision-Language Models Judge Without Seeing: Exposing Informativeness BiasAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaohan Zou, Roshan Sridhar, Mohammadtaher Safarzadeh, et al.2026 · 1 citation
This page in Markdown → https://md.research.elamur.ai/free/en/authors/nan-ding/cited-by/