Elamur Research⌕
☰
home / authors / Serge Belongie / cited by / page 2

Who cites Serge Belongie

3,318 citations of their works from 3,083 papers of our library (of the 149,439 whose bibliographies we read) · 322 with a page here, the most cited first · page 2 of 4 · 101–200 · ← Serge Belongie

1 2 3 4

  1. Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation ModelsarXiv:2303.04671Chenfei Wu, Shengming Yin, Weizhen Qi, et al.2023 · 328 citations
  2. ALFWorld: Aligning Text and Embodied Environments for Interactive LearningarXiv:2010.03768Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, et al.2020 · 322 citations
  3. MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
  4. WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine LearningInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Krishna Srinivasan, Karthik Raman, Jiecao Chen, et al.2021 · 315 citations
  5. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)arXiv:2309.17421Zhengyuan Yang, Linjie Li, Kevin Lin, et al.2023 · 311 citations
  6. UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Wei Li, Can Gao, Guocheng Niu, et al.2021 · 308 citations
  7. Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
  8. SPICE: Semantic Propositional Image Caption EvaluationarXiv:1607.08822Peter Anderson, Basura Fernando, Mark Johnson, et al.2016 · 289 citations
  9. Guided Open Vocabulary Image Captioning with Constrained Beam SearchConference on Empirical Methods in Natural Language Processing (EMNLP)Peter Anderson, Basura Fernando, Mark Johnson, et al.2017 · 286 citations
  10. Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence ModelsarXiv:1610.02424Ashwin K Vijayakumar, Michael Cogswell, Ramprasath R. Selvaraju, et al.2016 · 282 citations
  11. MiniCPM-V: A GPT-4V Level MLLM on Your PhonearXiv:2408.01800Yuan Yao, Tianyu Yu, Ao Zhang, et al.2024 · 269 citations
  12. Automatic Machine Translation Evaluation in Many Languages via Zero-Shot ParaphrasingConference on Empirical Methods in Natural Language Processing (EMNLP)Brian Thompson, Matt Post2020 · 260 citations
  13. InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingLecture notes in computer scienceYi Wang, Kunchang Li, Xinhao Li, et al.2024 · 253 citations
  14. Long-term Recurrent Convolutional Networks for Visual Recognition and DescriptionarXiv:1411.4389Jeff Donahue, Lisa Anne Hendricks, Marcus Rohrbach, et al.2014 · 245 citations
  15. Learning to Speak and Act in a Fantasy Text Adventure GamearXiv:1903.03094Jack Urbanek, Angela Fan, Siddharth Karamcheti, et al.2019 · 243 citations
  16. The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural SupervisionarXiv:1904.12584Jiayuan Mao, Chuang Gan, Pushmeet Kohli, et al.2019 · 241 citations
  17. Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyarXiv:2403.14608Zeyu Han, Chao Gao, Jinyang Liu, et al.2024 · 240 citations
  18. OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-AllocationIEEE Computer Society Conference on Computer Vision and Pattern RecognitionQidong Huang, Xiaoyi Dong, Pan Zhang, et al.2023 · 238 citations
  19. Translation between Molecules and Natural LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Carl Edwards, Tuan Lai, Kevin Ros, et al.2022 · 238 citations
  20. A Deep Generative Framework for Paraphrase GenerationarXiv:1709.05074Ankush Gupta, Arvind Agarwal, Prawaan Singh, et al.2017 · 233 citations
  21. Findings of the Third Shared Task on Multimodal Machine TranslationConference on Machine Translation: Shared Task PapersLoïc Barrault, Fethi Bougares, Lucia Specia, et al.2018 · 230 citations
  22. A Survey of Hallucination in Large Foundation ModelsarXiv:2309.05922Vipula Rawte, Amit Sheth, Amitava Das2023 · 226 citations
  23. TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question AnsweringIEEE/CVF International Conference on Computer Vision (ICCV)Yushi Hu, Benlin Liu, Jungo Kasai, et al.2023 · 218 citations
  24. Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, et al.2020 · 218 citations
  25. RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human FeedbackIEEE Computer Society Conference on Computer Vision and Pattern RecognitionTianyu Yu, Yuan Yao, Haoye Zhang, et al.2023 · 217 citations
  26. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
  27. Did the Model Understand the Question?Annual Meeting of the Association for Computational Linguistics (ACL)Pramod Kaushik Mudrakarta, Ankur Taly, Mukund Sundararajan, et al.2018 · 214 citations
  28. What matters when building vision-language models?Conference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 212 citations
  29. Logical Natural Language Generation from Open-Domain TablesAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhu Chen, Jianshu Chen, Yu Su, et al.2020 · 210 citations
  30. Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Shengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 208 citations
  31. NExT-GPT: Any-to-Any Multimodal LLMarXiv:2309.05519Shengqiong Wu, Hao Fei, Leigang Qu, et al.2023 · 207 citations
  32. BLINK: Multimodal Large Language Models Can See but Not PerceiveLecture notes in computer scienceXingyu Fu, Yushi Hu, Bangzheng Li, et al.2024 · 206 citations
  33. Woodpecker: Hallucination Correction for Multimodal Large Language ModelsScience China Information SciencesShukang Yin, Chaoyou Fu, Sirui Zhao, et al.2023 · 206 citations
  34. A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and ValidationArtificial Intelligence ReviewXiaowei Huang, Wenjie Ruan, Wei Huang, et al.2023 · 199 citations
  35. MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningarXiv:2310.09478Jun Chen, Deyao Zhu, Xiaoqian Shen, et al.2023 · 199 citations
  36. MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and TextConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Hexiang Hu, Xi Chen, et al.2022 · 199 citations
  37. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
  38. MM-REACT: Prompting ChatGPT for Multimodal Reasoning and ActionarXiv:2303.11381Zhengyuan Yang, Linjie Li, Jianfeng Wang, et al.2023 · 196 citations
  39. One Embedder, Any Task: Instruction-Finetuned Text EmbeddingsarXiv:2212.09741Hongjin Su, Weijia Shi, Jungo Kasai, et al.2022 · 193 citations
  40. Representation of Linguistic Form and Function in Recurrent Neural NetworksComputational LinguisticsÁkos Kádár, Grzegorz Chrupała, Afra Alishahi2017 · 192 citations
  41. Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction TuningarXiv:2306.14565Fuxiao Liu, Kevin Lin, Linjie Li, et al.2023 · 189 citations
  42. Findings of the 2021 Conference on Machine Translation (WMT21)Conference on Machine Translation (WMT)Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, et al.2021 · 189 citations
  43. Transformers without Tears: Improving the Normalization of Self-AttentionarXiv:1910.05895Toan Q. Nguyen, Julian Salazar2019 · 189 citations
  44. Eliciting Latent Predictions from Transformers with the Tuned LensarXiv:2303.08112Nora Belrose, Igor Ostrovsky, Lev McKinney, et al.2023 · 188 citations
  45. AudioCaps: Generating Captions for Audios in The WildConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chris Dongjoo Kim, Byeongchang Kim, Hyunmin Lee, et al.2019 · 187 citations
  46. Deja Vu: Contextual Sparsity for Efficient LLMs at Inference TimeInternational Conference on Machine Learning (ICML)Zichang Liu, Jue Wang, Tri Dao, et al.2023 · 185 citations
  47. CogVideoX: Text-to-Video Diffusion Models with An Expert TransformerarXiv:2408.06072Zhuoyi Yang, Jiayan Teng, Wendi Zheng, et al.2024 · 184 citations
  48. VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Jing Yu Koh, Robert Lo, Lawrence Jang, et al.2024 · 184 citations
  49. Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall SpacesIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJihan Yang, Shusheng Yang, Anjali W. Gupta, et al.2024 · 182 citations
  50. Order-Embeddings of Images and LanguagearXiv:1511.06361Ivan Vendrov, Ryan Kiros, Sanja Fidler, et al.2015 · 177 citations
  51. Aligning Large Multimodal Models with Factually Augmented RLHFarXiv:2309.14525Zhiqing Sun, Sheng Shen, Shengcao Cao, et al.2023 · 176 citations
  52. Detecting Harmful Memes and Their TargetsFindings of the Association for Computational LinguisticsShraman Pramanick, Dimitar Dimitrov, Rituparna Mukherjee, et al.2021 · 171 citations
  53. Tutel: Adaptive Mixture-of-Experts at ScaleMLSys 2023Changho Hwang, Wei Cui, Yifan Xiong, et al.2022 · 168 citations
  54. Probing What Different NLP Tasks Teach Machines about Function Word ComprehensionJoint Conference on Lexical and Computational Semantics (*SEM)Najoung Kim, Roma Patel, Adam Poliak, et al.2019 · 163 citations
  55. Chameleon: Mixed-Modal Early-Fusion Foundation ModelsarXiv:2405.09818Chameleon Team2024 · 159 citations
  56. ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene GrapharXiv:2006.16934Fei Yu, Jiji Tang, Weichong Yin, et al.2020 · 152 citations
  57. GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructionConference on Neural Information Processing Systems (NeurIPS)Rui Yang, Lin Song, Yanwei Li, et al.2023 · 147 citations
  58. GPT-4V(ision) is a Generalist Web Agent, if GroundedarXiv:2401.01614Boyuan Zheng, Boyu Gou, Jihyung Kil, et al.2024 · 146 citations
  59. InternVideo: General Video Foundation Models via Generative and Discriminative LearningarXiv:2212.03191Yi Wang, Kunchang Li, Yizhuo Li, et al.2022 · 144 citations
  60. Unifying Human and Statistical Evaluation for Natural Language GenerationarXiv:1904.02792Tatsunori B. Hashimoto, Hugh Zhang, Percy Liang2019 · 143 citations
  61. PaliGemma: A versatile 3B VLM for transferarXiv:2407.07726Lucas Beyer, Andreas Steiner, Andre Susano Pinto, et al.2024 · 142 citations
  62. Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and DiscoveryConference on Neural Information Processing Systems (NeurIPS)Yuxin Wen, Neel Jain, John Kirchenbauer, et al.2023 · 141 citations
  63. Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTsTransactions of the Association for Computational Linguistics (TACL)Emanuele Bugliarello, Ryan Cotterell, Naoaki Okazaki, et al.2021 · 141 citations
  64. Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4VarXiv:2310.11441Jianwei Yang, Hao Zhang, Feng Li, et al.2023 · 137 citations
  65. Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image DescriptionConference on Machine Translation (WMT)Desmond Elliott, Stella Frank, Loïc Barrault, et al.2017 · 137 citations
  66. Analyzing and Mitigating Object Hallucination in Large Vision-Language ModelsarXiv:2310.00754Yiyang Zhou, Chenhang Cui, Jaehong Yoon, et al.2023 · 134 citations
  67. Improved Natural Language Generation via Loss TruncationAnnual Meeting of the Association for Computational Linguistics (ACL)Daniel Kang, Tatsunori B. Hashimoto2020 · 130 citations
  68. Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Lei Li, Yuqi Wang, Runxin Xu, et al.2024 · 129 citations
  69. FOIL it! Find One mismatch between Image and Language captionAnnual Meeting of the Association for Computational Linguistics (ACL)Ravi Shekhar, Sandro Pezzelle, Yauhen Klimovich, et al.2017 · 127 citations
  70. Insertion-based Decoding with Automatically Inferred Generation OrderTransactions of the Association for Computational Linguistics (TACL)Jiatao Gu, Qi Liu, Kyunghyun Cho2019 · 125 citations
  71. MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding BenchmarkarXiv:2409.02813Xiang Yue, Tianyu Zheng, Yuansheng Ni, et al.2024 · 123 citations
  72. Hallucination of Multimodal Large Language Models: A SurveyarXiv:2404.18930Zechen Bai, Pichao Wang, Tianjun Xiao, et al.2024 · 120 citations
  73. Emergent Linear Representations in World Models of Self-Supervised Sequence ModelsarXiv:2309.00941Neel Nanda, Andrew Lee, Martin Wattenberg2023 · 116 citations
  74. LMMs-Eval: Reality Check on the Evaluation of Large Multimodal ModelsFindings of the Association for Computational LinguisticsKaichen Zhang, Bo Li, Peiyuan Zhang, et al.2025 · 115 citations
  75. Do Androids Laugh at Electric Sheep? Humor “Understanding” Benchmarks from The New Yorker Caption ContestAnnual Meeting of the Association for Computational Linguistics (ACL)Jack Hessel, Ana Marasovic, Jena D. Hwang, et al.2023 · 112 citations
  76. IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language ReasoningarXiv:2110.13214Pan Lu, Liang Qiu, Jiaqi Chen, et al.2021 · 103 citations
  77. ChartLlama: A Multimodal LLM for Chart Understanding and GenerationarXiv:2311.16483Yucheng Han, Chi Zhang, Xin Chen, et al.2023 · 99 citations
  78. LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image UnderstandingarXiv:2306.17107Yanzhe Zhang, Ruiyi Zhang, Jiuxiang Gu, et al.2023 · 98 citations
  79. Accelerating Sparse Deep Neural NetworksarXiv 2021 (NVIDIA)Asit Mishra, Jorge Albericio Latorre, Jeff Pool, et al.2021 · 97 citations
  80. ColPali: Efficient Document Retrieval with Vision Language ModelsarXiv:2407.01449Manuel Faysse, Hugues Sibille, Tony Wu, et al.2024 · 96 citations
  81. AnyGPT: Unified Multimodal LLM with Discrete Sequence ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Jun Zhan, Junqi Dai, Jiasheng Ye, et al.2024 · 95 citations
  82. Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardsConference on Neural Information Processing Systems (NeurIPS)Alexandre Rame, Guillaume Couairon, Mustafa Shukor, et al.2023 · 90 citations
  83. JGLUE: Japanese General Language Understanding EvaluationLanguage Resources and Evaluation Conference (LREC)Kentaro Kurihara, Daisuke Kawahara, Tomohide Shibata2022 · 90 citations
  84. Benchmarking Vision Language Models for Cultural UnderstandingConference on Empirical Methods in Natural Language Processing (EMNLP)Shravan Nayak, Kanishk Jain, Rabiul Awal, et al.2024 · 87 citations
  85. Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
  86. InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and CompositionarXiv:2309.15112Pan Zhang, Xiaoyi Dong, Bin Wang, et al.2023 · 87 citations
  87. PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image SynthesisarXiv:2310.00426Junsong Chen, Jincheng Yu, Chongjian Ge, et al.2023 · 87 citations
  88. Improving Alignment and Robustness with Circuit BreakersConference on Neural Information Processing Systems (NeurIPS)Andy Zou, Long Phan, Justin Wang, et al.2024 · 83 citations
  89. Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal ModelarXiv:2408.11039Chunting Zhou, Lili Yu, Arun Babu, et al.2024 · 83 citations
  90. A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty QuantificationarXiv:2107.07511Anastasios N. Angelopoulos, Stephen Bates2021 · 79 citations
  91. HOList: An Environment for Machine Learning of Higher-Order Theorem ProvingarXiv:1904.03241Kshitij Bansal, Sarah M. Loos, Markus N. Rabe, et al.2019 · 78 citations
  92. Factuality of Large Language Models: A SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxia Wang, Minghan Wang, Muhammad Arslan Manzoor, et al.2024 · 77 citations
  93. Localizing Model Behavior with Path PatchingarXiv:2304.05969Nicholas Goldowsky-Dill, Chris MacLeod, Lucas Sato, et al.2023 · 76 citations
  94. Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text IntegrationarXiv:2306.09093Chenyang Lyu, Minghao Wu, Longyue Wang, et al.2023 · 75 citations
  95. SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
  96. A Primer on the Inner Workings of Transformer-based Language ModelsarXiv:2405.00208Javier Ferrando, Gabriele Sarti, Arianna Bisazza, et al.2024 · 72 citations
  97. AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination EvaluationarXiv:2311.07397Junyang Wang, Yuhang Wang, Guohai Xu, et al.2023 · 67 citations
  98. We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?arXiv:2407.01284Runqi Qiao, Qiuna Tan, Guanting Dong, et al.2024 · 65 citations
  99. Do Neural Language Representations Learn Physical Commonsense?arXiv:1908.02899Maxwell Forbes, Ari Holtzman, Yejin Choi2019 · 64 citations
  100. ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language ModelsarXiv:2402.11684Guiming Hardy Chen, Shunian Chen, Ruifei Zhang, et al.2024 · 62 citations

1 2 3 4

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/serge-belongie/cited-by/page/2/