Elamur Research⌕
☰
home / authors / James H. Hays / cited by / page 2

Who cites James H. Hays

2,648 citations of their works from 2,637 papers of our library (of the 149,439 whose bibliographies we read) · 288 with a page here, the most cited first · page 2 of 3 · 101–200 · ← James H. Hays

1 2 3

  1. Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
  2. SPICE: Semantic Propositional Image Caption EvaluationarXiv:1607.08822Peter Anderson, Basura Fernando, Mark Johnson, et al.2016 · 289 citations
  3. Guided Open Vocabulary Image Captioning with Constrained Beam SearchConference on Empirical Methods in Natural Language Processing (EMNLP)Peter Anderson, Basura Fernando, Mark Johnson, et al.2017 · 286 citations
  4. Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence ModelsarXiv:1610.02424Ashwin K Vijayakumar, Michael Cogswell, Ramprasath R. Selvaraju, et al.2016 · 282 citations
  5. MiniCPM-V: A GPT-4V Level MLLM on Your PhonearXiv:2408.01800Yuan Yao, Tianyu Yu, Ao Zhang, et al.2024 · 269 citations
  6. Automatic Machine Translation Evaluation in Many Languages via Zero-Shot ParaphrasingConference on Empirical Methods in Natural Language Processing (EMNLP)Brian Thompson, Matt Post2020 · 260 citations
  7. InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingLecture notes in computer scienceYi Wang, Kunchang Li, Xinhao Li, et al.2024 · 253 citations
  8. Long-term Recurrent Convolutional Networks for Visual Recognition and DescriptionarXiv:1411.4389Jeff Donahue, Lisa Anne Hendricks, Marcus Rohrbach, et al.2014 · 245 citations
  9. Learning to Speak and Act in a Fantasy Text Adventure GamearXiv:1903.03094Jack Urbanek, Angela Fan, Siddharth Karamcheti, et al.2019 · 243 citations
  10. The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural SupervisionarXiv:1904.12584Jiayuan Mao, Chuang Gan, Pushmeet Kohli, et al.2019 · 241 citations
  11. Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyarXiv:2403.14608Zeyu Han, Chao Gao, Jinyang Liu, et al.2024 · 240 citations
  12. OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-AllocationIEEE Computer Society Conference on Computer Vision and Pattern RecognitionQidong Huang, Xiaoyi Dong, Pan Zhang, et al.2023 · 238 citations
  13. A Deep Generative Framework for Paraphrase GenerationarXiv:1709.05074Ankush Gupta, Arvind Agarwal, Prawaan Singh, et al.2017 · 233 citations
  14. Findings of the Third Shared Task on Multimodal Machine TranslationConference on Machine Translation: Shared Task PapersLoïc Barrault, Fethi Bougares, Lucia Specia, et al.2018 · 230 citations
  15. A Survey of Hallucination in Large Foundation ModelsarXiv:2309.05922Vipula Rawte, Amit Sheth, Amitava Das2023 · 226 citations
  16. TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question AnsweringIEEE/CVF International Conference on Computer Vision (ICCV)Yushi Hu, Benlin Liu, Jungo Kasai, et al.2023 · 218 citations
  17. Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, et al.2020 · 218 citations
  18. RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human FeedbackIEEE Computer Society Conference on Computer Vision and Pattern RecognitionTianyu Yu, Yuan Yao, Haoye Zhang, et al.2023 · 217 citations
  19. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
  20. Did the Model Understand the Question?Annual Meeting of the Association for Computational Linguistics (ACL)Pramod Kaushik Mudrakarta, Ankur Taly, Mukund Sundararajan, et al.2018 · 214 citations
  21. What matters when building vision-language models?Conference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 212 citations
  22. Logical Natural Language Generation from Open-Domain TablesAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhu Chen, Jianshu Chen, Yu Su, et al.2020 · 210 citations
  23. Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Shengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 208 citations
  24. NExT-GPT: Any-to-Any Multimodal LLMarXiv:2309.05519Shengqiong Wu, Hao Fei, Leigang Qu, et al.2023 · 207 citations
  25. BLINK: Multimodal Large Language Models Can See but Not PerceiveLecture notes in computer scienceXingyu Fu, Yushi Hu, Bangzheng Li, et al.2024 · 206 citations
  26. Woodpecker: Hallucination Correction for Multimodal Large Language ModelsScience China Information SciencesShukang Yin, Chaoyou Fu, Sirui Zhao, et al.2023 · 206 citations
  27. A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and ValidationArtificial Intelligence ReviewXiaowei Huang, Wenjie Ruan, Wei Huang, et al.2023 · 199 citations
  28. MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningarXiv:2310.09478Jun Chen, Deyao Zhu, Xiaoqian Shen, et al.2023 · 199 citations
  29. MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and TextConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Hexiang Hu, Xi Chen, et al.2022 · 199 citations
  30. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
  31. MM-REACT: Prompting ChatGPT for Multimodal Reasoning and ActionarXiv:2303.11381Zhengyuan Yang, Linjie Li, Jianfeng Wang, et al.2023 · 196 citations
  32. One Embedder, Any Task: Instruction-Finetuned Text EmbeddingsarXiv:2212.09741Hongjin Su, Weijia Shi, Jungo Kasai, et al.2022 · 194 citations
  33. Representation of Linguistic Form and Function in Recurrent Neural NetworksComputational LinguisticsÁkos Kádár, Grzegorz Chrupała, Afra Alishahi2017 · 192 citations
  34. Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction TuningarXiv:2306.14565Fuxiao Liu, Kevin Lin, Linjie Li, et al.2023 · 189 citations
  35. AudioCaps: Generating Captions for Audios in The WildConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chris Dongjoo Kim, Byeongchang Kim, Hyunmin Lee, et al.2019 · 187 citations
  36. CogVideoX: Text-to-Video Diffusion Models with An Expert TransformerarXiv:2408.06072Zhuoyi Yang, Jiayan Teng, Wendi Zheng, et al.2024 · 184 citations
  37. VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Jing Yu Koh, Robert Lo, Lawrence Jang, et al.2024 · 184 citations
  38. Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall SpacesIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJihan Yang, Shusheng Yang, Anjali W. Gupta, et al.2024 · 182 citations
  39. Order-Embeddings of Images and LanguagearXiv:1511.06361Ivan Vendrov, Ryan Kiros, Sanja Fidler, et al.2015 · 177 citations
  40. Aligning Large Multimodal Models with Factually Augmented RLHFarXiv:2309.14525Zhiqing Sun, Sheng Shen, Shengcao Cao, et al.2023 · 176 citations
  41. Detecting Harmful Memes and Their TargetsFindings of the Association for Computational LinguisticsShraman Pramanick, Dimitar Dimitrov, Rituparna Mukherjee, et al.2021 · 171 citations
  42. Tutel: Adaptive Mixture-of-Experts at ScaleMLSys 2023Changho Hwang, Wei Cui, Yifan Xiong, et al.2022 · 168 citations
  43. Probing What Different NLP Tasks Teach Machines about Function Word ComprehensionJoint Conference on Lexical and Computational Semantics (*SEM)Najoung Kim, Roma Patel, Adam Poliak, et al.2019 · 163 citations
  44. Chameleon: Mixed-Modal Early-Fusion Foundation ModelsarXiv:2405.09818Chameleon Team2024 · 159 citations
  45. ERNIE-ViL: Knowledge Enhanced Vision-Language Representations Through Scene GrapharXiv:2006.16934Fei Yu, Jiji Tang, Weichong Yin, et al.2020 · 152 citations
  46. GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructionConference on Neural Information Processing Systems (NeurIPS)Rui Yang, Lin Song, Yanwei Li, et al.2023 · 147 citations
  47. GPT-4V(ision) is a Generalist Web Agent, if GroundedarXiv:2401.01614Boyuan Zheng, Boyu Gou, Jihyung Kil, et al.2024 · 146 citations
  48. InternVideo: General Video Foundation Models via Generative and Discriminative LearningarXiv:2212.03191Yi Wang, Kunchang Li, Yizhuo Li, et al.2022 · 144 citations
  49. Unifying Human and Statistical Evaluation for Natural Language GenerationarXiv:1904.02792Tatsunori B. Hashimoto, Hugh Zhang, Percy Liang2019 · 143 citations
  50. PaliGemma: A versatile 3B VLM for transferarXiv:2407.07726Lucas Beyer, Andreas Steiner, Andre Susano Pinto, et al.2024 · 142 citations
  51. Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and DiscoveryConference on Neural Information Processing Systems (NeurIPS)Yuxin Wen, Neel Jain, John Kirchenbauer, et al.2023 · 141 citations
  52. Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTsTransactions of the Association for Computational Linguistics (TACL)Emanuele Bugliarello, Ryan Cotterell, Naoaki Okazaki, et al.2021 · 141 citations
  53. Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4VarXiv:2310.11441Jianwei Yang, Hao Zhang, Feng Li, et al.2023 · 137 citations
  54. Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image DescriptionConference on Machine Translation (WMT)Desmond Elliott, Stella Frank, Loïc Barrault, et al.2017 · 137 citations
  55. Analyzing and Mitigating Object Hallucination in Large Vision-Language ModelsarXiv:2310.00754Yiyang Zhou, Chenhang Cui, Jaehong Yoon, et al.2023 · 134 citations
  56. Improved Natural Language Generation via Loss TruncationAnnual Meeting of the Association for Computational Linguistics (ACL)Daniel Kang, Tatsunori B. Hashimoto2020 · 130 citations
  57. Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Lei Li, Yuqi Wang, Runxin Xu, et al.2024 · 129 citations
  58. FOIL it! Find One mismatch between Image and Language captionAnnual Meeting of the Association for Computational Linguistics (ACL)Ravi Shekhar, Sandro Pezzelle, Yauhen Klimovich, et al.2017 · 127 citations
  59. Insertion-based Decoding with Automatically Inferred Generation OrderTransactions of the Association for Computational Linguistics (TACL)Jiatao Gu, Qi Liu, Kyunghyun Cho2019 · 125 citations
  60. MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding BenchmarkarXiv:2409.02813Xiang Yue, Tianyu Zheng, Yuansheng Ni, et al.2024 · 123 citations
  61. Hallucination of Multimodal Large Language Models: A SurveyarXiv:2404.18930Zechen Bai, Pichao Wang, Tianjun Xiao, et al.2024 · 120 citations
  62. LMMs-Eval: Reality Check on the Evaluation of Large Multimodal ModelsFindings of the Association for Computational LinguisticsKaichen Zhang, Bo Li, Peiyuan Zhang, et al.2025 · 115 citations
  63. Do Androids Laugh at Electric Sheep? Humor “Understanding” Benchmarks from The New Yorker Caption ContestAnnual Meeting of the Association for Computational Linguistics (ACL)Jack Hessel, Ana Marasovic, Jena D. Hwang, et al.2023 · 112 citations
  64. ChartLlama: A Multimodal LLM for Chart Understanding and GenerationarXiv:2311.16483Yucheng Han, Chi Zhang, Xin Chen, et al.2023 · 99 citations
  65. LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image UnderstandingarXiv:2306.17107Yanzhe Zhang, Ruiyi Zhang, Jiuxiang Gu, et al.2023 · 98 citations
  66. Accelerating Sparse Deep Neural NetworksarXiv 2021 (NVIDIA)Asit Mishra, Jorge Albericio Latorre, Jeff Pool, et al.2021 · 97 citations
  67. ColPali: Efficient Document Retrieval with Vision Language ModelsarXiv:2407.01449Manuel Faysse, Hugues Sibille, Tony Wu, et al.2024 · 96 citations
  68. AnyGPT: Unified Multimodal LLM with Discrete Sequence ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Jun Zhan, Junqi Dai, Jiasheng Ye, et al.2024 · 95 citations
  69. Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardsConference on Neural Information Processing Systems (NeurIPS)Alexandre Rame, Guillaume Couairon, Mustafa Shukor, et al.2023 · 90 citations
  70. JGLUE: Japanese General Language Understanding EvaluationLanguage Resources and Evaluation Conference (LREC)Kentaro Kurihara, Daisuke Kawahara, Tomohide Shibata2022 · 90 citations
  71. Benchmarking Vision Language Models for Cultural UnderstandingConference on Empirical Methods in Natural Language Processing (EMNLP)Shravan Nayak, Kanishk Jain, Rabiul Awal, et al.2024 · 87 citations
  72. PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image SynthesisarXiv:2310.00426Junsong Chen, Jincheng Yu, Chongjian Ge, et al.2023 · 87 citations
  73. Improving Alignment and Robustness with Circuit BreakersConference on Neural Information Processing Systems (NeurIPS)Andy Zou, Long Phan, Justin Wang, et al.2024 · 83 citations
  74. Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal ModelarXiv:2408.11039Chunting Zhou, Lili Yu, Arun Babu, et al.2024 · 83 citations
  75. A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty QuantificationarXiv:2107.07511Anastasios N. Angelopoulos, Stephen Bates2021 · 79 citations
  76. HOList: An Environment for Machine Learning of Higher-Order Theorem ProvingarXiv:1904.03241Kshitij Bansal, Sarah M. Loos, Markus N. Rabe, et al.2019 · 78 citations
  77. Factuality of Large Language Models: A SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxia Wang, Minghan Wang, Muhammad Arslan Manzoor, et al.2024 · 77 citations
  78. Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text IntegrationarXiv:2306.09093Chenyang Lyu, Minghao Wu, Longyue Wang, et al.2023 · 75 citations
  79. SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
  80. AMBER: An LLM-free Multi-dimensional Benchmark for MLLMs Hallucination EvaluationarXiv:2311.07397Junyang Wang, Yuhang Wang, Guohai Xu, et al.2023 · 67 citations
  81. We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?arXiv:2407.01284Runqi Qiao, Qiuna Tan, Guanting Dong, et al.2024 · 65 citations
  82. Do Neural Language Representations Learn Physical Commonsense?arXiv:1908.02899Maxwell Forbes, Ari Holtzman, Yejin Choi2019 · 64 citations
  83. ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language ModelsarXiv:2402.11684Guiming Hardy Chen, Shunian Chen, Ruifei Zhang, et al.2024 · 62 citations
  84. The Generative AI Paradox: "What It Can Create, It May Not Understand"arXiv:2311.00059Peter West, Ximing Lu, Nouha Dziri, et al.2023 · 62 citations
  85. MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language BenchmarkarXiv:2402.04788Dongping Chen, Ruoxi Chen, Shilin Zhang, et al.2024 · 60 citations
  86. mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language ModelsarXiv:2408.04840Jiabo Ye, Haiyang Xu, Haowei Liu, et al.2024 · 60 citations
  87. MMICL: Empowering Vision-language Model with Multi-Modal In-Context LearningarXiv:2309.07915Haozhe Zhao, Zefan Cai, Shuzheng Si, et al.2023 · 58 citations
  88. Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?arXiv:2406.13121Jinhyuk Lee, Anthony Chen, Zhuyun Dai, et al.2024 · 53 citations
  89. The PhotoBook Dataset: Building Common Ground through Visually-Grounded DialogueAnnual Meeting of the Association for Computational Linguistics (ACL)Janosch Haber, Tim Baumgärtner, Ece Takmaz, et al.2019 · 53 citations
  90. AutoML-GPT: Automatic Machine Learning with GPTarXiv:2305.02499Shujian Zhang, Chengyue Gong, Lemeng Wu, et al.2023 · 52 citations
  91. SciGraphQA: A Large-Scale Synthetic Multi-Turn Question-Answering Dataset for Scientific GraphsarXiv:2308.03349Shengzhi Li, Nima Tajbakhsh2023 · 50 citations
  92. NVLM: Open Frontier-Class Multimodal LLMsarXiv:2409.11402Wenliang Dai, Nayeon Lee, Boxin Wang, et al.2024 · 44 citations
  93. Large Multilingual Models Pivot Zero-Shot Multimodal Learning across LanguagesarXiv:2308.12038Jinyi Hu, Yuan Yao, Chongyi Wang, et al.2023 · 43 citations
  94. A Systematic Survey of Automatic Prompt Optimization TechniquesConference on Empirical Methods in Natural Language Processing (EMNLP)Kiran Ramnath, Kang Zhou, Sheng Guan, et al.2025 · 40 citations
  95. MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at ScaleAnnual Meeting of the Association for Computational Linguistics (ACL)Jiawei Guo, Tianyu Zheng, Yizhi Li, et al.2025 · 40 citations
  96. Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
  97. Continual Adaptation for Efficient Machine CommunicationConference on Computational Natural Language Learning (CoNLL)Robert Hawkins, Minae Kwon, Dorsa Sadigh, et al.2020 · 38 citations
  98. Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and ParaphrasingarXiv:2305.16635Jaehun Jung, Peter West, Liwei Jiang, et al.2023 · 36 citations
  99. Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese UnderstandingarXiv:2405.08748Zhimin Li, Jianwei Zhang, Qin Lin, et al.2024 · 35 citations
  100. Arabic Image Captioning using Pre-training of Deep Bidirectional TransformersInternational Natural Language Generation Conference (INLG)Jonathan Emami, Pierre Nugues, Ashraf Elnagar, et al.2022 · 33 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/james-h-hays/cited-by/page/2/