Elamur Research⌕
☰
home / topics / Vision & language / page 3

🖼️ Vision & language

221 papers · page 3 of 3 · 126–221 · the most cited first · all topics

Text with images and video: captions, visual questions and models that see and read.

1 2 3

  1. Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model ScalingXiaokang Chen, Zhiyu Wu, Xingchao Liu, et al.2025 · 97 citations
  2. InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large ModelXiaoyi Dong, Pan Zhang, Yuhang Zang, et al.2024 · 92 citations
  3. Towards Emotion-aided Multi-modal Dialogue Act ClassificationTulika Saha, Aditya Patra, Sriparna Saha, et al.2020 · 78 citations
  4. Dynamic Routing Transformer Network for Multimodal Sarcasm DetectionYuan Tian, Nan Xu, Ruike Zhang, et al.2023 · 66 citations
  5. MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection SystemLibo Qin, Shijue Huang, Qiguang Chen, et al.2023 · 65 citations
  6. Building a Bridge: A Method for Image-Text Sarcasm Detection Without Pretraining on Image-Text DataXinyu Wang, Xiaowen Sun, Tan Yang, et al.2020 · 62 citations
  7. When did you become so smart, oh wise one?! Sarcasm Explanation in Multi-modal Multi-party DialoguesShivani Kumar, Atharva Kulkarni, Md Shad Akhtar, et al.2022 · 51 citations
  8. The PhotoBook Dataset: Building Common Ground through Visually-Grounded DialogueJanosch Haber, Tim Baumgärtner, Ece Takmaz, et al.2019 · 51 citations
  9. What Does Your Smile Mean? Jointly Detecting Multi-Modal Sarcasm and Sentiment Using Quantum ProbabilityYaochen Liu, Yazhou Zhang, Qiuchi Li, et al.2021 · 43 citations
  10. FAST: Efficient Action Tokenization for Vision-Language-Action ModelsKarl Pertsch, Kyle Stachowicz, Brian Ichter, et al.2025 · 38 citations
  11. CITE: A Corpus of Image-Text Discourse RelationsMalihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo, et al.2019 · 37 citations
  12. A Multimodal Corpus for Emotion Recognition in SarcasmAnupama Ray, Shubham Mishra, Apoorva Nunna, et al.2022 · 35 citations
  13. SemEval-2025 Task 1: AdMIRe - Advancing Multimodal Idiomaticity RepresentationThomas Pickard, Aline Villavicencio, Maggie Mi, et al.2025 · 30 citations
  14. Multi-modal Stance Detection: New Datasets and ModelBin Liang, Ang Li, Jingqian Zhao, et al.2024 · 28 citations
  15. Multimodal Sarcasm Target Identification in TweetsJiquan Wang, Lin Sun, Yi Liu, et al.2022 · 28 citations
  16. Multi-source Semantic Graph-based Multimodal Sarcasm Explanation GenerationLiqiang Jing, Xuemeng Song, Kun Ouyang, et al.2023 · 26 citations
  17. CofiPara: A Coarse-to-fine Paradigm for Multimodal Sarcasm Target Identification with Large Multimodal ModelsZixin Chen, Hongzhan Lin, Ziyang Luo, et al.2024 · 20 citations
  18. Propaganda to Hate: A Multimodal Analysis of Arabic Memes with Multi-Agent LLMsFiroj Alam, Md. Rafiul Biswas, Uzair Shah, et al.2024 · 18 citations
  19. Common Ground Tracking in Multimodal DialogueIbrahim Khalil Khebour, Kenneth Lai, Mariah Bradford, et al.2024 · 17 citations
  20. Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine TranslationWenyu Guo, Qingkai Fang, Dong Yu, et al.2023 · 15 citations
  21. Extension Multi30K: Multimodal Dataset for Integrated Vision and Language Research in UkrainianNataliia Saichyshyna, Daniil Maksymenko, Oleksii Turuta, et al.2023 · 15 citations
  22. Towards Arabic Multimodal Dataset for Sentiment AnalysisAbdelhamid Haouhat, Slimane Bellaouar, Attia Nehar, et al.2023 · 13 citations
  23. Amharic LLaMA and LLaVA: Multimodal LLMs for Low Resource LanguagesMichael Andersland2024 · 12 citations
  24. AIN: The Arabic INclusive Large Multimodal ModelAhmed Heakl, Sara Ghaboura, Omkar Thawkar, et al.2025 · 11 citations
  25. Multimodal Semantic Learning from Child-Directed InputAngeliki Lazaridou, Grzegorz Chrupała, Raquel Fernández, et al.2016 · 9 citations
  26. A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity UnderstandingDilara Torunoğlu-Selamet, Doğukan Arslan, Rodrigo Wilkens, et al.2026 · 8 citations
  27. Acquired TASTE: Multimodal Stance Detection with Textual and Structural EmbeddingsGuy Barel, Oren Tsur, Dan Vilenchik2025 · 8 citations
  28. A Formal Analysis of Multimodal Referring Strategies Under Common GroundNikhil Krishnaswamy, James Pustejovsky2020 · 8 citations
  29. This One or That One? A Study on Accessibility via Demonstratives with Multimodal Large Language ModelsYu Wang, Emmanuele Chersoni, Chu-Ren Huang2026 · 7 citations
  30. Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality EnsemblesAbhijnan Nath, Huma Jamil, Shafiuddin Rehan Ahmed, et al.2024 · 7 citations
  31. Hierarchical Fusion for Online Multimodal Dialog Act ClassificationMd Messal Monem Miah, Adarsh Pyarelal, Ruihong Huang2023 · 7 citations
  32. The Aligned Multimodal Movie Treebank: An audio, video, dependency-parse treebankAdam Yaari, Jan DeWitt, Henry Hu, et al.2022 · 7 citations
  33. OASIS: A Multilingual and Multimodal Dataset for Culturally Grounded Spoken Visual QAFiroj Alam, Ali Ezzat Shahroor, Md. Arid Hasan, et al.2025 · 6 citations
  34. Acquiring Linguistic Knowledge from Multimodal InputTheodor Amariucai, Alexander Scott Warstadt2023 · 6 citations
  35. GRAVL-BERT: Graphical Visual-Linguistic Representations for Multimodal Coreference ResolutionDanfeng Guo, Arpit Gupta, Sanchit Agarwal, et al.2022 · 6 citations
  36. ARB: A Comprehensive Arabic Multimodal Reasoning BenchmarkSara Ghaboura, Shubham Patle, Ketan More, et al.2026 · 3 citations
  37. Evaluating Multimodal Large Language Models on Vertically Written Japanese TextKeito Sasagawa, Shuhei Kurita, Daisuke Kawahara2026 · 3 citations
  38. Arabic Multimodal Machine Learning: Datasets, Applications, Approaches, and ChallengesAbdelhamid Haouhat, Slimane Bellaouar, Attia Nehar, et al.2025 · 3 citations
  39. Baseer: A Vision-Language Model for Arabic Document-to-Markdown OCRKhalil Hennara, Muhammad Hreden, Mohamed Motasim Hamed, et al.2025 · 3 citations
  40. Detecting Hope, Hate, and Emotion in Arabic Textual Speech and Multi-modal Memes Using Large Language ModelsNouar AlDahoul, Yasir Zaki2025 · 2 citations
  41. Multimodal Arabic Captioning with Interpretable Visual Concept IntegrationPassant Elchafei, Amany Fashwan2025 · 2 citations
  42. 6fanle Submission to the AmericasNLP 2026 Shared Task on Wixarika Image CaptioningJi Wang, Hanqi Yang2026 · 1 citation
  43. AHA-Memes: A Fine-Grained Multimodal Benchmark for Understanding Hate in Arabic MemesMohamed Bayan Kmainasi, Ali Ezzat Shahroor, Abul Hasnat, et al.2026 · 1 citation
  44. Culturally-Aware Image Captioning for Guaraní with Multimodal Prompting: IUHoosiers at AmericasNLP 2026Wenchen Shi, Phakphum Artkaew, Luke Gessler2026 · 1 citation
  45. Digital Harf: A Clinically Integrated Multimodal AI System for Pervasive Arabic Speech and Language TherapyAsif Azad, Mohammad Sadat Hossain, MD Sadik Hossain Shanto, et al.2026 · 1 citation
  46. ITUNLP at MWE-2026 AdMIRe 2: A Zero-Shot LLM Pipeline for Multimodal Idiom Understanding and RankingAtakan Site, Oğuz Ali Arslan, Gülşen Eryiğit2026 · 1 citation
  47. Multi-modal, Multi-task, Multi-criteria Automatic Evaluation with Vision Language ModelsMasanari Oi, Masahiro Kaneko, Naoaki Okazaki, et al.2026 · 1 citation
  48. Nearest-Neighbor Retrieval for Indigenous Image CaptioningJustin Vasselli, Arturo Martínez Peguero, Shintaro Ozaki, et al.2026 · 1 citation
  49. Reading Dynamics and Comprehension in Cognitive Aging: A Multimodal Language ResourceClaudia Marzi, Noemi Boni, Alice Todesco, et al.2026 · 1 citation
  50. Structured Entity Extraction from Hawaiian Television Chyrons Using Vision-Language ModelsKelley Lynch, Owen King, Kyeongmin Rim, et al.2026 · 1 citation
  51. Test-Time Adaptation of an Offline Multimodal Foundation Model for Simultaneous Speech TranslationYi Xing, Manli Yu, Pengfei Liu, et al.2026 · 1 citation
  52. BitMar: Low-Bit Multimodal Fusion with Episodic Memory for Edge DevicesEuhid Aman, Esteban Carlin, Hsing-Kuo Kenneth Pao, et al.2025 · 1 citation
  53. MLInitiative at CASE 2025: Multimodal Detection of Hate Speech, Humor,and Stance using TransformersAshish Acharya, Ankit Bk, Bikram K.C., et al.2025 · 1 citation
  54. Dreaming Out Loud: A Self-Synthesis Approach For Training Vision-Language Models With Developmentally Plausible DataBadr AlKhamissi, Yingtian Tang, Abdülkadir Gökce, et al.2024 · 1 citation
  55. A Large-Scale Instruction-Tuning Dataset and Models for Slovenian Vision-Language TasksMatej Martinc, Domen Vreš2026
  56. AgriChain: Visually-Grounded Expert-Verified Reasoning for Interpretable Agricultural Vision–Language ModelsHazza Mahmood, Yongqiang Yu, Rao Anwer2026
  57. alexandru412 at MWE-2026 AdMIRe 2.0: Advancing Multimodal Idiomaticity RepresentationCristea Alexandru-Marian2026
  58. Assessing Y-Axis Influence: Bias in Multimodal Language Models on Chart-to-Table TranslationSeok Hwan Song, Azher Ahmed Efat, Wallapak Tavanapong2026
  59. CANVAS: A Multimodal Dataset of Chinese Textbook Images for Bias and Representation AnalysisHaotian Zhu, Kefan Yu, Min Li2026
  60. ClimateChat-300K: A Multi-Modal Facebook Dataset for Understanding Diverse Perspectives in Climate CommunicationWajdi Zaghouani, Md. Rafiul Biswas, Mabrouka Bessghaier, et al.2026
  61. CONVERSE: Annotation Scheme and Dataset for Multimodal Conversational Engagement Analysis in Human-Human and Human-Robot InteractionEkaterina Torubarova, Oskar Ljung, Julia Uddén, et al.2026
  62. COPECO-Speech: Multimodal Post-Editing with Speech and LLMs for Translation TeachingJeevanthi Liyanapathirana, Pierrette Bouillon, Jonathan Mutal, et al.2026
  63. Detecting Latin in Historical Books with Large Language Models: A Multimodal BenchmarkYu Wu, Ke Shu, Jonas Fischer, et al.2026
  64. Do Factual Recall Mechanisms Carry over from Text to Speech in Multimodal Language Models?Luca Modica, Filip Landin, Mehrdad Farahani, et al.2026
  65. Do Multimodal LLMs Understand Order? Measuring the Fragility of Multimodal Reasoning under Input Order PerturbationsSheng-Lun Wei, Yu-Ling Liao, Hen-Hsen Huang, et al.2026
  66. DREAM: A Multicultural Multimodal Dataset Linking Dialogues and Realistic Image SequencesJuan Mallo, Marcos Estecha-Garitagoitia, Ricardo Cordoba, et al.2026
  67. Early Fusion with Contrastive Learning: A Lightweight Alternative for Multi-modal ClassificationFelix Wernlein, Abhik Jana, Sandipan Sikdar2026
  68. Evaluating Discriminability of Vision-Language ModelsMasayasu Muraoka, Naoaki Okazaki2026
  69. Evaluating Multimodal Large Language Model Narrative Interpretation through the Lens of Appraisal TheoryJayant Teotia, Xiaowei Wang, Xulang Zhang, et al.2026
  70. Event Chronography in Multi-modal Data: The BME Method for Quantitative AnalysesAnaïs Claire Murat, Maria Koutsombogera, Carl Vogel2026
  71. I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in MemesShijia Zhou, Saif M. Mohammad, Barbara Plank, et al.2026
  72. ImageEval 2026: Culturally Grounded Arabic Multimodal EvaluationSamir Abdaljalil, Hunzalah Hassan Bhatti, Ahlam Bashiti, et al.2026
  73. K-MIND: Korean Multimodal INteraction Data for Dyadic Conversation AnalysisJae Hee Yang, Yuha Shin, Saim Shin, et al.2026
  74. Leveraging Semi-Supervised Learning for Multimodal Hate Speech Data Annotation and DetectionRathi Adarshi Rammohan, Zhao Ren, Dominik Puchała, et al.2026
  75. LST at MWE-2026 AdMIRe 2: Advancing Multimodal Idiomaticity RepresentationLe Qiu, Yu-Yin Hsu, Emmanuele Chersoni2026
  76. MASA: A Novel Multimodal Foundation Model for L2 Speaking Assessment in Picture-description ScenariosBi-Cheng Yan, Fu-An Chao, Hong-Yun H.Y. Lin, et al.2026
  77. MEUR: A Benchmark for Evaluating Vision-Language Models on Multimodal Event Understanding and ReasoningZimu Wang, Yuqi Wang, Tong Chen, et al.2026
  78. MT-Video-Bench: A Holistic Video Understanding Benchmark for Evaluating Multimodal LLMs in Multi-Turn DialoguesYaning Pan, Qianqian Xie, Guohui Zhang, et al.2026
  79. Multimodal Entrainment and Feedback in Online Group MeetingsPatrizia Paggio, Manex Agirrezabal, Giulia Di Cristina, et al.2026
  80. Multimodal LLMs Do Not Compose Skills Optimally across ModalitiesPaula Ontalvilla, Aitor Ormazabal, Gorka Azkune2026
  81. Multimodal Reference by Means of the Pronoun We and Hand Gestures in a Novel Corpus of Parliamentary Opening DebatesCostanza Navarretta2026
  82. Seeing the Other Side: Diagnostic Tasks for Viewpoint Reasoning in Vision–Language ModelsMakoto Takenaka, Hitomi Yanaka2026
  83. Similar Predictions, Different Processes: A Multi-Level Comparison of Human and Multimodal LLM Language PredictionShuqi Wang, Zhenguang Cai2026
  84. STRUDEL: Unrolling a Benchmark for Evaluating Vision-Language Models on Structured Diagram Understanding across DomainsDaniel Steinigen, Lucie Flek, Sebastian Houben2026
  85. That’s what I need: A multimodal study of Hebrew ‘Reversed Pseudo-Clefts’Yael Maschler, Hilla Polak-Yitzhaki2026
  86. TiC-MuFormer: Time-Aware Caption-Integrated Multimodal Transformers for User-Level Mental Health ModelingGeorgios Tsoumplekas, Yannis Spyridis, Vasileios Argyriou2026
  87. ViX-Ray: A Vietnamese Chest X-Ray Dataset for Vision-Language ModelsDuy Vu Minh Nguyen, Chinh Thanh Truong, Trần Hoàng Phúc, et al.2026
  88. Voices across Decades: A Multimodal Diachronic Corpus of German Bundestag Debates (GerParlDia-MM)Ingo Siegert2026
  89. When Tables Go Crazy: Evaluating Multimodal Models on French Financial DocumentsVirginie Mouilleron, Théo Lasnier, Anna Mosolova, et al.2026
  90. Which Way Does Time Flow? A Psychophysics-Grounded Evaluation for Vision–Language ModelsShiho Matta, Lis Kanashiro Pereira, Peitao Han, et al.2026
  91. 从感知到推理：深度思考赋能多模态大语言模型 (From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models)Wenxin Zhu (祝文鑫), Andong Chen (陈安东), Yuchen Song (宋宇宸), et al.2026
  92. Enhancing Quranic Learning: A Multimodal Deep Learning Approach for Arabic Phoneme RecognitionAyhan Kucukmanisa, Derya Gelmez, Sukru Selim Calik, et al.2025
  93. Wasm: A Pipeline for Constructing Structured Arabic Interleaved Multimodal CorporaKhalil Hennara; Ahmad Bastati; Muhammad Hreden; Mohamed Motasim Hamed; Zeina Aldallal; Sara Chrouf;, Safwan AlModhayan2025
  94. 视频问答技术研究进展 (Research Progress of Video Question Answering Technologies)Cuizhu Bao (包翠竹), Kai Ding (丁凯), Jianfeng Dong (董建锋), et al.2024
  95. The Youthful Heracles-Melqart in Tyre. Choosing a Visual Language for a Phoenician God in the Hellenistic PeriodAchim Lichtenberger2022
  96. 视觉语言预训练综述 (Survey on Vision-language Pre-training)Jiong Yin (殷炯), Zhedong Zhang (张哲东), Yuhan Gao (高宇涵), et al.2022

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/topics/multimodal/page/3/