🧑‍🔬 Who cites Anas Awadalla

263 citations of their works from 261 papers of our library (of the 149,439 whose bibliographies we read) · 89 with a page here, the most cited first · ← Anas Awadalla

1. Improved Baselines with Visual Instruction TuningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionHaotian Liu, Chunyuan Li, Yuheng Li, et al.2023 · 2,614 citations
2. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
3. MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIIEEE Computer Society Conference on Computer Vision and Pattern RecognitionXiang Yue, Yuansheng Ni, Kai Zhang, et al.2023 · 1,005 citations
4. Universal and Transferable Adversarial Attacks on Aligned Language ModelsarXiv:2307.15043Andy Zou, Zifan Wang, Nicholas Carlini, et al.2023 · 1,005 citations
5. Explainability for Large Language Models: A SurveyACM Transactions on Intelligent Systems and TechnologyHaiyan Zhao, Hanjie Chen, Fan Yang, et al.2023 · 790 citations
6. Jailbreaking Black Box Large Language Models in Twenty QueriesarXiv:2310.08419Patrick Chao, Alexander Robey, Edgar Dobriban, et al.2023 · 553 citations
7. MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsarXiv:2310.02255Pan Lu, Hritik Bansal, Tony Xia, et al.2023 · 468 citations
8. Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video AnalysisIEEE Computer Society Conference on Computer Vision and Pattern RecognitionChaoyou Fu, Yuhan Dai, Yongdong Luo, et al.2024 · 427 citations
9. CogVLM: Visual Expert for Pretrained Language ModelsConference on Neural Information Processing Systems (NeurIPS)Weihan Wang, Qingsong Lv, Wenmeng Yu, et al.2023 · 383 citations
10. Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!arXiv:2310.03693Xiangyu Qi, Yi Zeng, Tinghao Xie, et al.2023 · 355 citations
11. MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesarXiv:2308.02490Weihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 344 citations
12. HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust RefusalarXiv:2402.04249Mantas Mazeika, Long Phan, Xuwang Yin, et al.2024 · 330 citations
13. MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
14. Multimodal Chain-of-Thought Reasoning in Language ModelsarXiv:2302.00923Zhuosheng Zhang, Aston Zhang, Mu Li, et al.2023 · 308 citations
15. OCRBench: On the Hidden Mystery of OCR in Large Multimodal ModelsScience China Information SciencesYuliang Liu, Zhang Li, Mingxin Huang, et al.2023 · 306 citations
16. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
17. JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Patrick Chao, Edoardo Debenedetti, Alexander Robey, et al.2024 · 277 citations
18. Visual Adversarial Examples Jailbreak Aligned Large Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceXiangyu Qi, Kaixuan Huang, Ashwinee Panda, et al.2023 · 240 citations
19. Baseline Defenses for Adversarial Attacks Against Aligned Language ModelsarXiv:2309.00614Neel Jain, Avi Schwarzschild, Yuxin Wen, et al.2023 · 236 citations
20. Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionZhang Li, Biao Yang, Qiang Liu, et al.2023 · 222 citations
21. RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human FeedbackIEEE Computer Society Conference on Computer Vision and Pattern RecognitionTianyu Yu, Yuan Yao, Haoye Zhang, et al.2023 · 217 citations
22. What matters when building vision-language models?Conference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 212 citations
23. Scalable Extraction of Training Data from (Production) Language ModelsarXiv:2311.17035Milad Nasr, Nicholas Carlini, Jonathan Hayase, et al.2023 · 211 citations
24. BLINK: Multimodal Large Language Models Can See but Not PerceiveLecture notes in computer scienceXingyu Fu, Yushi Hu, Bangzheng Li, et al.2024 · 206 citations
25. How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Zeng, Hongpeng Lin, Jingwen Zhang, et al.2024 · 202 citations
26. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
27. Low-Resource Languages Jailbreak GPT-4arXiv:2310.02446Zheng-Xin Yong, Cristina Menghini, Stephen H. Bach2023 · 183 citations
28. Aligning Large Multimodal Models with Factually Augmented RLHFarXiv:2309.14525Zhiqing Sun, Sheng Shen, Shengcao Cao, et al.2023 · 176 citations
29. Catastrophic Jailbreak of Open-source LLMs via Exploiting GenerationarXiv:2310.06987Yangsibo Huang, Samyak Gupta, Mengzhou Xia, et al.2023 · 169 citations
30. WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMsConference on Neural Information Processing Systems (NeurIPS)Seungju Han, Kavel Rao, Allyson Ettinger, et al.2024 · 165 citations
31. SmoothLLM: Defending Large Language Models Against Jailbreaking AttacksarXiv:2310.03684Alexander Robey, Eric Wong, Hamed Hassani, et al.2023 · 164 citations
32. FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual PromptsProceedings of the AAAI Conference on Artificial IntelligenceYichen Gong, Delong Ran, Jinyuan Liu, et al.2023 · 163 citations
33. MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language ModelsLecture notes in computer scienceXin Liu, Yichen Zhu, Jindong Gu, et al.2023 · 152 citations
34. JudgeLM: Fine-tuned Large Language Models are Scalable JudgesarXiv:2310.17631Lianghui Zhu, Xinggang Wang, Xinlong Wang2023 · 145 citations
35. DeepInception: Hypnotize Large Language Model to Be JailbreakerarXiv:2311.03191Xuan Li, Zhanke Zhou, Jianing Zhu, et al.2023 · 141 citations
36. Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Lei Li, Yuqi Wang, Runxin Xu, et al.2024 · 129 citations
37. LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal ModelsarXiv:2407.07895Feng Li, Renrui Zhang, Hao Zhang, et al.2024 · 127 citations
38. Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
39. MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding BenchmarkarXiv:2409.02813Xiang Yue, Tianyu Zheng, Yuansheng Ni, et al.2024 · 123 citations
40. Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingarXiv:2401.05566Evan Hubinger, Carson Denison, Jesse Mu, et al.2024 · 123 citations
41. Hallucination of Multimodal Large Language Models: A SurveyarXiv:2404.18930Zechen Bai, Pichao Wang, Tianjun Xiao, et al.2024 · 120 citations
42. LLM Self Defense: By Self Examination, LLMs Know They Are Being TrickedarXiv:2308.07308Mansi Phute, Alec Helbling, Matthew Hull, et al.2023 · 119 citations
43. Shadow Alignment: The Ease of Subverting Safely-Aligned Language ModelsarXiv:2310.02949Xianjun Yang, Xiao Wang, Qi Zhang, et al.2023 · 103 citations
44. World Model on Million-Length Video And Language With Blockwise RingAttentionarXiv:2402.08268Hao Liu, Wilson Yan, Matei Zaharia, et al.2024 · 99 citations
45. Safety Alignment Should Be Made More Than Just a Few Tokens DeeparXiv:2406.05946Xiangyu Qi, Ashwinee Panda, Kaifeng Lyu, et al.2024 · 97 citations
46. InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large ModelarXiv:2401.16420Xiaoyi Dong, Pan Zhang, Yuhang Zang, et al.2024 · 94 citations
47. WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
48. AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
49. Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
50. InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and CompositionarXiv:2309.15112Pan Zhang, Xiaoyi Dong, Bin Wang, et al.2023 · 87 citations
51. Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM AssessmentConference on Empirical Methods in Natural Language Processing (EMNLP)Vyas Raina, Adian Liusie, Mark Gales2024 · 86 citations
52. Improving Alignment and Robustness with Circuit BreakersConference on Neural Information Processing Systems (NeurIPS)Andy Zou, Long Phan, Justin Wang, et al.2024 · 83 citations
53. Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
54. Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language ModelsarXiv:2307.14539Erfan Shayegani, Yue Dong, Nael Abu-Ghazaleh2023 · 81 citations
55. MANTIS: Interleaved Multi-Image Instruction TuningTransactions on Machine Learning ResearchDongfu Jiang, Xuan He, Huaye Zeng, et al.2024 · 74 citations
56. Long Context Transfer from Language to VisionarXiv:2406.16852Peiyuan Zhang, Kaichen Zhang, Bo Li, et al.2024 · 73 citations
57. VIEScore: Towards Explainable Metrics for Conditional Image Synthesis EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Max Ku, Dongfu Jiang, Cong Wei, et al.2024 · 68 citations
58. Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank ModificationsarXiv:2402.05162Boyi Wei, Kaixuan Huang, Yangsibo Huang, et al.2024 · 66 citations
59. A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and ToxicityarXiv:2401.01967Andrew Lee, Xiaoyan Bai, Itamar Pres, et al.2024 · 64 citations
60. mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language ModelsarXiv:2408.04840Jiabo Ye, Haiyang Xu, Haowei Liu, et al.2024 · 60 citations
61. Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task ArithmeticAnnual Meeting of the Association for Computational Linguistics (ACL)Rishabh Bhardwaj, Duc Anh Do, Soujanya Poria2024 · 59 citations
62. MMICL: Empowering Vision-language Model with Multi-Modal In-Context LearningarXiv:2309.07915Haozhe Zhao, Zefan Cai, Shuzheng Si, et al.2023 · 58 citations
63. In-context Learning with Retrieved Demonstrations for Language Models: A SurveyarXiv:2401.11624Man Luo, Xin Xu, Yue Liu, et al.2024 · 54 citations
64. InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDConference on Neural Information Processing Systems (NeurIPS)Xiaoyi Dong, Pan Zhang, Yuhang Zang, et al.2024 · 54 citations
65. M³CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-ThoughtAnnual Meeting of the Association for Computational Linguistics (ACL)Qiguang Chen, Libo Qin, Jin Zhang, et al.2024 · 54 citations
66. The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce HarmConference on Empirical Methods in Natural Language Processing (EMNLP)Aakanksha, Arash Ahmadian, Beyza Ermis, et al.2024 · 49 citations
67. Understanding Catastrophic Forgetting in Language Models via Implicit InferencearXiv:2309.10105Suhas Kotha, Jacob Mitchell Springer, Aditi Raghunathan2023 · 45 citations
68. Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters MoreConference on Empirical Methods in Natural Language Processing (EMNLP)Zichen Wen, Yifeng Gao, Shaobo Wang, et al.2025 · 44 citations
69. NVLM: Open Frontier-Class Multimodal LLMsarXiv:2409.11402Wenliang Dai, Nayeon Lee, Boxin Wang, et al.2024 · 44 citations
70. InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and OutputarXiv:2407.03320Pan Zhang, Xiaoyi Dong, Yuhang Zang, et al.2024 · 39 citations
71. LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-SteeringAnnual Meeting of the Association for Computational Linguistics (ACL)Jinhe Bi, Yujun Wang, Haokun Chen, et al.2025 · 24 citations
72. Language Model Alignment in Multilingual Trolley ProblemsarXiv:2407.02273Zhijing Jin, Max Kleiman-Weiner, Giorgio Piatti, et al.2024 · 23 citations
73. TACO: Enhancing Multimodal In-context Learning via Task Mapping-Guided Sequence ConfigurationConference on Empirical Methods in Natural Language Processing (EMNLP)Yanshu Li, Jianjiang Yang, Tian Yun, et al.2025 · 22 citations
74. LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution ShiftsAnnual Meeting of the Association for Computational Linguistics (ACL)Qibing Ren, Hao Li, Dongrui Liu, et al.2025 · 18 citations
75. Jailbreaking LLMs with Arabic Transliteration and ArabiziConference on Empirical Methods in Natural Language Processing (EMNLP)Mansour Al Ghanim, Saleh Almohaimeed, Mengxin Zheng, et al.2024 · 16 citations
76. from Benign import Toxic: Jailbreaking the Language Model via Adversarial MetaphorsAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Yan, Sheng Sun, Zenghao Duan, et al.2025 · 12 citations
77. AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak DefenderConference on Empirical Methods in Natural Language Processing (EMNLP)Weixiang Zhao, Jiahe Guo, Yulin Hu, et al.2025 · 11 citations
78. Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems?International Joint Conference on Natural Language Processing (IJCNLP)Kai Yan, Yufei Xu, Zhengyin Du, et al.2025 · 5 citations
79. HiddenGuard: Fine-Grained Safe Generation with Specialized Representation RouterAnnual Meeting of the Association for Computational Linguistics (ACL)Lingrui Mei, Shenghua Liu, Yiwei Wang, et al.2026 · 4 citations
80. Do Images Speak Louder than Words? Investigating the Effect of Textual Misinformation in VLMsConference of the European Chapter of the Association for Computational Linguistics (EACL)Chi Zhang, Wenxuan Ding, Jiale Liu, et al.2026 · 2 citations
81. A Parameter-Efficient and Data-Centric Framework for Ancient Chinese Text Recognition and Layout AnalysisWorkshop on Language Technologies for Historical and Ancient Languages @ LRECYuchun Meng2026
82. Chart-MRAG: Benchmarking Multimodal Retrieval Augmented Generation on Chart-based DocumentsAnnual Meeting of the Association for Computational Linguistics (ACL)Ymyang, Jiang Zhong, Li Jin, et al.2026
83. CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious AttacksAnnual Meeting of the Association for Computational Linguistics (ACL)Xu Zhang, Hao Li, Zhichao Lu2026
84. ECHA: Jailbreaking LVLMs via the Mismatch between Implicit Semantic Reconstruction and Explicit Safety AlignmentFindings of the Association for Computational LinguisticsChenxing Xu, Junyong Jiang, Zehu Zhang, et al.2026
85. Ghost in the Shell: Synonym-Aware Logit Shaping Fingerprint for Copyright Protection of Large Vision-Language ModelsFindings of the Association for Computational LinguisticsXiaofan Zheng, Xinghao Wang, Xiaojun Wan2026
86. Leave My Images Alone: Preventing Multi-Modal Large Language Models from Analyzing Images via Visual Prompt InjectionAnnual Meeting of the Association for Computational Linguistics (ACL)Zedian Shao, Hongbin Liu, Yuepeng Hu, et al.2026
87. MLingualFC: Evaluating Jailbreak Vulnerabilities in Multilingual Vision-Language ModelsWorkshop on Multilinguality in the Era of Large Language ModelsRishabh Makwana, Mamta Mamta, Deeksha Varshney, et al.2026
88. S2H-DPO: Hardness-Aware Preference Optimization for Vision–Language ModelsFindings of the Association for Computational LinguisticsNitish Shukla, Surgan Jandial, Arun Ross2026
89. Simple-VGC: Enhancing Visual Grounding in Multimodal Reasoning via Adaptive Tool CompositionAnnual Meeting of the Association for Computational Linguistics (ACL)Ye Wang, Qianglong Chen, Siyuan Wang, et al.2026

172 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/anas-awadalla/cited-by/