Who cites «Are aligned neural networks adversarially aligned?»
- Improved Baselines with Visual Instruction TuningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionHaotian Liu, Chunyuan Li, Yuheng Li, et al.2023 · 2,614 citations
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
- Universal and Transferable Adversarial Attacks on Aligned Language ModelsarXiv:2307.15043Andy Zou, Zifan Wang, Nicholas Carlini, et al.2023 · 1,005 citations
- Explainability for Large Language Models: A SurveyACM Transactions on Intelligent Systems and TechnologyHaiyan Zhao, Hanjie Chen, Fan Yang, et al.2023 · 790 citations
- Jailbreaking Black Box Large Language Models in Twenty QueriesarXiv:2310.08419Patrick Chao, Alexander Robey, Edgar Dobriban, et al.2023 · 553 citations
- Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!arXiv:2310.03693Xiangyu Qi, Yi Zeng, Tinghao Xie, et al.2023 · 355 citations
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust RefusalarXiv:2402.04249Mantas Mazeika, Long Phan, Xuwang Yin, et al.2024 · 330 citations
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Patrick Chao, Edoardo Debenedetti, Alexander Robey, et al.2024 · 277 citations
- Visual Adversarial Examples Jailbreak Aligned Large Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceXiangyu Qi, Kaixuan Huang, Ashwinee Panda, et al.2023 · 240 citations
- Baseline Defenses for Adversarial Attacks Against Aligned Language ModelsarXiv:2309.00614Neel Jain, Avi Schwarzschild, Yuxin Wen, et al.2023 · 236 citations
- Scalable Extraction of Training Data from (Production) Language ModelsarXiv:2311.17035Milad Nasr, Nicholas Carlini, Jonathan Hayase, et al.2023 · 211 citations
- How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Zeng, Hongpeng Lin, Jingwen Zhang, et al.2024 · 202 citations
- Low-Resource Languages Jailbreak GPT-4arXiv:2310.02446Zheng-Xin Yong, Cristina Menghini, Stephen H. Bach2023 · 183 citations
- Catastrophic Jailbreak of Open-source LLMs via Exploiting GenerationarXiv:2310.06987Yangsibo Huang, Samyak Gupta, Mengzhou Xia, et al.2023 · 169 citations
- WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMsConference on Neural Information Processing Systems (NeurIPS)Seungju Han, Kavel Rao, Allyson Ettinger, et al.2024 · 165 citations
- SmoothLLM: Defending Large Language Models Against Jailbreaking AttacksarXiv:2310.03684Alexander Robey, Eric Wong, Hamed Hassani, et al.2023 · 164 citations
- FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual PromptsProceedings of the AAAI Conference on Artificial IntelligenceYichen Gong, Delong Ran, Jinyuan Liu, et al.2023 · 163 citations
- DeepInception: Hypnotize Large Language Model to Be JailbreakerarXiv:2311.03191Xuan Li, Zhanke Zhou, Jianing Zhu, et al.2023 · 141 citations
- Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingarXiv:2401.05566Evan Hubinger, Carson Denison, Jesse Mu, et al.2024 · 123 citations
- LLM Self Defense: By Self Examination, LLMs Know They Are Being TrickedarXiv:2308.07308Mansi Phute, Alec Helbling, Matthew Hull, et al.2023 · 119 citations
- Shadow Alignment: The Ease of Subverting Safely-Aligned Language ModelsarXiv:2310.02949Xianjun Yang, Xiao Wang, Qi Zhang, et al.2023 · 103 citations
- Safety Alignment Should Be Made More Than Just a Few Tokens DeeparXiv:2406.05946Xiangyu Qi, Ashwinee Panda, Kaifeng Lyu, et al.2024 · 97 citations
- WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
- AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM AssessmentConference on Empirical Methods in Natural Language Processing (EMNLP)Vyas Raina, Adian Liusie, Mark Gales2024 · 86 citations
- Improving Alignment and Robustness with Circuit BreakersConference on Neural Information Processing Systems (NeurIPS)Andy Zou, Long Phan, Justin Wang, et al.2024 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language ModelsarXiv:2307.14539Erfan Shayegani, Yue Dong, Nael Abu-Ghazaleh2023 · 81 citations
- Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank ModificationsarXiv:2402.05162Boyi Wei, Kaixuan Huang, Yangsibo Huang, et al.2024 · 66 citations
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and ToxicityarXiv:2401.01967Andrew Lee, Xiaoyan Bai, Itamar Pres, et al.2024 · 64 citations
- Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task ArithmeticAnnual Meeting of the Association for Computational Linguistics (ACL)Rishabh Bhardwaj, Duc Anh Do, Soujanya Poria2024 · 59 citations
- The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce HarmConference on Empirical Methods in Natural Language Processing (EMNLP)Aakanksha, Arash Ahmadian, Beyza Ermis, et al.2024 · 49 citations
- Understanding Catastrophic Forgetting in Language Models via Implicit InferencearXiv:2309.10105Suhas Kotha, Jacob Mitchell Springer, Aditi Raghunathan2023 · 45 citations
- Language Model Alignment in Multilingual Trolley ProblemsarXiv:2407.02273Zhijing Jin, Max Kleiman-Weiner, Giorgio Piatti, et al.2024 · 23 citations
- LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution ShiftsAnnual Meeting of the Association for Computational Linguistics (ACL)Qibing Ren, Hao Li, Dongrui Liu, et al.2025 · 18 citations
- Jailbreaking LLMs with Arabic Transliteration and ArabiziConference on Empirical Methods in Natural Language Processing (EMNLP)Mansour Al Ghanim, Saleh Almohaimeed, Mengxin Zheng, et al.2024 · 16 citations
- from Benign import Toxic: Jailbreaking the Language Model via Adversarial MetaphorsAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Yan, Sheng Sun, Zenghao Duan, et al.2025 · 12 citations
- AdaSteer: Your Aligned LLM is Inherently an Adaptive Jailbreak DefenderConference on Empirical Methods in Natural Language Processing (EMNLP)Weixiang Zhao, Jiahe Guo, Yulin Hu, et al.2025 · 11 citations
- HiddenGuard: Fine-Grained Safe Generation with Specialized Representation RouterAnnual Meeting of the Association for Computational Linguistics (ACL)Lingrui Mei, Shenghua Liu, Yiwei Wang, et al.2026 · 4 citations
- Do Images Speak Louder than Words? Investigating the Effect of Textual Misinformation in VLMsConference of the European Chapter of the Association for Computational Linguistics (EACL)Chi Zhang, Wenxuan Ding, Jiale Liu, et al.2026 · 2 citations
- ECHA: Jailbreaking LVLMs via the Mismatch between Implicit Semantic Reconstruction and Explicit Safety AlignmentFindings of the Association for Computational LinguisticsChenxing Xu, Junyong Jiang, Zehu Zhang, et al.2026
- Leave My Images Alone: Preventing Multi-Modal Large Language Models from Analyzing Images via Visual Prompt InjectionAnnual Meeting of the Association for Computational Linguistics (ACL)Zedian Shao, Hongbin Liu, Yuepeng Hu, et al.2026
- MLingualFC: Evaluating Jailbreak Vulnerabilities in Multilingual Vision-Language ModelsWorkshop on Multilinguality in the Era of Large Language ModelsRishabh Makwana, Mamta Mamta, Deeksha Varshney, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/carlini-2023-aligned-neural-networks-adversarially-aligned/cited-by/