Who cites Neel Jain
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the UglyarXiv:2312.02003Yifan Yao, Jinhao Duan, Kaidi Xu, et al.2023 · 1,186 citations
- Universal and Transferable Adversarial Attacks on Aligned Language ModelsarXiv:2307.15043Andy Zou, Zifan Wang, Nicholas Carlini, et al.2023 · 1,005 citations
- Jailbreaking Black Box Large Language Models in Twenty QueriesarXiv:2310.08419Patrick Chao, Alexander Robey, Edgar Dobriban, et al.2023 · 553 citations
- Security and Privacy Challenges of Large Language Models: A SurveyACM Computing SurveysBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 424 citations
- Large Language Models as OptimizersarXiv:2309.03409Chengrun Yang, Xuezhi Wang, Yifeng Lu, et al.2023 · 413 citations
- AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language ModelsarXiv:2310.04451Xiaogeng Liu, Nan Xu, Muhao Chen, et al.2023 · 350 citations
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust RefusalarXiv:2402.04249Mantas Mazeika, Long Phan, Xuwang Yin, et al.2024 · 330 citations
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Patrick Chao, Edoardo Debenedetti, Alexander Robey, et al.2024 · 277 citations
- Tree of Attacks: Jailbreaking Black-Box LLMs AutomaticallyConference on Neural Information Processing Systems (NeurIPS)Anay Mehrotra, Manolis Zampetakis, Paul Kassianik, et al.2023 · 251 citations
- Baseline Defenses for Adversarial Attacks Against Aligned Language ModelsarXiv:2309.00614Neel Jain, Avi Schwarzschild, Yuxin Wen, et al.2023 · 236 citations
- How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Zeng, Hongpeng Lin, Jingwen Zhang, et al.2024 · 202 citations
- Catastrophic Jailbreak of Open-source LLMs via Exploiting GenerationarXiv:2310.06987Yangsibo Huang, Samyak Gupta, Mengzhou Xia, et al.2023 · 169 citations
- SmoothLLM: Defending Large Language Models Against Jailbreaking AttacksarXiv:2310.03684Alexander Robey, Eric Wong, Hamed Hassani, et al.2023 · 164 citations
- DeepInception: Hypnotize Large Language Model to Be JailbreakerarXiv:2311.03191Xuan Li, Zhanke Zhou, Jianing Zhu, et al.2023 · 141 citations
- Detecting Language Model Attacks with PerplexityarXiv:2308.14132Gabriel Alon, Michael Kamfonas2023 · 141 citations
- Jailbreak and Guard Aligned Language Models with Only Few In-Context DemonstrationsarXiv:2310.06387Zeming Wei, Yifei Wang, Ang Li, et al.2023 · 130 citations
- SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Zhangchen Xu, Fengqing Jiang, Luyao Niu, et al.2024 · 127 citations
- SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language ModelsFindings of the Association for Computational LinguisticsLijun Li, Bowen Dong, Ruohui Wang, et al.2024 · 119 citations
- LLM Self Defense: By Self Examination, LLMs Know They Are Being TrickedarXiv:2308.07308Mansi Phute, Alec Helbling, Matthew Hull, et al.2023 · 119 citations
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive AttacksarXiv:2404.02151Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion2024 · 118 citations
- Certifying LLM Safety against Adversarial PromptingarXiv:2309.02705Aounon Kumar, Chirag Agarwal, Suraj Srinivas, et al.2023 · 113 citations
- Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMAnnual Meeting of the Association for Computational Linguistics (ACL)Bochuan Cao, Yuanpu Cao, Lu Lin, et al.2024 · 109 citations
- Can LLM-Generated Misinformation Be Detected?arXiv:2309.13788Canyu Chen, Kai Shu2023 · 108 citations
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt OptimizationarXiv:2310.16427Xinyuan Wang, Chenxi Li, Zhen Wang, et al.2023 · 102 citations
- Optimizing Instructions and Demonstrations for Multi-Stage Language Model ProgramsConference on Empirical Methods in Natural Language Processing (EMNLP)Krista Opsahl-Ong, Michael J Ryan, Josh Purtell, et al.2024 · 99 citations
- AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
- In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space SteeringarXiv:2311.06668Sheng Liu, Haotian Ye, Lei Xing, et al.2023 · 89 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM AssessmentConference on Empirical Methods in Natural Language Processing (EMNLP)Vyas Raina, Adian Liusie, Mark Gales2024 · 86 citations
- A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models EasilyarXiv:2311.08268Peng Ding, Jun Kuang, Dan Ma, et al.2023 · 85 citations
- Formalizing and Benchmarking Prompt Injection Attacks and DefensesarXiv:2310.12815Yupei Liu, Yuqi Jia, Runpeng Geng, et al.2023 · 84 citations
- ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMsarXiv:2402.11753Fengqing Jiang, Zhangchen Xu, Luyao Niu, et al.2024 · 83 citations
- Improving Alignment and Robustness with Circuit BreakersConference on Neural Information Processing Systems (NeurIPS)Andy Zou, Long Phan, Justin Wang, et al.2024 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language ModelsarXiv:2402.07867Wei Zou, Runpeng Geng, Binghui Wang, et al.2024 · 80 citations
- Explore, Establish, Exploit: Red Teaming Language Models from ScratcharXiv:2306.09442Stephen Casper, Jason Lin, Joe Kwon, et al.2023 · 52 citations
- Unveiling Privacy Risks in LLM Agent MemoryAnnual Meeting of the Association for Computational Linguistics (ACL)Bo Wang, Weiyi He, Shenglai Zeng, et al.2025 · 33 citations
- Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Haneul Yoo, Yongjin Yang, Hwaran Lee2025 · 26 citations
- Intention Analysis Makes LLMs A Good Jailbreak DefenderInternational Conference on Computational Linguistics (COLING)Yuqi Zhang, Liang Ding, Lefei Zhang, et al.2025 · 21 citations
- Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from JailbreakingConference on Empirical Methods in Natural Language Processing (EMNLP)Junda Zhu, Lingyong Yan, Shuaiqiang Wang, et al.2025 · 21 citations
- Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal TrainingAnnual Meeting of the Association for Computational Linguistics (ACL)Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, et al.2025 · 19 citations
- Shaping the Safety Boundaries: Understanding and Defending Against Jailbreaks in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Lang Gao, Jiahui Geng, Xiangliang Zhang, et al.2025 · 19 citations
- LLMs know their vulnerabilities: Uncover Safety Gaps through Natural Distribution ShiftsAnnual Meeting of the Association for Computational Linguistics (ACL)Qibing Ren, Hao Li, Dongrui Liu, et al.2025 · 18 citations
- Revisiting Jailbreaking for Large Language Models: A Representation Engineering PerspectiveInternational Conference on Computational Linguistics (COLING)Tianlong Li, Zhenghua Wang, Wenhao Liu, et al.2025 · 17 citations
- When "Competency" in Reasoning Opens the Door to Vulnerability: Jailbreaking LLMs via Novel Complex CiphersarXiv:2402.10601Divij Handa, Zehua Zhang, Amir Saeidi, et al.2024 · 15 citations
- Understanding Chain-of-Thought in LLMs through Information TheoryarXiv:2411.11984Jean-Francois Ton, Muhammad Faaiz Taufiq, Yang Liu2024 · 14 citations
- Refining Input Guardrails: Enhancing LLM-as-a-Judge Efficiency Through Chain-of-Thought Fine-Tuning and AlignmentarXiv:2501.13080Melissa Kazemi Rad, Huy Nghiem, Andy Luo, et al.2025 · 9 citations
- CORBA: Contagious Recursive Blocking Attacks on Multi-Agent Systems Based on Large Language ModelsFindings of the Association for Computational LinguisticsZhenhong Zhou, Zherui Li, Jie Zhang, et al.2026 · 7 citations
- HiddenGuard: Fine-Grained Safe Generation with Specialized Representation RouterAnnual Meeting of the Association for Computational Linguistics (ACL)Lingrui Mei, Shenghua Liu, Yiwei Wang, et al.2026 · 4 citations
- CTCC: A Robust and Stealthy Fingerprinting Framework for Large Language Models via Cross-Turn Contextual Correlation BackdoorConference on Empirical Methods in Natural Language Processing (EMNLP)Zhenhua Xu, Xixiang Zhao, Xubin Yue, et al.2025 · 4 citations
- Jailbreaking Attacks vs. Content Safety Filters: How Far Are We in the LLM Safety Arms Race?Findings of the Association for Computational LinguisticsYuan Xin, Dingfan Chen, Linyi Yang, et al.2026 · 3 citations
- Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement LearningFindings of the Association for Computational LinguisticsWenjin Liu, Haoran Luo, Xueyuan Lin, et al.2026 · 3 citations
- Universal Jailbreak Suffixes Are Strong Attention HijackersTransactions of the Association for Computational Linguistics (TACL)Matan Ben-Tov, Mor Geva, Mahmood Sharif2026 · 3 citations
- Unraveling LLM Jailbreaks Through Safety Knowledge NeuronsConference of the European Chapter of the Association for Computational Linguistics (EACL)Chongwen Zhao, Yutong Ke, Kaizhu Huang2026 · 3 citations
- In-Context Representation HijackingAnnual Meeting of the Association for Computational Linguistics (ACL)Itay Yona, Amir Sarid, Michael Karasik, et al.2026 · 2 citations
- Persona Jailbreaking in Large Language ModelsFindings of the Association for Computational LinguisticsJivnesh Sandhan, Fei Cheng, Tushar Sandhan, et al.2026 · 2 citations
- Adversarial Decoding: Generating Readable Documents for Adversarial ObjectivesFindings of the Association for Computational LinguisticsCollin Zhang, Tingwei Zhang, Vitaly Shmatikov2026 · 1 citation
- Beyond Surface-Level Detection: Towards Cognitive-Driven Defense Against Jailbreak Attacks via Meta-Operations ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Rui Pu, Chaozhuo Li, Rui Ha, et al.2026 · 1 citation
- BitBypass: A New Direction in Jailbreaking Aligned Large Language Models with Bitstream CamouflageFindings of the Association for Computational LinguisticsKalyan Nakka, Nitesh Saxena2026 · 1 citation
- From Attack Surfaces to Actual Operations: A Survey of Modern LLM JailbreaksFindings of the Association for Computational LinguisticsRuikang Zhou, Changsheng Sun, Mark Huasong Meng2026 · 1 citation
- LogicPoison: Logical Attacks on Graph Retrieval-Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Yilin Xiao, Jin Chen, Qinggang Zhang, et al.2026 · 1 citation
- PARASITE: Conditional System Prompt Poisoning to Hijack LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Viet Pham, Thai Le2026 · 1 citation
- ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha MomentsAnnual Meeting of the Association for Computational Linguistics (ACL)Yuquan Wang, Mi Zhang, Yining Wang, et al.2026 · 1 citation
- A Simple and Efficient Learning-Style Prompting for LLM JailbreakingFindings of the Association for Computational LinguisticsXuan Luo, Yue Wang, Zefeng He, et al.2026
- Calibrating Inference Time Alignment with Sequence-level Risk AccumulationAnnual Meeting of the Association for Computational Linguistics (ACL)Shanwen Tan, Ziyang Dong, Wei Ju, et al.2026
- Defense Against Knowledge Poisoning Attack on GraphRAGAnnual Meeting of the Association for Computational Linguistics (ACL)Havva Alizadeh Noughabi, Fattane Zarrinkalam, Ali Dehghantanha2026
- Enhancing the Transferability of Jailbreak Attacks on Large Language Models via Exploiting Reparameterization InvarianceAnnual Meeting of the Association for Computational Linguistics (ACL)Ao Wang, Xinghao Yang, Yongshun Gong, et al.2026
- How Adversarial Environments Mislead Agentic AI?Findings of the Association for Computational LinguisticsZhonghao Zhan, Huichi Zhou, Zhenhao Li, et al.2026
- LCO: LLM-based Constraint Optimization for Safer Agentic LLMs in Real-world TasksFindings of the Association for Computational LinguisticsJiayong Wan, Jiawei Chen, Zhaoxia Yin, et al.2026
- Pattern Enhanced Multi-Turn Jailbreaking: Exploiting Structural Vulnerabilities in Large Language ModelsFindings of the Association for Computational LinguisticsRagib Amin Nihal, Rui Wen, Kazuhiro Nakadai, et al.2026
- RLShield: Dynamic Jailbreak Detection for LLMs via Reinforced Adaptive LearningFindings of the Association for Computational LinguisticsZhao Tong, Pengfei Yang, Yimeng Gu, et al.2026
- SafetyMem: Adaptive Jailbreak Defense via Dual-Component Safety MemoryAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Wang, Ziyi Ni, Huacan Wang, et al.2026
- SHARP: Self-adaptive Harmful Category-aware Prompt Generation for Black-box JailbreakingAnnual Meeting of the Association for Computational Linguistics (ACL)Yingjie Xue, Xingyou Xia, Jun Zhang, et al.2026
- Silencing the Guardrails: Inference-Time Jailbreaking via Dynamic Contextual Representation AblationFindings of the Association for Computational LinguisticsWenpeng Xing, Moran Fang, Guangtai Wang, et al.2026
- Stop Fixating on Prompts: Reasoning Hijacking and Constraint Tightening for Red-Teaming LLM AgentsAnnual Meeting of the Association for Computational Linguistics (ACL)Yanxu Mao, Peipei Liu, Tiehan Cui, et al.2026
- StructBreak: Structural Cognitive Overload-Induced Safety Failures in MLLMsFindings of the Association for Computational LinguisticsYang Luo, Liu Xinran, TianTian Ji, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/neel-jain/cited-by/