Who cites Zico Kolter
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
- The Rise and Potential of Large Language Model Based Agents: A SurveyScience China Information SciencesZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,272 citations
- A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the UglyarXiv:2312.02003Yifan Yao, Jinhao Duan, Kaidi Xu, et al.2023 · 1,186 citations
- Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsComputational LinguisticsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 977 citations
- Explainability for Large Language Models: A SurveyACM Transactions on Intelligent Systems and TechnologyHaiyan Zhao, Hanjie Chen, Fan Yang, et al.2023 · 790 citations
- Integrating Multimodal Information in Large Pretrained TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.2020 · 746 citations
- Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP)Wei Han, Hui Chen, Soujanya Poria2021 · 564 citations
- Jailbreaking Black Box Large Language Models in Twenty QueriesarXiv:2310.08419Patrick Chao, Alexander Robey, Edgar Dobriban, et al.2023 · 553 citations
- RL²: Fast Reinforcement Learning via Slow Reinforcement LearningarXiv:1611.02779Yan Duan, John Schulman, Xi Chen, et al.2016 · 524 citations
- Phi-4 Technical ReportarXiv:2412.08905Marah Abdin, Jyoti Aneja, Harkirat Behl, et al.2024 · 502 citations
- CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of ModalityAnnual Meeting of the Association for Computational Linguistics (ACL)Wenmeng Yu, Hua Xu, Fanyang Meng, et al.2020 · 494 citations
- Experience Grounds LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Yonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 439 citations
- Security and Privacy Challenges of Large Language Models: A SurveyACM Computing SurveysBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 424 citations
- Hindsight Experience ReplayarXiv:1707.01495Marcin Andrychowicz, Filip Wolski, Alex Ray, et al.2017 · 421 citations
- Large Language Models Cannot Self-Correct Reasoning YetarXiv:2310.01798Jie Huang, Xinyun Chen, Swaroop Mishra, et al.2023 · 412 citations
- FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
- Representation Engineering: A Top-Down Approach to AI TransparencyarXiv:2310.01405Andy Zou, Long Phan, Sarah Chen, et al.2023 · 397 citations
- Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!arXiv:2310.03693Xiangyu Qi, Yi Zeng, Tinghao Xie, et al.2023 · 355 citations
- AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language ModelsarXiv:2310.04451Xiaogeng Liu, Nan Xu, Muhao Chen, et al.2023 · 350 citations
- Improving Multimodal Named Entity Recognition via Entity Span Detection with Unified Multimodal TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Jianfei Yu, Jing Jiang, Li Yang, et al.2020 · 342 citations
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust RefusalarXiv:2402.04249Mantas Mazeika, Long Phan, Xuwang Yin, et al.2024 · 330 citations
- Incentivizing Exploration In Reinforcement Learning With Deep Predictive ModelsarXiv:1507.00814Bradly C. Stadie, Sergey Levine, Pieter Abbeel2015 · 313 citations
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Patrick Chao, Edoardo Debenedetti, Alexander Robey, et al.2024 · 277 citations
- Scaling Laws for Autoregressive Generative ModelingarXiv:2010.14701Tom Henighan, Jared Kaplan, Mor Katz, et al.2020 · 277 citations
- Hallucination-Free? Assessing the Reliability of Leading AI Legal Research ToolsarXiv:2405.20362Varun Magesh, Faiz Surani, Matthew Dahl, et al.2024 · 271 citations
- Large Language Models Sensitivity to The Order of Options in Multiple-Choice QuestionsFindings of the Association for Computational LinguisticsPouya Pezeshkpour, Estevam Hruschka2023 · 261 citations
- Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelarXiv:2402.07827Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 253 citations
- XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language ModelsarXiv:2308.01263Paul Rottger, Hannah Rose Kirk, Bertie Vidgen, et al.2023 · 244 citations
- LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation DatasetarXiv:2309.11998Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, et al.2023 · 242 citations
- Visual Adversarial Examples Jailbreak Aligned Large Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceXiangyu Qi, Kaixuan Huang, Ashwinee Panda, et al.2023 · 240 citations
- TrustLLM: Trustworthiness in Large Language ModelsarXiv:2401.05561Yue Huang, Lichao Sun, Haoran Wang, et al.2024 · 237 citations
- Baseline Defenses for Adversarial Attacks Against Aligned Language ModelsarXiv:2309.00614Neel Jain, Avi Schwarzschild, Yuxin Wen, et al.2023 · 236 citations
- Steering Language Models With Activation EngineeringarXiv:2308.10248Alexander Matt Turner, Lisa Thiergart, Gavin Leech, et al.2023 · 233 citations
- Combating Misinformation in the Age of LLMs: Opportunities and ChallengesAI MagazineCanyu Chen, Kai Shu2023 · 214 citations
- Scalable Extraction of Training Data from (Production) Language ModelsarXiv:2311.17035Milad Nasr, Nicholas Carlini, Jonathan Hayase, et al.2023 · 211 citations
- How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Zeng, Hongpeng Lin, Jingwen Zhang, et al.2024 · 202 citations
- Refusal in Language Models Is Mediated by a Single DirectionarXiv:2406.11717Andy Arditi, Oscar Obeso, Aaquib Syed, et al.2024 · 196 citations
- LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation MethodsarXiv:2412.05579Haitao Li, Qian Dong, Junjie Chen, et al.2024 · 195 citations
- InjecAgent: Benchmarking Indirect Prompt Injections in Tool-Integrated Large Language Model AgentsFindings of the Association for Computational LinguisticsQiusi Zhan, Zhixiang Liang, Zifan Ying, et al.2024 · 193 citations
- Multilingual Jailbreak Challenges in Large Language ModelsarXiv:2310.06474Yue Deng, Wenxuan Zhang, Sinno Jialin Pan, et al.2023 · 192 citations
- Low-Resource Languages Jailbreak GPT-4arXiv:2310.02446Zheng-Xin Yong, Cristina Menghini, Stephen H. Bach2023 · 183 citations
- AI Alignment: A Comprehensive SurveyarXiv:2310.19852Jiaming Ji, Tianyi Qiu, Boyuan Chen, et al.2023 · 173 citations
- Catastrophic Jailbreak of Open-source LLMs via Exploiting GenerationarXiv:2310.06987Yangsibo Huang, Samyak Gupta, Mengzhou Xia, et al.2023 · 169 citations
- GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak PromptsarXiv:2309.10253Jiahao Yu, Xingwei Lin, Zheng Yu, et al.2023 · 169 citations
- The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False DatasetsarXiv:2310.06824Samuel Marks, Max Tegmark2023 · 169 citations
- GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via CipherarXiv:2308.06463Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, et al.2023 · 168 citations
- WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMsConference on Neural Information Processing Systems (NeurIPS)Seungju Han, Kavel Rao, Allyson Ettinger, et al.2024 · 165 citations
- The Linear Representation Hypothesis and the Geometry of Large Language ModelsInternational Conference on Machine Learning (ICML)Kiho Park, Yo Joong Choe, Victor Veitch2023 · 165 citations
- SmoothLLM: Defending Large Language Models Against Jailbreaking AttacksarXiv:2310.03684Alexander Robey, Eric Wong, Hamed Hassani, et al.2023 · 164 citations
- A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information FunnelingarXiv:2406.02069Zefan Cai, Yichi Zhang, Bofei Gao, et al.2024 · 155 citations
- TOFU: A Task of Fictitious Unlearning for LLMsarXiv:2401.06121Pratyush Maini, Zhili Feng, Avi Schwarzschild, et al.2024 · 144 citations
- DeepInception: Hypnotize Large Language Model to Be JailbreakerarXiv:2311.03191Xuan Li, Zhanke Zhou, Jianing Zhu, et al.2023 · 141 citations
- Detecting Language Model Attacks with PerplexityarXiv:2308.14132Gabriel Alon, Michael Kamfonas2023 · 141 citations
- Do LLMs Exhibit Human-like Response Biases? A Case Study in Survey DesignTransactions of the Association for Computational Linguistics (TACL)Lindia Tjuatja, Valerie Chen, Tongshuang Wu, et al.2024 · 140 citations
- Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow InstructionsarXiv:2309.07875Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, et al.2023 · 135 citations
- Jailbreak and Guard Aligned Language Models with Only Few In-Context DemonstrationsarXiv:2310.06387Zeming Wei, Yifei Wang, Ang Li, et al.2023 · 130 citations
- SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Zhangchen Xu, Fengqing Jiang, Luyao Niu, et al.2024 · 127 citations
- The WMDP Benchmark: Measuring and Reducing Malicious Use With UnlearningarXiv:2403.03218Nathaniel Li, Alexander Pan, Anjali Gopal, et al.2024 · 127 citations
- Function Vectors in Large Language ModelsarXiv:2310.15213Eric Todd, Millicent L. Li, Arnab Sen Sharma, et al.2023 · 127 citations
- Negative Preference Optimization: From Catastrophic Collapse to Effective UnlearningarXiv:2404.05868Ruiqi Zhang, Licong Lin, Yu Bai, et al.2024 · 126 citations
- Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
- Best Practices and Lessons Learned on Synthetic DataarXiv:2404.07503Ruibo Liu, Jerry Wei, Fangyu Liu, et al.2024 · 119 citations
- SALAD-Bench: A Hierarchical and Comprehensive Safety Benchmark for Large Language ModelsFindings of the Association for Computational LinguisticsLijun Li, Bowen Dong, Ruohui Wang, et al.2024 · 119 citations
- LLM Self Defense: By Self Examination, LLMs Know They Are Being TrickedarXiv:2308.07308Mansi Phute, Alec Helbling, Matthew Hull, et al.2023 · 119 citations
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive AttacksarXiv:2404.02151Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion2024 · 118 citations
- Deliberative Alignment: Reasoning Enables Safer Language ModelsSuperIntelligence - Robotics - Safety & AlignmentMelody Y. Guan, Manas Joglekar, Eric Wallace, et al.2024 · 115 citations
- Fundamental Limitations of Alignment in Large Language ModelsarXiv:2304.11082Yotam Wolf, Noam Wies, Oshri Avnery, et al.2023 · 114 citations
- Defending Large Language Models Against Jailbreaking Attacks Through Goal PrioritizationAnnual Meeting of the Association for Computational Linguistics (ACL)Zhexin Zhang, Junxiao Yang, Pei Ke, et al.2024 · 113 citations
- Certifying LLM Safety against Adversarial PromptingarXiv:2309.02705Aounon Kumar, Chirag Agarwal, Suraj Srinivas, et al.2023 · 113 citations
- Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMAnnual Meeting of the Association for Computational Linguistics (ACL)Bochuan Cao, Yuanpu Cao, Lu Lin, et al.2024 · 109 citations
- Mechanistic Interpretability for AI Safety — A ReviewarXiv:2404.14082Leonard Bereska, Efstratios Gavves2024 · 108 citations
- Can LLM-Generated Misinformation Be Detected?arXiv:2309.13788Canyu Chen, Kai Shu2023 · 108 citations
- Red-Teaming Large Language Models using Chain of Utterances for Safety-AlignmentarXiv:2308.09662Rishabh Bhardwaj, Soujanya Poria2023 · 108 citations
- R-Judge: Benchmarking Safety Risk Awareness for LLM AgentsFindings of the Association for Computational LinguisticsTongxin Yuan, Zhiwei He, Lingzhong Dong, et al.2024 · 106 citations
- Shadow Alignment: The Ease of Subverting Safely-Aligned Language ModelsarXiv:2310.02949Xianjun Yang, Xiao Wang, Qi Zhang, et al.2023 · 103 citations
- LoRA+: Efficient Low Rank Adaptation of Large ModelsarXiv:2402.12354Soufiane Hayou, Nikhil Ghosh, Bin Yu2024 · 97 citations
- Safety Alignment Should Be Made More Than Just a Few Tokens DeeparXiv:2406.05946Xiangyu Qi, Ashwinee Panda, Kaifeng Lyu, et al.2024 · 97 citations
- Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource LanguagesProceedings of the AAAI Conference on Artificial IntelligenceZihao Li, Yucheng Shi, Zirui Liu, et al.2024 · 95 citations
- WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
- Alignment for HonestyConference on Neural Information Processing Systems (NeurIPS)Yuqing Yang, Ethan Chern, Xipeng Qiu, et al.2023 · 90 citations
- AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
- In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space SteeringarXiv:2311.06668Sheng Liu, Haotian Ye, Lei Xing, et al.2023 · 89 citations
- The Language Barrier: Dissecting Safety Challenges of LLMs in Multilingual ContextsFindings of the Association for Computational LinguisticsLingfeng Shen, Weiting Tan, Sihao Chen, et al.2024 · 88 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Rethinking Interpretability in the Era of Large Language ModelsarXiv:2402.01761Chandan Singh, Jeevana Priya Inala, Michel Galley, et al.2024 · 87 citations
- SORRY-Bench: Systematically Evaluating Large Language Model Safety RefusalarXiv:2406.14598Tinghao Xie, Xiangyu Qi, Yi Zeng, et al.2024 · 87 citations
- Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM AssessmentConference on Empirical Methods in Natural Language Processing (EMNLP)Vyas Raina, Adian Liusie, Mark Gales2024 · 86 citations
- Machine Unlearning of Pre-trained Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jin Yao, Eli Chien, Minxin Du, et al.2024 · 86 citations
- On Prompt-Driven Safeguarding for Large Language ModelsarXiv:2401.18018Chujie Zheng, Fan Yin, Hao Zhou, et al.2024 · 85 citations
- A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models EasilyarXiv:2311.08268Peng Ding, Jun Kuang, Dan Ma, et al.2023 · 85 citations
- Detoxifying Large Language Models via Knowledge EditingAnnual Meeting of the Association for Computational Linguistics (ACL)Mengru Wang, Ningyu Zhang, Ziwen Xu, et al.2024 · 84 citations
- PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human PreferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Jiaming Ji, Donghai Hong, Borong Zhang, et al.2025 · 83 citations
- ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMsarXiv:2402.11753Fengqing Jiang, Zhangchen Xu, Luyao Niu, et al.2024 · 83 citations
- Improving Alignment and Robustness with Circuit BreakersConference on Neural Information Processing Systems (NeurIPS)Andy Zou, Long Phan, Justin Wang, et al.2024 · 83 citations
- The Instruction Hierarchy: Training LLMs to Prioritize Privileged InstructionsarXiv:2404.13208Eric Wallace, Kai Xiao, Reimar Leike, et al.2024 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- MART: Improving LLM Safety with Multi-round Automatic Red-TeamingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Suyu Ge, Chunting Zhou, Rui Hou, et al.2024 · 82 citations
- Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language ModelsarXiv:2307.14539Erfan Shayegani, Yue Dong, Nael Abu-Ghazaleh2023 · 81 citations
- MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zico-kolter/cited-by/