🧑‍🔬 Who cites Sayash Kapoor

291 citations of their works from 222 papers of our library (of the 149,439 whose bibliographies we read) · 66 with a page here, the most cited first · ← Sayash Kapoor

1. JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Patrick Chao, Edoardo Debenedetti, Alexander Robey, et al.2024 · 277 citations
2. Hallucination-Free? Assessing the Reliability of Leading AI Legal Research ToolsarXiv:2405.20362Varun Magesh, Faiz Surani, Matthew Dahl, et al.2024 · 271 citations
3. RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
4. TrustLLM: Trustworthiness in Large Language ModelsarXiv:2401.05561Yue Huang, Lichao Sun, Haoran Wang, et al.2024 · 237 citations
5. Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language ModelsScience China Information SciencesQiguang Chen, Libo Qin, Jinhao Liu, et al.2025 · 176 citations
6. SmoothLLM: Defending Large Language Models Against Jailbreaking AttacksarXiv:2310.03684Alexander Robey, Eric Wong, Hamed Hassani, et al.2023 · 164 citations
7. MLE-bench: Evaluating Machine Learning Agents on Machine Learning EngineeringarXiv:2410.07095Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, et al.2024 · 140 citations
8. A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
9. WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
10. Why Do Multi-Agent LLM Systems Fail?arXiv:2503.13657Mert Cemri, Melissa Z. Pan, Shuyi Yang, et al.2025 · 89 citations
11. Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
12. PaperBench: Evaluating AI's Ability to Replicate AI ResearcharXiv:2504.01848Giulio Starace, Oliver Jaffe, Dane Sherburn, et al.2025 · 86 citations
13. More Agents Is All You NeedarXiv:2402.05120Junyou Li, Qin Zhang, Yangbin Yu, et al.2024 · 85 citations
14. ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific DiscoveryarXiv:2410.05080Ziru Chen, Shijie Chen, Yuting Ning, et al.2024 · 81 citations
15. BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextarXiv:2403.18421Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, et al.2024 · 79 citations
16. Benchmarking Benchmark Leakage in Large Language ModelsarXiv:2404.18824Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.2024 · 73 citations
17. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
18. Unintended Impacts of LLM Alignment on Global RepresentationAnnual Meeting of the Association for Computational Linguistics (ACL)Michael J Ryan, William Held, Diyi Yang2024 · 57 citations
19. Magentic-One: A Generalist Multi-Agent System for Solving Complex TasksarXiv:2411.04468Adam Fourney, Gagan Bansal, Hussein Mozannar, et al.2024 · 54 citations
20. RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement LearningarXiv:2410.02089Jonas Gehring, Kunhao Zheng, Jade Copet, et al.2024 · 51 citations
21. MLGym: A New Framework and Benchmark for Advancing AI Research AgentsarXiv:2502.14499Deepak Nathani, Lovish Madaan, Nicholas Roberts, et al.2025 · 50 citations
22. ClimateGPT: Towards AI Synthesizing Interdisciplinary Research on Climate ChangearXiv:2401.09646David Thulke, Yingbo Gao, Petrus Pelser, et al.2024 · 45 citations
23. A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic SystemsarXiv:2504.09037Zixuan Ke, Fangkai Jiao, Yifei Ming, et al.2025 · 39 citations
24. LLM4SR: A Survey on Large Language Models for Scientific ResearcharXiv:2501.04306Ziming Luo, Zonglin Yang, Zexin Xu, et al.2025 · 39 citations
25. CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent BenchmarkarXiv:2409.11363Zachary S. Siegel, Sayash Kapoor, Nitya Nadgir, et al.2024 · 39 citations
26. Introducing v0.5 of the AI Safety Benchmark from MLCommonsarXiv:2404.12241Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, et al.2024 · 38 citations
27. Scaling of Search and Learning: A Roadmap to Reproduce o1 from Reinforcement Learning PerspectivearXiv:2412.14135Zhiyuan Zeng, Qinyuan Cheng, Zhangyue Yin, et al.2024 · 33 citations
28. Jamba-1.5: Hybrid Transformer-Mamba Models at ScalearXiv:2408.12570Jamba Team: Barak Lenz, Alan Arazi, Amir Bergman, et al.2024 · 30 citations
29. The State of Multilingual LLM Safety Research: From Measuring The Language Gap To Mitigating ItConference on Empirical Methods in Natural Language Processing (EMNLP)Zheng Xin Yong, Beyza Ermis, Marzieh Fadaee, et al.2025 · 25 citations
30. Towards Scientific Intelligence: A Survey of LLM-based Scientific AgentsarXiv:2503.24047Shuo Ren, Can Xie, Pu Jian, et al.2025 · 24 citations
31. SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research PapersarXiv:2504.00255Yanzheng Xiang, Hanqi Yan, Shuyin Ouyang, et al.2025 · 23 citations
32. The Leaderboard IllusionConference on Neural Information Processing Systems (NeurIPS)Shivalika Singh, Yiyang Nan, Alex Wang, et al.2025 · 22 citations
33. A Survey on Evaluation of LLM-based AgentsFindings of the Association for Computational LinguisticsAsaf Yehudai, Lilach Eden, Alan Li, et al.2026 · 21 citations
34. The Limits of Inference Scaling Through ResamplingarXiv:2411.17501Benedikt Stroebl, Sayash Kapoor, Arvind Narayanan2024 · 21 citations
35. AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research SuitearXiv:2510.21652Jonathan Bragg, Mike D'Arcy, Nishant Balepur, et al.2025 · 19 citations
36. ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research CodeConference on Neural Information Processing Systems (NeurIPS)Tianyu Hua; Harper Hua; Violet Xiang; Benjamin Klieger; Sang T. Truong; Weixin Liang; Fan-Yun Sun;, Nick Haber2025 · 16 citations
37. MLRC-Bench: Can Language Agents Solve Machine Learning Research Challenges?Conference on Neural Information Processing Systems (NeurIPS)Yunxiang Zhang, Muhammad Khalifa, Shitanshu Bhushan, et al.2025 · 13 citations
38. When AI Co-Scientists Fail: SPOT-a Benchmark for Automated Verification of Scientific ResearcharXiv:2505.11855Guijin Son, Jiwoo Hong, Honglu Fan, et al.2025 · 13 citations
39. AI Scientists Fail Without Strong Implementation CapabilityarXiv:2506.01372Minjun Zhu, Qiujie Xie, Yixuan Weng, et al.2025 · 12 citations
40. AutoReproduce: Automatic AI Experiment Reproduction with Paper LineageAnnual Meeting of the Association for Computational Linguistics (ACL)Xuanle Zhao, Zilin Sang, Yuxuan Li, et al.2025 · 12 citations
41. TRAIL: Trace Reasoning and Agentic Issue LocalizationarXiv:2505.08638Darshan Deshpande, Varun Gangal, Hersh Mehta, et al.2025 · 12 citations
42. Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent EvaluationarXiv:2510.11977Sayash Kapoor, Benedikt Stroebl, Peter Kirgis, et al.2025 · 11 citations
43. SciArena: An Open Evaluation Platform for Non-Verifiable Scientific Literature-Grounded TasksConference on Neural Information Processing Systems (NeurIPS)Yilun Zhao, Kaiyan Zhang, Tiansheng Hu, et al.2025 · 11 citations
44. Examining False Positives under Inference Scaling for Mathematical ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Yu Wang, Nan Yang, Liang Wang, et al.2025 · 9 citations
45. SafeScientist: Toward Risk-Aware Scientific Discoveries by LLM AgentsarXiv:2505.23559Kunlun Zhu, Jiaxun Zhang, Ziheng Qi, et al.2025 · 8 citations
46. Localized Cultural Knowledge is Conserved and Controllable in Large Language ModelsFindings of the Association for Computational LinguisticsVeniamin Veselovsky, Berke Argın, Benedikt Stroebl, et al.2026 · 7 citations
47. Scaling Collaborative Effort with AgentsFindings of the Association for Computational LinguisticsShannon Zejiang Shen, Valerie Chen, Ken Gu, et al.2026 · 7 citations
48. When Life Gives You Samples: The Benefits of Scaling up Inference Compute for Multilingual LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Ammar Khairi, Daniel D'souza, Ye Shen, et al.2025 · 6 citations
49. A Study of LLMs' Preferences for Libraries and Programming LanguagesFindings of the Association for Computational LinguisticsLukas Twist, Mark Harman, Don Syme, et al.2026 · 5 citations
50. How Far Are We From True Auto-Research?arXiv:2605.19156Zhengxin Zhang, Ning Wang, Sainyam Galhotra, et al.2026 · 5 citations
51. Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic EvaluationsAnnual Meeting of the Association for Computational Linguistics (ACL)Preethi Seshadri, Samuel Cahyawijaya, Ayomide Odumakinde, et al.2026 · 5 citations
52. HiddenGuard: Fine-Grained Safe Generation with Specialized Representation RouterAnnual Meeting of the Association for Computational Linguistics (ACL)Lingrui Mei, Shenghua Liu, Yiwei Wang, et al.2026 · 4 citations
53. Uncertainty Quantification in LLM Agents: Foundations, Emerging Challenges, and OpportunitiesAnnual Meeting of the Association for Computational Linguistics (ACL)Changdae Oh, Seongheon Park, To Eun Kim, et al.2026 · 4 citations
54. Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM ReasoningarXiv:2504.05047Sugyeong Eo, Hyeonseok Moon, Evelyn Hayoon Zi, et al.2025 · 4 citations
55. The Automated LLM Speedrunning Benchmark: Reproducing NanoGPT ImprovementsConference on Neural Information Processing Systems (NeurIPS)Bingchen Zhao, Despoina Magka, Minqi Jiang, et al.2025 · 4 citations
56. Position: LLM Watermarking Should Align Stakeholders' Incentives for Practical AdoptionFindings of the Association for Computational LinguisticsYepeng Liu, Xuandong Zhao, Dawn Song, et al.2026 · 2 citations
57. Training AI Scientists to Replicate ResearcharXiv:2608.13331Damon Falck, Samer Sabri, Anja Surina, et al.2026 · 2 citations
58. In-Distribution Steering: Balancing Control and Coherence in Language Model GenerationLanguage Resources and Evaluation Conference (LREC)Arthur Vogels, Benjamin Wong, Yann Choho, et al.2026 · 1 citation
59. MÖVE: A Holistic LLM Benchmark for the German Public SectorarXiv:2606.13111Camilla Dalerci, Thilo Michael, Robin Schaefer, et al.2026 · 1 citation
60. Agentic CLEAR: Automating Multi-Level Evaluation of LLM AgentsAnnual Meeting of the Association for Computational Linguistics (ACL)Asaf Yehudai, Lilach Eden, Michal Shmueli-Scheuer2026
61. Efficient Agent Evaluation via Diversity-Guided User SimulationAnnual Meeting of the Association for Computational Linguistics (ACL)Itay Nakash, George Kour, Ateret Anaby Tavor2026
62. Follow the Path: Reasoning over Knowledge Graph Paths to Improve Large Language Model FactualityFindings of the Association for Computational LinguisticsMike Zhang, Johannes Bjerva, Russa Biswas2026
63. NLG Evaluation: Past, Present, FutureSymposium on Natural Language Generation EvaluationsEhud Reiter2026
64. The Past and Future of AI ScientistsarXiv:2608.14407Ross D. King2026
65. What Moves the Pareto Frontier in Tool-Using Agents? A Compute-Aware Study of ReAct VariantsAnnual Meeting of the Association for Computational Linguistics (ACL)Rishi N. Simhadri2026
66. Tracr-Injection: Distilling Algorithms into Pre-trained Language ModelsarXiv:2505.10719Tomás Vergara-Browne, Álvaro Soto2025

156 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/sayash-kapoor/cited-by/