Who cites John J. Nay
- A Survey on Evaluation of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyYupeng Chang, Xu Wang, Jindong Wang, et al.2023 · 3,648 citations
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- How Does NLP Benefit Legal System: A Summary of Legal Artificial IntelligenceAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxi Zhong, Chaojun Xiao, Cunchao Tu, et al.2020 · 518 citations
- Large Legal Fictions: Profiling Legal Hallucinations in Large Language ModelsarXiv:2401.01301 · Journal of Legal Analysis 16, no. 1 (2024): 64-93Matthew Dahl, Varun Magesh, Mirac Suzgun, et al.2024 · 437 citations
- LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language ModelsarXiv:2308.11462Neel Guha; Julian Nyarko; Daniel E. Ho; Christopher Re; Adam Chilton; Aditya Narayana; Alex Chohlas-Wood; Austin Peters; Brandon Waldon; Daniel N. Rockmore; Diego Zambrano; Dmitry Talisman; Enam Hoque; Faiz Surani; Frank Fagan; Galit Sarfaty; Gregory M. Dickinson; Haggai Porat; Jason Hegland; Jessica Wu; Joe Nudell; Joel Niklaus; John Nay; Jonathan H. Choi; Kevin Tobia; Margaret Hagan; Megan Ma; Michael Livermore; Nikon Rasumov-Rahe; Nils Holzenberger; Noam Kolt; Peter Henderson; Sean Rehaag; Sharad Goel; Shang Gao; Spencer Williams; Sunny Gandhi; Tom Zur; Varun Iyer;, Zehua Li2023 · 389 citations
- Large Language Models for Mathematical Reasoning: Progresses and ChallengesConference of the European Chapter of the Association for Computational Linguistics (EACL)Janice Ahn, Rishu Verma, Renze Lou, et al.2024 · 280 citations
- TrustLLM: Trustworthiness in Large Language ModelsarXiv:2401.05561Yue Huang, Lichao Sun, Haoran Wang, et al.2024 · 237 citations
- LawBench: Benchmarking Legal Knowledge of Large Language ModelsarXiv:2309.16289Zhiwei Fei, Xiaoyu Shen, Dawei Zhu, et al.2023 · 188 citations
- Detecting Language Model Attacks with PerplexityarXiv:2308.14132Gabriel Alon, Michael Kamfonas2023 · 141 citations
- Platypus: Quick, Cheap, and Powerful Refinement of LLMsarXiv:2308.07317Ariel N. Lee, Cole J. Hunter, Nataniel Ruiz2023 · 117 citations
- Prompt Cache: Modular Attention Reuse for Low-Latency InferenceMLSys 2024In Gim, Guojun Chen, Seung-seob Lee, et al.2023 · 109 citations
- GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem SolversAnnual Meeting of the Association for Computational Linguistics (ACL)Qintong Li, Leyang Cui, Xueliang Zhao, et al.2024 · 108 citations
- Nemotron-4 340B Technical ReportarXiv:2406.11704Nvidia: Bo Adler, Niket Agarwal, Ashwath Aithal, et al.2024 · 107 citations
- FrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AIarXiv:2411.04872Elliot Glazer, Ege Erdil, Tamay Besiroglu, et al.2024 · 97 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- PaperBench: Evaluating AI's Ability to Replicate AI ResearcharXiv:2504.01848Giulio Starace, Oliver Jaffe, Dane Sherburn, et al.2025 · 86 citations
- Evaluating Mathematical Reasoning Beyond AccuracyProceedings of the AAAI Conference on Artificial IntelligenceShijie Xia, Xuefeng Li, Yixin Liu, et al.2024 · 85 citations
- HelpSteer2: Open-source dataset for training top-performing reward modelsarXiv:2406.08673Zhilin Wang, Yi Dong, Olivier Delalleau, et al.2024 · 82 citations
- LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Haitao Li, You Chen, Qingyao Ai, et al.2024 · 77 citations
- KMMLU: Measuring Massive Multitask Language Understanding in KoreanConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guijin Son, Hanwool Lee, Sungdong Kim, et al.2025 · 76 citations
- Teaching Large Language Models to Reason with Reinforcement LearningarXiv:2403.04642Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, et al.2024 · 61 citations
- Dialect prejudice predicts AI decisions about people's character, employability, and criminalityarXiv:2403.00742Valentin Hofmann, Pratyusha Ria Kalluri, Dan Jurafsky, et al.2024 · 57 citations
- CMB: A Comprehensive Medical Benchmark in ChinesearXiv:2308.08833Xidong Wang, Guiming Hardy Chen, Dingjie Song, et al.2023 · 54 citations
- GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local RefinementsarXiv:2402.10963Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, et al.2024 · 45 citations
- ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Faris Hijazi, Somayah AlHarbi, Abdulaziz AlHussein, et al.2024 · 28 citations
- GameBench: Evaluating Strategic Reasoning Abilities of LLM AgentsarXiv:2406.06613Anthony Costarelli, Mat Allen, Roman Hauksson, et al.2024 · 20 citations
- RCBSF: A Multi-Agent Framework for Automated Contract Revision via Stackelberg GameFindings of the Association for Computational LinguisticsShijia Xu, Yu Wang, Xiaolong Jia, et al.2026 · 11 citations
- Exposing the Achilles' Heel: Evaluating LLMs Ability to Handle Mistakes in Mathematical ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Joykirat Singh, Akshay Nambi, Vibhav Vineet2025 · 8 citations
- Cutting Through the Noise: Boosting LLM Performance on Math Word ProblemsUjjwala Anantheswaran, Himanshu Gupta, Kevin Scaria, et al.2024 · 7 citations
- The Validation Gap: A Mechanistic Analysis of How Language Models Compute Arithmetic but Fail to Validate ItConference on Empirical Methods in Natural Language Processing (EMNLP)Leonardo Bertolazzi, Philipp Mondorf, Barbara Plank, et al.2025 · 6 citations
- From Benchmarks to Skills: Low-Rank Factors for LLM EvaluationTransactions of the Association for Computational Linguistics (TACL)Aviya Maimon, Amir David Nisan Cohen, Gal Vishne, et al.2026
- PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language ModelsFindings of the Association for Computational LinguisticsZetian Ouyang, Linlin Wang, Gerard de Melo, et al.2026
- R ESEARCH QA: Evaluating Scholarly Question Answering at Scale Across 75 Fields with Survey-Mined Questions and RubricsTransactions of the Association for Computational Linguistics (TACL)Li S. Yifei, Allen Chang, Chaitanya Malaviya, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/john-j-nay/cited-by/