Who cites «Execution-Based Evaluation for Open-Domain Code Generation»
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for CodearXiv:2403.07974Naman Jain, King Han, Alex Gu, et al.2024 · 578 citations
- SWE-agent: Agent-Computer Interfaces Enable Automated Software EngineeringConference on Neural Information Processing Systems (NeurIPS)John Yang, Carlos E. Jimenez, Alexander Wettig, et al.2024 · 552 citations
- WebArena: A Realistic Web Environment for Building Autonomous AgentsarXiv:2307.13854Shuyan Zhou, Frank F. Xu, Hao Zhu, et al.2023 · 432 citations
- A Survey on Large Language Models for Code GenerationACM Transactions on Software Engineering and MethodologyJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 367 citations
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex InstructionsarXiv:2406.15877Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, et al.2024 · 176 citations
- CRUXEval: A Benchmark for Code Reasoning, Understanding and ExecutionarXiv:2401.03065Alex Gu, Baptiste Rozière, Hugh Leather, et al.2024 · 122 citations
- Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language ModelsarXiv:2501.09686Fengli Xu, Qianyue Hao, Zefang Zong, et al.2025 · 120 citations
- InterCode: Standardizing and Benchmarking Interactive Coding with Execution FeedbackConference on Neural Information Processing Systems (NeurIPS)John Yang, Akshara Prabhakar, Karthik Narasimhan, et al.2023 · 95 citations
- Multilingual Large Language Model: A Survey of Resources, Taxonomy and FrontiersarXiv:2404.04925Libo Qin, Qiguang Chen, Yuhang Zhou, et al.2024 · 75 citations
- XCodeEval: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Mohammad Abdullah Matin Khan, M Saiful Bari, Xuan Long Do, et al.2024 · 51 citations
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and RetrievalarXiv:2303.03004Mohammad Abdullah Matin Khan, M Saiful Bari, Xuan Long Do, et al.2023 · 42 citations
- L2CEval: Evaluating Language-to-Code Generation Capabilities of Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Ansong Ni, Pengcheng Yin, Yilun Zhao, et al.2024 · 27 citations
- Prompting Large Language Models to Tackle the Full Software Development Lifecycle: A Case StudyInternational Conference on Computational Linguistics (COLING)Bowen Li, Wenhan Wu, Ziwei Tang, et al.2025 · 13 citations
- EVM-QuestBench: An Execution-Grounded Benchmark for Natural-Language Transaction Code GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Pei Yang, Wanyi Chen, Ke Wang, et al.2026 · 1 citation
- From Conversation to Evaluation: Benchmarking LLMs on Development Knowledge via SimpleDevQAFindings of the Association for Computational LinguisticsJing Zhang, Lianghong Guo, Yanlin Wang, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/wang-2023-execution-based-evaluation-open-domain/cited-by/