🔗 Who cites «A Systematic Evaluation of Large Language Models of Code»

108 papers of our library cite it (of the 149,439 whose bibliographies we read) · 30 with a page here, the most cited first · ← back to «A Systematic Evaluation of Large Language Models of Code»

1. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
2. The Rise and Potential of Large Language Model Based Agents: A SurveyScience China Information SciencesZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,272 citations
3. Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code GenerationConference on Neural Information Processing Systems (NeurIPS)Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, et al.2023 · 648 citations
4. A Categorical Archive of ChatGPT FailuresarXiv:2302.03494Ali Borji2023 · 559 citations
5. Gorilla: Large Language Model Connected with Massive APIsConference on Neural Information Processing Systems (NeurIPS)Shishir G. Patil, Tianjun Zhang, Xin Wang, et al.2023 · 546 citations
6. CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-XACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)Qinkai Zheng, Xiao Xia, Xu Zou, et al.2023 · 465 citations
7. The AI Scientist: Towards Fully Automated Open-Ended Scientific DiscoveryarXiv:2408.06292Chris Lu, Cong Lu, Robert Tjarko Lange, et al.2024 · 372 citations
8. A Survey on Large Language Models for Code GenerationACM Transactions on Software Engineering and MethodologyJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 367 citations
9. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
10. The Effect of Sampling Temperature on Problem Solving in Large Language ModelsFindings of the Association for Computational LinguisticsMatthew Renze2024 · 263 citations
11. Language Models of Code are Few-Shot Commonsense LearnersConference on Empirical Methods in Natural Language Processing (EMNLP)Aman Madaan, Shuyan Zhou, Uri Alon, et al.2022 · 212 citations
12. Evaluating Large Language Models: A Comprehensive SurveyarXiv:2310.19736Zishan Guo, Renren Jin, Chuang Liu, et al.2023 · 182 citations
13. SantaCoder: don't reach for the stars!arXiv:2301.03988Loubna Ben Allal, Raymond Li, Denis Kocetkov, et al.2023 · 167 citations
14. Reasoning with Language Model Prompting: A SurveyarXiv:2212.09597Shuofei Qiao, Yixin Ou, Ningyu Zhang, et al.2022 · 161 citations
15. Emergent and Predictable Memorization in Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Stella Biderman, USVSN Sai Prashanth, Lintang Sutawika, et al.2023 · 123 citations
16. CRUXEval: A Benchmark for Code Reasoning, Understanding and ExecutionarXiv:2401.03065Alex Gu, Baptiste Rozière, Hugh Leather, et al.2024 · 122 citations
17. RepoBench: Benchmarking Repository-Level Code Auto-Completion SystemsarXiv:2306.03091Tianyang Liu, Canwen Xu, Julian McAuley2023 · 122 citations
18. Self-Edit: Fault-Aware Code Editor for Code GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Kechi Zhang, Zhuo Li, Jia Li, et al.2023 · 105 citations
19. MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code GenerationarXiv:2208.08227Federico Cassano, John Gouwar, Daniel Nguyen, et al.2022 · 88 citations
20. Large Language Models Are Not Strong Abstract ReasonersarXiv:2305.19555Gael Gendron, Qiming Bao, Michael Witbrock, et al.2023 · 61 citations
21. Parsel: Algorithmic Reasoning with Language Models by Composing DecompositionsConference on Neural Information Processing Systems (NeurIPS)Eric Zelikman, Qian Huang, Gabriel Poesia, et al.2023 · 56 citations
22. CoCoMIC: Code Completion by Jointly Modeling In-file and Cross-file ContextLanguage Resources and Evaluation Conference (LREC)Yangruibo Ding, Zijian Wang, Wasi Ahmad, et al.2024 · 45 citations
23. ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming LanguagesarXiv:2212.06742Yekun Chai, Shuohuan Wang, Chao Pang, et al.2022 · 32 citations
24. AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZInternational Conference on Learning Representations (ICLR)Jonas Belouadi, Anne Lauscher, Steffen Eger2023 · 31 citations
25. PaSa: An LLM Agent for Comprehensive Academic Paper SearchAnnual Meeting of the Association for Computational Linguistics (ACL)Yichen He, Guanhua Huang, Peiyuan Feng, et al.2025 · 29 citations
26. Code to Think, Think to Code: A Survey on Code-Enhanced Reasoning and Reasoning-Driven Code Intelligence in LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Dayu Yang, Tianyang Liu, Daoan Zhang, et al.2025 · 19 citations
27. NaturalCodeBench: Examining Coding Performance Mismatch on HumanEval and Natural User QueriesFindings of the Association for Computational LinguisticsShudan Zhang, Hanlin Zhao, Xiao Liu, et al.2024 · 17 citations
28. M2RC-EVAL: Massively Multilingual Repository-level Code Completion EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Jiaheng Liu, Ken Deng, Congnan Liu, et al.2025 · 8 citations
29. Deep Learning Based Code Generation Methods: Literature Review (基于深度学习的代码生成方法研究进展)Journal of SoftwareZezhou Yang (杨泽洲), Sirong Chen (陈思榕), Cuiyun Gao (高翠芸), et al.2023 · 1 citation
30. STCOR: A Trilevel Syllogism-Driven Reasoning FrameworkWorkshop on Argument MiningKeying Yang, Hao Wang, Chengtao Jian, et al.2026

78 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/xu-2022-systematic-evaluation-large-language-models/cited-by/