🧑‍🔬 Who cites Juyoung Suk

307 citations of their works from 281 papers of our library (of the 149,439 whose bibliographies we read) · 71 with a page here, the most cited first · ← Juyoung Suk

1. Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language ModelsarXiv:2405.01535Seungone Kim, Juyoung Suk, Shayne Longpre, et al.2024 · 234 citations
2. LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation MethodsarXiv:2412.05579Haitao Li, Qian Dong, Junjie Chen, et al.2024 · 195 citations
3. Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language ModelsScience China Information SciencesQiguang Chen, Libo Qin, Jinhao Liu, et al.2025 · 176 citations
4. LLM-based NLG Evaluation: Current Status and ChallengesComputational LinguisticsMingqi Gao, Xinyu Hu, Xunjian Yin, et al.2025 · 153 citations
5. Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-ExpertsFindings of the Association for Computational LinguisticsHaoxiang Wang, Wei Xiong, Tengyang Xie, et al.2024 · 153 citations
6. LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation TasksarXiv:2406.18403Anna Bavaresco, Raffaella Bernardi, Leonardo Bertolazzi, et al.2024 · 141 citations
7. To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningarXiv:2409.12183Zayne Sprague, Fangcong Yin, Juan Diego Rodriguez, et al.2024 · 138 citations
8. A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
9. Arcee's MergeKit: A Toolkit for Merging Large Language ModelsarXiv:2403.13257Charles Goddard, Shamane Siriwardhana, Malikeh Ehghaghi, et al.2024 · 105 citations
10. WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the WildarXiv:2406.04770Bill Yuchen Lin, Yuntian Deng, Khyathi Chandu, et al.2024 · 105 citations
11. AudioBench: A Universal Benchmark for Audio Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Xunlong Zou, Geyu Lin, et al.2025 · 77 citations
12. OffsetBias: Leveraging Debiased Data for Tuning EvaluatorsFindings of the Association for Computational LinguisticsJunsoo Park, Seungyeon Jwa, Ren Meiying, et al.2024 · 67 citations
13. Inference-Time Scaling for Generalist Reward ModelingarXiv:2504.02495Zijun Liu, Peiyi Wang, Runxin Xu, et al.2025 · 65 citations
14. Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-JudgeConference on Empirical Methods in Natural Language Processing (EMNLP)Tianhao Wu, Weizhe Yuan, Olga Golovneva, et al.2025 · 64 citations
15. AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?Conference on Empirical Methods in Natural Language Processing (EMNLP)Ori Yoran, Samuel Joseph Amouyal, Chaitanya Malaviya, et al.2024 · 46 citations
16. Direct Judgement Preference OptimizationConference on Empirical Methods in Natural Language Processing (EMNLP)PeiFeng Wang, Austin Xu, Yilun Zhou, et al.2025 · 35 citations
17. Evaluating Language Models as Synthetic Data GeneratorsAnnual Meeting of the Association for Computational Linguistics (ACL)Seungone Kim, Juyoung Suk, Xiang Yue, et al.2025 · 32 citations
18. Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the AboveAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Rachel Rudinger, Jordan Boyd-Graber2025 · 28 citations
19. LLM-as-a-Judge & Reward Model: What They Can and Cannot DoarXiv:2409.11239Guijin Son, Hyunwoo Ko, Hoyoung Lee, et al.2024 · 27 citations
20. IberoBench: A Benchmark for LLM Evaluation in Iberian LanguagesInternational Conference on Computational Linguistics (COLING)Irene Baucells, Javier Aula-Blasco, Iria de-Dios-Flores, et al.2025 · 24 citations
21. Evaluating the Consistency of LLM EvaluatorsInternational Conference on Computational Linguistics (COLING)Noah Lee, Jiwoo Hong, James Thorne2025 · 16 citations
22. CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-JudgesAnnual Meeting of the Association for Computational Linguistics (ACL)Haitao Li, Junjie Chen, Qingyao Ai, et al.2025 · 15 citations
23. Improve LLM-as-a-Judge Ability as a General AbilityConference on Empirical Methods in Natural Language Processing (EMNLP)Jiachen Yu, Shaoning Sun, Xiaohui Hu, et al.2025 · 15 citations
24. Does Context Matter? ContextualJudgeBench for Evaluating LLM-based Judges in Contextual SettingsAnnual Meeting of the Association for Computational Linguistics (ACL)Austin Xu, Srijan Bansal, Yifei Ming, et al.2025 · 14 citations
25. OmniThink: Expanding Knowledge Boundaries in Machine Writing through ThinkingConference on Empirical Methods in Natural Language Processing (EMNLP)Zekun Xi, Wenbiao Yin, Jizhan Fang, et al.2025 · 14 citations
26. CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Hongchao Jiang, Yiming Chen, Yushi Cao, et al.2026 · 13 citations
27. Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Hengyuan Zhang, Shiping Yang, Xiao Liang, et al.2026 · 13 citations
28. Evaluating LLMs' Divergent Thinking Capabilities for Scientific Idea Generation with Minimal ContextarXiv:2412.17596Kai Ruan, Xuan Wang, Jixiang Hong, et al.2024 · 13 citations
29. From Calculation to Adjudication: Examining LLM judges on Mathematical Reasoning TasksarXiv:2409.04168Andreas Stephan, Dawei Zhu, Matthias Aßenmacher, et al.2024 · 13 citations
30. Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User PersonasAnnual Meeting of the Association for Computational Linguistics (ACL)Nishant Balepur, Vishakh Padmakumar, Fumeng Yang, et al.2025 · 12 citations
31. MORQA: Benchmarking Evaluation Metrics for Medical Open-Ended Question AnsweringLanguage Resources and Evaluation Conference (LREC)Wen-wai Yim, Asma Ben Abacha, Zixuan Yu, et al.2026 · 11 citations
32. Cross-Lingual Auto Evaluation for Assessing Multilingual LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Sumanth Doddapaneni, Mohammed Safi Ur Rahman Khan, Dilip Venkatesh, et al.2025 · 11 citations
33. Influences on LLM Calibration: A Study of Response Agreement, Loss Functions, and Prompt StylesAnnual Meeting of the Association for Computational Linguistics (ACL)Yuxi Xia, Pedro Henrique Luz De Araujo, Klim Zaporojets, et al.2025 · 11 citations
34. An Empirical Study of LLM-as-a-Judge: How Design Choices Impact Evaluation ReliabilityWorkshop on Generation, Evaluation and Metrics (GEM)Yusuke Yamauchi, Taro Yano, Masafumi Oyamada2026 · 10 citations
35. Reason Only When Needed: Efficient Generative Reward Modeling via Model-Internal UncertaintyFindings of the Association for Computational LinguisticsChao Xue, Yao Wang, Mengqiao Liu, et al.2026 · 8 citations
36. Beyond Outlining: Heterogeneous Recursive Planning for Adaptive Long-form Writing with Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ruibin Xiong, Yimeng Chen, Dmitrii Khizbullin, et al.2025 · 8 citations
37. SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific LiteratureConference of the European Chapter of the Association for Computational Linguistics (EACL)Hang Ding, Yilun Zhao, Tiansheng Hu, et al.2026 · 7 citations
38. When Life Gives You Samples: The Benefits of Scaling up Inference Compute for Multilingual LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Ammar Khairi, Daniel D'souza, Ye Shen, et al.2025 · 6 citations
39. Can LLMs Automate Fact-Checking Article Writing?Transactions of the Association for Computational Linguistics (TACL)Dhruv Sahnan, David Corney, Irene Larraz, et al.2026 · 5 citations
40. mR3: Multilingual Rubric-Agnostic Reward Reasoning ModelsarXiv:2510.01146David Anugraha, Shou-Yi Hung, Zilu Tang, et al.2025 · 5 citations
41. Multi-Session Client-Centered Treatment Outcome Evaluation in PsychotherapyLanguage Resources and Evaluation Conference (LREC)Hongbin Na, Tao Shen, Shumao Yu, et al.2026 · 4 citations
42. DARS: Dynamic Action Re-Sampling to Enhance Coding Agent Performance by Adaptive Tree TraversalAnnual Meeting of the Association for Computational Linguistics (ACL)Vaibhav Aggarwal, Ojasv Kamal, Abhinav Japesh, et al.2025 · 4 citations
43. J4R: Learning to Judge with Equivalent Initial State Group Relative Policy OptimizationAnnual Meeting of the Association for Computational Linguistics (ACL)Austin Xu, Yilun Zhou, Xuan-Phi Nguyen, et al.2026 · 3 citations
44. Korean Canonical Legal Benchmark: Toward Knowledge-Independent Evaluation of LLMs' Legal Reasoning CapabilitiesConference of the European Chapter of the Association for Computational Linguistics (EACL)Hongseok Oh, Wonseok Hwang, Kyoung-Woon On2026 · 3 citations
45. MedQA-CS: Objective Structured Clinical Examination (OSCE)-Style Benchmark for Evaluating LLM Clinical SkillsConference of the European Chapter of the Association for Computational Linguistics (EACL)Zonghai Yao, Zihao Zhang, Chaolong Tang, et al.2026 · 3 citations
46. Graders Should Cheat: Privileged Information Enables Expert-Level Automated EvaluationsConference on Empirical Methods in Natural Language Processing (EMNLP)Jin Peng Zhou, Séb Arnold, Nan Ding, et al.2025 · 3 citations
47. AITutor-EvalKit: Exploring the Capabilities of AI TutorsConference of the European Chapter of the Association for Computational Linguistics (EACL)Numaan Naeem, Kaushal Kumar Maurya, Kseniia Petukhova, et al.2026 · 2 citations
48. Benchmarking Frontier LLMs on Arabic Cultural and Sociolinguistic Knowledge: A Cross-Evaluation Framework with Human SME Ground TrutharXiv:2607.00139Sajjad Abdoli, Ghassan Al-Sumaidaee, Ahmad ElShiekh, et al.2026 · 1 citation
49. Decentralized Arena: Towards Democratic and Scalable Automatic Evaluation of Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yanbin Yin, Kun Zhou, Zhen Wang, et al.2026 · 1 citation
50. DRAGON: Domain-specific Robust Automatic Data Generation for RAG OptimizationFindings of the Association for Computational LinguisticsHaiyang Shen, Hang Yan, Zhongshi Xing, et al.2026 · 1 citation
51. IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Bosi Wen, Yilin Niu, Cunxiang Wang, et al.2026 · 1 citation
52. InferenceDynamics: Adaptive LLM Routing through Structured Capability and Knowledge ProfilingAnnual Meeting of the Association for Computational Linguistics (ACL)Haochen Shi, Tianshi Zheng, Weiqi Wang, et al.2026 · 1 citation
53. RECAP: REwriting Conversations for Intent Understanding in Agentic PlanningFindings of the Association for Computational LinguisticsKushan Mitra, Dan Zhang, Hannah Kim, et al.2026 · 1 citation
54. SCAN: Structured Capability Assessment and Navigation for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Zongqi Wang, Tianle Gu, Chen Gong, et al.2026 · 1 citation
55. SEFL: A Framework for Generating Synthetic Educational Assignment Feedback with LLM AgentsLanguage Resources and Evaluation Conference (LREC)Mike Zhang, Amalie Pernille Dilling, Léon Gondelman, et al.2026 · 1 citation
56. Synthetic Doctor-Patient Dialogue Generation for Robust Medical ASR: A Scalable Pipeline for Vocabulary Expansion and Privacy PreservationConference of the European Chapter of the Association for Computational Linguistics (EACL)Kefei Liu, Meizhu Liu2026 · 1 citation
57. A Virtual Assistant for Architectural Design in a VR EnvironmentConference of the European Chapter of the Association for Computational Linguistics (EACL)Ander Salaberria, Oier Ijurco, Markel Ferro, et al.2026
58. Alignment Tuning for Large Language Models: A Data-Centric Lens on Alignment Data PipelinesFindings of the Association for Computational LinguisticsHwanjun Song2026
59. Bi-Text Mining across German Dialects: On the Role of Synthetic Training Data for Dialect AdaptationWorkshop on Building and Using Comparable Corpora (BUCC)Jing Wang, Barbara Plank, Robert Litschko2026
60. Calibrating LLM Judges: Linear Probes for Fast and Reliable Uncertainty EstimationAnnual Meeting of the Association for Computational Linguistics (ACL)Bhaktipriya Radharapu, Eshika Saxena, Kenneth Li, et al.2026
61. Comparing Approaches to Automatic Summarization in Less-Resourced LanguagesLanguage Resources and Evaluation Conference (LREC)Chester Palen-Michel, Constantine Lignos2026
62. Computational models of pragmatic reasoning with flexible generation of meaning and expression alternativesarXiv:2607.18443Polina Tsvilodub, Fausto Carcassi, Michael Franke2026
63. Evaluation Pitfalls and Sparsity Limitations in LLM-based Confidence Estimates for ClassificationFindings of the Association for Computational LinguisticsElena Merdjanovska, Omar Zaidan, Andreas Rücklé2026
64. ExStrucTiny: A Benchmark for Schema-Variable Structured Information Extraction from Document ImagesConference of the European Chapter of the Association for Computational Linguistics (EACL)Mathieu Sibue, Andrés Muñoz Garza, Samuel Mensah, et al.2026
65. Judging Instruction Responses in a Low-Resource Language: A Case Study on BasqueLanguage Resources and Evaluation Conference (LREC)David Ponce, Harritxu Gete, Thierry Etchegoyhen, et al.2026
66. Learning to Refine: Self-Refinement of Parallel Reasoning in LLMsFindings of the Association for Computational LinguisticsQibin Wang, Pu Zhao, Shaohan Huang, et al.2026
67. Mitigating Judgment Preference Bias in Large Language Models through Group-Based PollingFindings of the Association for Computational LinguisticsShuliang Liu, Zhipeng Xu, Zhenghao Liu, et al.2026
68. ORCA: Open-ended Response Correctness Assessment for Audio Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Šimon Sedláček, Sara Barahona, Cecilia Bolaños, et al.2026
69. Reward Modeling for Scientific Writing EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Furkan Şahinuç, Subhabrata Dutta, Iryna Gurevych2026
70. Synthetic Eggs in Many Baskets: The Impact of Synthetic Data Diversity on LLM Fine-TuningFindings of the Association for Computational LinguisticsMax Schaffelder, Albert Gatt2026
71. Classifying German Language Proficiency Levels Using Large Language ModelsarXiv:2512.06483Elias-Leander Ahlers; Witold Brunsmann;, Malte Schilling2025

210 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/juyoung-suk/cited-by/