📰 GEM 2026 — accepted papers

GEM 2026 is the 2026 edition of the Workshop on Generation, Evaluation and Metrics (GEM), held in San Diego, California, USA, July 2026 (publisher: Association for Computational Linguistics). The ACL Anthology lists 76 papers of it; our library holds 2 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. An Empirical Study of LLM-as-a-Judge: How Design Choices Impact Evaluation ReliabilityYusuke Yamauchi, Taro Yano, Masafumi Oyamada3 citations
2. Capturing Epistemic Uncertainty in LLM-Based Soft LabelingYanru Jiang, Siyu Liang1 citation
3. MedFact: Benchmarking the Fact-Checking Capabilities of Large Language Models on Chinese Medical TextsJiayi He, Yangmin Huang, Qianyun Du et al.1 citation
4. MetaGraph: A Large-Scale Meta-Analysis of GenAI in Financial NLP (2022–2025)Paolo Pedinotti, Peter Baumann, Nathan Jessurun et al.1 citation
5. Permutation-Consensus Listwise Judging for Robust Factuality EvaluationTianyi Huang, Nathan Huang, Justin Tang et al.1 citation
6. Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth AnalysesXanh Ho, Jiahao Huang, Florian Boudin et al.1 citation
7. Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language ModelsPriyanka Mary Mammen, Emil Joswin, Shankar Venkitachalam1 citation

All accepted papers (76)

The most cited first; 2 with our summary link to their page here, the others to the original.

1. An Empirical Study of LLM-as-a-Judge: How Design Choices Impact Evaluation ReliabilityYusuke Yamauchi, Taro Yano, Masafumi Oyamada3 citations
2. Capturing Epistemic Uncertainty in LLM-Based Soft LabelingYanru Jiang, Siyu Liang1 citation
3. MedFact: Benchmarking the Fact-Checking Capabilities of Large Language Models on Chinese Medical TextsJiayi He, Yangmin Huang, Qianyun Du et al.1 citation
4. MetaGraph: A Large-Scale Meta-Analysis of GenAI in Financial NLP (2022–2025)Paolo Pedinotti, Peter Baumann, Nathan Jessurun et al.1 citation
5. Permutation-Consensus Listwise Judging for Robust Factuality EvaluationTianyi Huang, Nathan Huang, Justin Tang et al.1 citation
6. Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth AnalysesXanh Ho, Jiahao Huang, Florian Boudin et al.1 citation
7. Who Endorsed It? Measuring Authority Bias Across Expertise Levels in Language ModelsPriyanka Mary Mammen, Emil Joswin, Shankar Venkitachalam1 citation
8. A Progressive Evaluation Framework for Multicultural Analysis of Story VisualizationJanak Kapuriya, Ali Hatami, Paul Buitelaar
9. Are LLM Benchmarks Already Contaminated? A Systematic Review of Contamination Detection MethodsErfan Nourbakhsh, Mohammad Sadegh Sirjani, Amir Mousavi et al.
10. C2-Faith: Benchmarking LLM Judges for Causal and Coverage Faithfulness in Chain-of-Thought ReasoningAvni Mittal, Rauno Arike
11. CoSy: Conversational Synthesis for Grounded Question AnsweringPatrick Huber, Arash Einolghozati, Rylan Conway et al.
12. Complex-IF and Beyond: Expert Rubrics for RLVRSushant Mehta, Liudas Panavas, Eleanor Fleming et al.
13. Component Transfer Can Exceed Full Model Performance: Investigating Post-Trained Mixture-of-ExpertsRabin Tiwari
14. Concord: An Agreement-Aware Multi-Adjudication Pipeline for LLM EvaluationTyler Bliss, Mahit Verma, Aila Iyer-Singh et al.
15. Cross-Domain Semantic Fidelity Evaluation for Meaning-to-Text GenerationDavan Harrison, Marilyn Walker
16. Do Nugget-Based Evaluation Patterns Generalize to List-QA?MohammadJavad Ardestani, Ehsan Kamalloo, Davood Rafiei
17. E-star 12B: Reliable Rubric-Following and Domain-Adaptive SLM Evaluator for Korean Industrial SettingsYonghoon Kwon, Heondeuk Lee, Barom Kang
18. Early-Token Confidence Predicts Reasoning Quality in Multi-Agent LLM DebateAli Keramati, Justin Cheok, Jacob Horne et al.
19. EconWebArena: Benchmarking Autonomous Agents on Economic Tasks in Realistic Web EnvironmentsZefang Liu, Yinzhu Quan
20. Evaluating ASR Quality at Scale on TV Entertainment PlatformsAdeep Hande, Kishorekumar Sundararajan, Yidnekachew Endale et al.
21. Evaluating Counterfactual Strategic Reasoning in Large Language ModelsDimitrios Georgousis, Maria Lymperaiou, Angeliki Dimitriou et al.
22. Evaluating Multilingual Sentiment Classifiers Using an LLM-Annotated Wikipedia BenchmarkMilena Stróżyna, Włodzimierz Lewoniewski, Izabela Czumałowska
23. Evaluating the Reliability of LLMs in Faithfully Updating Text: An Empirical StudyAyan Datta, Paheli Bhattacharya, Rishabh Gupta
24. Exploring Coherence of LLMs in Multilingual Question AnsweringStefano Campese, Ivano Lauriola
25. Fine-Tuning vs. RAG for Multi-Hop Question Answering with Novel KnowledgeZhuoyi Yang, Yurun Song, Kyler G. Harris et al.

See all 76 papers in GEM 2026 — accepted papers →

📄 Papers with our summary in our library (2)

The most cited first (OpenAlex citations plus our library's).

1. Mind the Gap... or Not? How Translation Errors and Evaluation Details Skew Multilingual ResultsWorkshop on Generation, Evaluation and Metrics (GEM)Jan-Thorsten Peter, David Vilar, Tobias Domhan, et al.2026 · 4 citations
2. ReproHum #0669-08: Reproducing a Recipe for Arbitrary Text Style Transfer with LLMsWorkshop on Generation, Evaluation and Metrics (GEM)Saad Mahamood2026 · 1 citation

🧭 Top topics

Topics of its works in our library, with the number of works on each.

🌍Multilingual & cross-lingual NLP (1)📏Evaluation & benchmarks (1)

📚 Fields

🎭Arts and Humanities (2)🖥️Computer Science (2)

🧑‍🔬 Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/gem/2026/