📰 EvalEval 2026 — accepted papers

EvalEval 2026 is the 2026 edition of the Workshop on Evaluating Evaluations (EvalEval), held in San Diego, CA, July 2026 (publisher: Association for Computational Linguistics). The ACL Anthology lists 21 papers of it; our library holds 8 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

📍 San Diego, CA · 🗓 July 2026

All accepted papers (21)

The most cited first; 8 with our summary link to their page here, the others to the original.

1. Mind the Gap: How Elicitation Protocols Shape the Stated-Revealed Preference Gap in Language ModelsPranav Mahajan, Ihor Kendiukhov, Syed Hussain et al.1 citation · our summary
2. BenchNavigator: A Discovery Interface for Comparing LLM BenchmarksAnna Sokol, Inge Vejsbjerg, Elizabeth M. Daly et al.our summary
3. Beyond Static Benchmarks: A Validity, Reliability, and Sociotechnical Framework for Evaluating LLMs in Deployment Contexts ↗Ben Jenkins
4. Caged Birds and Cute Bookworms: Feminine Tropes and Implicit Gender Bias in Large Language ModelsSachita Nishal, Jack Bandyour summary
5. Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication TheoryIsar Nejadgholi, Masoud Kianpour, Krishnapriya Vishnubhotla et al.our summary
6. Document Overlap Is Not Evidence Continuity: Measuring Retrieval Jitter in Citation-Based RAG EvaluationPunitha Ponnurajour summary
7. Evaluating Large Language Model News Sentiment in Finance under Liquidity and Market Frictions ↗Kemal Kirtac
8. Evaluating Multi-turn Human-AI Interaction ↗Shi Ding, Sijian Tan
9. Evaluation Cards for XAI Metrics ↗Rokas Gipiškis, Olga Kurasova
10. From Guidelines to Guarantees: A Graph-Based Evaluation Harness for Domain-Specific Evaluation of LLMsJessica M. Lundin, Usman Nasir Nakakana, Guillaume Chabot-Coutureour summary
11. From Rubrics to Recipe: Principle-Centric Benchmark for Evaluating Large Language Models ↗Shirley Anugrah Hayati, Ruizi Wang, Dongyeop Kang
12. From Wordle to Fibble$^5$: Evaluating LLM Reasoning Under Escalating DeceptionChang Liuour summary
13. Graduating the Benchmark Scale: Lessons from ThermometrySean Trott, Oisín Parkinson-Coombsour summary
14. Guidelines for Whom? Rethinking AI Ethics in Resource-Constrained Migration Services ↗Nari Yoo, Ashley Khor, Namrata Mukhija et al.
15. Measuring AI-Induced Disempowerment: A Framework and Proposed Metrics ↗Je Qin Chooi, Jaeho Lee, Jasmine Xinze Li
16. Position: Evaluations of AI Moral Reasoning Still Miss Half of the Picture ↗Aidan Kierans, Ritam Dutt, Kaley Rittichier et al.
17. Reasoning Model Is Superior LLM-Judge, Yet Suffers from Biases ↗Hui Huang, Xuanxin Wu, Muyun Yang et al.
18. Rigorous Interpretation Is a Form of Evaluation ↗Isabelle Lee, Emmy Liu, Cathy Jiao et al.
19. Scorecard of AI Benchmark Quality ↗Ayrton San Joaquin, Rokas Gipiškis, Ze Shen Chin
20. Too long; didn't solve ↗Lucía Cabrera, Jocelyn D'Arcy, Isaac Saxton-Knight
21. When Scanners Lie: Evaluator Instability in LLM Red-Teaming ↗Lidor Erez, Omer Hofman, Tamir Nizri et al.

📄 Papers with our summary in our library (8)

The most cited first (OpenAlex citations plus our library's).

1. Mind the Gap: How Elicitation Protocols Shape the Stated-Revealed Preference Gap in Language ModelsWorkshop on Evaluating Evaluations (EvalEval)Pranav Mahajan, Ihor Kendiukhov, Syed Hussain, et al.2026 · 1 citation
2. From Wordle to Fibble5: Evaluating LLM Reasoning Under Escalating DeceptionWorkshop on Evaluating Evaluations (EvalEval)Chang Liu2026
3. From Guidelines to Guarantees: A Graph-Based Evaluation Harness for Domain-Specific Evaluation of LLMsWorkshop on Evaluating Evaluations (EvalEval)Jessica M. Lundin, Usman Nasir Nakakana, Guillaume Chabot-Couture2026
4. Defining Cultural Capabilities for AI Evaluation: A Taxonomy Grounded in Intercultural Communication TheoryWorkshop on Evaluating Evaluations (EvalEval)Isar Nejadgholi, Masoud Kianpour, Krishnapriya Vishnubhotla, et al.2026
5. Caged Birds and Cute Bookworms: Feminine Tropes and Implicit Gender Bias in Large Language ModelsWorkshop on Evaluating Evaluations (EvalEval)Sachita Nishal, Jack Bandy2026
6. Document Overlap Is Not Evidence Continuity: Measuring Retrieval Jitter in Citation-Based RAG EvaluationWorkshop on Evaluating Evaluations (EvalEval)Punitha Ponnuraj2026
7. BenchNavigator: A Discovery Interface for Comparing LLM BenchmarksWorkshop on Evaluating Evaluations (EvalEval)Anna Sokol, Inge Vejsbjerg, Elizabeth M. Daly, et al.2026
8. Graduating the Benchmark Scale: Lessons from ThermometryWorkshop on Evaluating Evaluations (EvalEval)Sean Trott, Oisín Parkinson-Coombs2026

🧭 Top topics

Topics of its works in our library, with the number of works on each.

🧠Language models & pretraining (5)📏Evaluation & benchmarks (3)🧮Reasoning (1)🔍Information retrieval & search (1)🛡️Bias, fairness & safety (1)

📚 Fields

🖥️Computer Science (7)🎭Arts and Humanities (6)🤝Social Sciences (5)🎯Decision Sciences (2)🧬Biochemistry, Genetics and Molecular Biology (1)💼Business, Management and Accounting (1)🩺Medicine (1)

🧑‍🔬 Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

🏛️ Top institutions

Institutions on the bylines of its works here, by the number of works.

🎓Rutgers, The State University of New JerseyNew Brunswick · United States1 work here🎓University of Notre DameNotre Dame · United States1 work here🏢IBMArmonk · United States1 work here🔬Max Planck SocietyMunich · Germany1 work here🎓University of OxfordOxford · United Kingdom1 work here🏢IBM (Ireland)Dublin · Ireland1 work here🎓Ohio UniversityAthens · United States1 work here🔬IBM Research - IrelandDublin · Ireland1 work here🏛️National Research Council CanadaOttawa · Canada1 work here🎓University of BergenBergen · Norway1 work here🎓Cardiff UniversityCardiff · United Kingdom1 work here🎓University of TübingenTübingen · Germany1 work here

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/evaleval/2026/