📰 HumEval 2022 — accepted papers

HumEval 2022 is the 2022 edition of the Workshop on Human Evaluation of NLP Systems (HumEval), held in Dublin, Ireland, May 2022 (publisher: Association for Computational Linguistics). The ACL Anthology lists 10 papers of it; our library holds 1 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

📍 Dublin, Ireland · 🗓 May 2022

Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ↗Anastasia Shimorina, Anya Belz26 citations
2. Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ↗Huiyuan Lai, Jiali Mao, Antonio Toral et al.10 citations
3. Toward More Effective Human Evaluation for Machine Translation ↗Belén Saldías Fuentes, George Foster, Markus Freitag et al.7 citations
4. A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ↗Varvara Logacheva, Daryna Dementieva, Irina Krotova et al.5 citations
5. Beyond calories: evaluating how tailored communication reduces emotional load in diet-coaching ↗Simone Balloccu, Ehud Reiter2 citations
6. Perceptual Quality Dimensions of Machine-Generated Text with a Focus on Machine Translation ↗Vivien Macketanz, Babak Naderi, Steven Schmidt et al.2 citations
7. Vacillating Human Correlation of SacreBLEU in Unprotected Languages ↗Ahrii Kim, Jinhyeon Kim1 citation

All accepted papers (10)

The most cited first; 1 with our summary link to their page here, the others to the original.

1. The Human Evaluation Datasheet: A Template for Recording Details of Human Evaluation Experiments in NLP ↗Anastasia Shimorina, Anya Belz26 citations
2. Human Judgement as a Compass to Navigate Automatic Metrics for Formality Transfer ↗Huiyuan Lai, Jiali Mao, Antonio Toral et al.10 citations
3. Toward More Effective Human Evaluation for Machine Translation ↗Belén Saldías Fuentes, George Foster, Markus Freitag et al.7 citations
4. A Study on Manual and Automatic Evaluation for Text Style Transfer: The Case of Detoxification ↗Varvara Logacheva, Daryna Dementieva, Irina Krotova et al.5 citations
5. Beyond calories: evaluating how tailored communication reduces emotional load in diet-coaching ↗Simone Balloccu, Ehud Reiter2 citations
6. Perceptual Quality Dimensions of Machine-Generated Text with a Focus on Machine Translation ↗Vivien Macketanz, Babak Naderi, Steven Schmidt et al.2 citations
7. Vacillating Human Correlation of SacreBLEU in Unprotected Languages ↗Ahrii Kim, Jinhyeon Kim1 citation
8. A Methodology for the Comparison of Human Judgments With Metrics for Coreference Resolution ↗Mariya Borovikova, Loïc Grobol, Anaïs Halftermeyer et al.
9. Human evaluation of web-crawled parallel corpora for machine translation ↗Gema Ramírez-Sánchez, Marta Bañón, Jaume Zaragoza-Bernabeu et al.
10. Towards Human Evaluation of Mutual Understanding in Human-Computer Spontaneous Conversation: An Empirical Study of Word Sense Disambiguation for Naturalistic Social Dialogs in American EnglishAlex Lưuour summary

📄 Papers with our summary in our library (1)

The most cited first (OpenAlex citations plus our library's).

1. Towards Human Evaluation of Mutual Understanding in Human-Computer Spontaneous Conversation: An Empirical Study of Word Sense Disambiguation for Naturalistic Social Dialogs in American EnglishWorkshop on Human Evaluation of NLP Systems (HumEval)Alex Lưu2022

🧭 Top topics

Topics of its works in our library, with the number of works on each.

🔀Word sense disambiguation (1)🗨️Dialogue systems (1)📏Evaluation & benchmarks (1)English (1)

📚 Fields

🎭Arts and Humanities (1)🖥️Computer Science (1)

🏛️ Top institutions

Institutions on the bylines of its works here, by the number of works.

🎓Brandeis UniversityWaltham · United States1 work here

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/humeval/2022/