📰 GEM 2023 — accepted papers

GEM 2023 is the 2023 edition of the Workshop on Generation, Evaluation and Metrics (GEM), held in Singapore, December 2023 (publisher: Association for Computational Linguistics). The ACL Anthology lists 32 papers of it; our library holds 1 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

📍 Singapore · 🗓 December 2023

All accepted papers (32)

The most cited first; 1 with our summary link to their page here, the others to the original.

1. A Simple yet Efficient Ensemble Approach for AI-generated Text Detection ↗Harika Abburi, Kalyani Roy, Michael Suesserman et al.
2. Adapting Pre-trained Generative Models for Extractive Question Answering ↗Prabir Mallick, Tapas Nayak, Indrajit Bhattacharya
3. An Empirical Bayes Framework for Open-Domain Dialogue Generation ↗Jing Yang Lee, Kong Aik Lee, Woon Seng Gan
4. Are Large Language Models Reliable Judges? A Study on the Factuality Evaluation Capabilities of LLMs ↗Xue-Yong Fu, Md Tahmid Rahman Laskar, Cheng Chen et al.
5. Automatic Evaluation of Generative Models with Instruction Tuning ↗Shuhaib Mehri, Vered Shwartz
6. Automatic Reflection Generation for Peer-to-Peer Counseling ↗Emma O'neil, João Sedoc, Diyi Yang et al.
7. ChatGPT as a Java Decompiler ↗Bradley Mcdanel, Zhanhao Liu
8. Context and Literacy Aware Learnable Metric for Text Simplification ↗Jeongwon Kwak, Hyeryun Park, Kyungmo Kim et al.
9. Contextualizing the Limits of Model & Evaluation Dataset Curation on Semantic Similarity Classification Tasks ↗Daniel Theron
10. Dialogue Quality and Emotion Annotations for Customer Support Conversations ↗John Mendonca, Patrícia Pereira, Miguel Menezes et al.
11. Effective Proxy for Human Labeling: Ensemble Disagreement Scores in Large Language Models for Industrial NLP ↗Wei Du, Laksh Advani, Yashmeet Gambhir et al.
12. Elo Uncovered: Robustness and Best Practices in Language Model Evaluation ↗Meriem Boubdir, Edward Kim, Beyza Ermis et al.
13. Flesch or Fumble? Evaluating Readability Standard Alignment of Instruction-Tuned Language Models ↗Joseph Marvin Imperial, Harish Tayyar Madabushi
14. Formalizing content creation and evaluation methods for AI-generated social media content ↗Christian Jensen, Axel Højmark
15. Harnessing the Plug-and-Play Controller by Prompting ↗Hao Wang, Lei Sha
16. How well ChatGPT understand Malaysian English? An Evaluation on Named Entity Recognition and Relation ExtractionMohan Raj Chanthran, Lay-Ki Soon, Huey Fang Ong et al.our summary
17. Leveraging Large Language Models for Enhanced Product Descriptions in eCommerce ↗Jianghong Zhou, Bo Liu, Jhalak Acharya et al.
18. Multi-domain Summarization from Leaderboards to Practice: Re-examining Automatic and Human Evaluation ↗David Demeter, Oshin Agarwal, Simon Ben Igeri et al.
19. One-Shot and Few-Shot Exemplification Modeling ↗John Harvill, Hee Suk Yoon, Eunseop Yoon et al.
20. PersonalityChat: Conversation Distillation for Personalized Dialog Modeling with Facts and Traits ↗Ehsan Lotfi, Maxime De Bruyn, Jeska Buhmann et al.
21. Post Turing: Mapping the landscape of LLM Evaluation ↗Alexey Tikhonov, Ivan P. Yamshchikov
22. Predicting Question-Answering Performance of Large Language Models through Semantic Consistency ↗Ella Rabinovich, Samuel Ackerman, Orna Raz et al.
23. QAMPARI: A Benchmark for Open-domain Questions with Many Answers ↗Samuel Amouyal, Tomer Wolfson, Ohad Rubin et al.
24. RankAug: Augmented data ranking for text classification ↗Tiasa Roy, Priyam Basu
25. Separating form and meaning: Using self-consistency to quantify task understanding across multiple senses ↗Xenia Ohmer, Elia Bruni, Dieuwke Hupkes

See all 32 papers in GEM 2023 — accepted papers →

📄 Papers with our summary in our library (1)

The most cited first (OpenAlex citations plus our library's).

1. How well ChatGPT understand Malaysian English? An Evaluation on Named Entity Recognition and Relation ExtractionWorkshop on Generation, Evaluation and Metrics (GEM)Mohan Raj Chanthran, Lay-Ki Soon, Huey Fang Ong, et al.2023 · 2 citations

🧭 Top topics

Topics of its works in our library, with the number of works on each.

🏷️Named entity recognition (1)🔎Information extraction (1)📏Evaluation & benchmarks (1)English (1)

📚 Fields

🎭Arts and Humanities (1)🖥️Computer Science (1)

🧑‍🔬 Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

🏛️ Top institutions

Institutions on the bylines of its works here, by the number of works.

🎓Monash University MalaysiaSubang Jaya · Malaysia1 work here

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/gem/2023/