PoETIC: A Re-framing of Context Dependent Emotion Detection
Paper · 2026 · Nirmal Surange and Manish Shrivastava
Summary
Most text-based emotion datasets label an utterance with emotions as if the feeling were fully contained in the words. The authors argue this is misleading. Without prosody, faces or emojis, written emotion depends heavily on the situation. Annotators labelling isolated sentences are therefore implicitly imagining a context. The paper recasts the task at the level of utterance–emotion pairs. Each pair is assigned one of three classes:
- Emotion-Obvious: the text conveys the emotion on its own.
- Emotion-Plausible: it could convey the emotion in some imagined situation.
- Emotion-Implausible: no context would make it fit.
They release PoETIC, a human-annotated benchmark built from filtered GoEmotions test sentences across six Ekman emotions plus Neutral. When asked to imagine contexts, annotators accept far more emotions per sentence than the original gold labels contain. The original GoEmotions tags also do not line up well with these plausibility judgments. Zero- and few-shot baselines with large and small language models are provided. The resource matters because it exposes how ambiguous single-label emotion annotation is. It also offers a way to test whether models reason about implicit context.
Key points
- PoETIC contains about 7k utterance–emotion pairs: 1,000 sentences × 7 labels (Fear, Anger, Sadness, Joy, Disgust, Surprise, Neutral). It is released on GitHub (nirmalsurange/PoETIC).
- The sentences come from the GoEmotions test split. Filtering reduced its 5,427 sentences to 4,770 clean ones, from which 1,000 were selected. The removals were:
- 268 sentences containing emojis
- 267 with foul language
- 106 short or noisy items
- 16 with hashtags or URLs
- Annotators judged an average of 4.55 emotions per utterance as possible, versus 1.09 gold emotions per utterance in the GoEmotions test set.
- The three labels are abbreviated EO, EP and EI. For Neutral, the authors add a constraint: no sentence may receive the Emotion-Obvious label for Neutral and for some other emotion at the same time.
- Baselines cover three LLMs (GPT-5-mini, Gemini 2.5 Flash, Llama3-70B via Groq) and two small language models, each tested in zero-shot and few-shot settings.
Institutions
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksPsychology · 1,552 worksExperimental and Cognitive Psychology · 870 worksSocial Psychology · 306 works
🧭 Topics 1Research subjects and languages the work is about.Sentiment & emotion · 972 works
Cite
Cite as Nirmal Surange and Manish Shrivastava. 2026. PoETIC: A Re-framing of Context Dependent Emotion Detection. Proceedings of Computational Affective Science (CAS) @ LREC 2026.
@inproceedings{surange2026poetic,
title = {{PoETIC: A Re-framing of Context Dependent Emotion Detection}},
author = {Nirmal Surange and Manish Shrivastava},
booktitle = {Proceedings of Computational Affective Science (CAS) @ LREC 2026},
year = {2026},
doi = {10.63317/4f24agmr53nm},
url = {https://doi.org/10.63317/4f24agmr53nm}
}References
- Anuj Attri, Arnav Attri, Suman Banerjee, Amey Patil, Muthusamy Chelliah, Nikesh Garera, and Pushpak Bhattacharyya. 2025. LLMs as architects and critics for multi-source opinion summarization. In Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Confere… find
- Sven Büchel and Udo Hahn. 2017. Emobank: Studying the impact of annotation perspective and representation format on dimensional emotion analysis. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics (EACL), pages 578–585. find
- Andiswa Bukula, Guanqun Cao, Rodrigo Tufiño, Rendi Chevi, Chiamaka Ijeoma Chukwuneke, Alexandra Ciobotaru, Daryna Dementieva, Murja Sani Gadanya, Robert Geislinger, Bela Gipp, Oumaima Hourrane, Oana Ignat, Falalu Ibrahim Lawan, Rooweither Mabuya, Rahmad Mahendra, Vukosi Marivate, Alexander Panchenko… find
- Carlos Busso, Murtaza Bulut, Chi-Chun Lee, Abe Kazemzadeh, Emily Mower, Samuel Kim, Jeannette N Chang, Sungbok Lee, and Shrikanth S Narayanan. 2008. Iemocap: Interactive emotional dyadic motion capture database. Language resources and evaluation, 42(4):335–359. find
- Ankush Chatterjee, Kedhar Nath Narahari, Meghana Joshi, and Puneet Agrawal. 2019. Semeval-2019 task 3: Emocontext contextual emotion detection in text. In Proceedings of the 13th international workshop on semantic evaluation, pages 39–48.
- Dorottya Demszky, Dana Movshovitz-Attias, Jeongwoo Ko, Alan Cowen, Gaurav Nemade, and Sujith Ravi. 2020. GoEmotions: A dataset of fine-grained emotions. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4040–4054, Online. Association for Computational… find
- Paul Ekman. 1992. Are there basic emotions? Psychological Review, 99(3):550–553. find
- Roman Klinger, Orphée De Clercq, Saif Mohammad, and Alexandra Balahur. 2018. IEST: WASSA-2018 implicit emotions shared task. In Proceedings of the 9th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pages 31–42, Brussels, Belgium. Association for Computatio… find
- Florian Lecourt, Madalina Croitoru, and Konstantin Todorov. 2025. ’only chatgpt gets me’: An empirical analysis of gpt versus other large language models for emotion detection in text. In Companion Proceedings of the ACM on Web Conference 2025, pages 2603–2611. find
- Gary McKeown, Michel Valstar, Roddy Cowie, Maja Pantic, and Marc Schroder. 2011. The semaine database: Annotated multimodal records of emotionally colored conversations between a person and a limited agent. IEEE transactions on affective computing, 3(1):5–17. find
- Shamsuddeen Hassan Muhammad, Nedjma Ousidhoum, Idris Abdulmumin, Jan Philip Wahle, Terry Ruas, Meriem Beloucif, Christine de Kock, Nirmal Surange, Daniela Teodorescu, Ibrahim Said Ahmad, David Ifeoluwa Adelani, Alham Fikri Aji, Felermino D. M. A. Ali, Ilseyar Alimova, Vladimir Araujo, Nikolay Babako… — MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations
- Klaus R Scherer and Harald G Wallbott. 1994. Evidence for universality and cultural variation of differential emotion response patterning. Journal of personality and social psychology, 66(2):310. find
- Smriti Singh, Cornelia Caragea, and Junyi Jessy Li. 2024. Language models (mostly) do not consider emotion triggers when predicting emotion. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Sh… find
- Daniel Yang, Aditya Kommineni, Mohammad Alshehri, Nilamadhab Mohanty, Vedant Modi, Jonathan Gratch, and Shrikanth Narayanan. 2023. Context unlocks emotions: Text-based emotion classification dataset auditing with large language models. In 2023 11th International Conference on Affective Computing and… find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/surange-2026-poetic-re-framing-context-dependent/