ME2-BERT: Are Events and Emotions what you need for Moral Foundation Prediction?
Paper · 2025 · Lorenzo Zangari, Candida M. Greco, Davide Picca et al.
Summary
Moral Foundation Prediction tries to detect which Moral Foundations Theory (MFT) dimensions a text expresses. Earlier systems usually look at morality alone and transfer poorly to new domains. The authors propose ME2-BERT, a BERT fine-tuning framework that also uses emotions and events. It is trained on E2MoCase_full, a news corpus that the authors describe as the only dataset with joint labels for morality, emotions and events.
The framework works as follows. Paragraphs with events and paragraphs without them are treated as separate domains. A denoising auto-encoder, guided by contrastive learning over emotion categories, produces text embeddings. An adversarial event-based domain classifier pushes these embeddings to be domain-invariant, and a multi-label moral classifier predicts the foundations.
ME2-BERT beats lexicon-based, BERT-based and LLM baselines. Its average F1 gains range from about 15% to 33%, and the gain reaches 35% when testing out of domain. Ablations indicate that every component, including the emotion and event modules, helps. This suggests that emotions and events give useful signals for robust morality detection.
Key points
- The task is framed as multi-label classification over the five MFT foundations: Care/Harm, Fairness/Cheating, Loyalty/Betrayal, Authority/Subversion and Purity/Degradation. Texts with none of them count as non-moral.
- The training data is E2MoCase_full (Greco et al., 2024). Emotion categories follow Plutchik's wheel, and each text is assigned a single dominant emotion.
- The architecture combines unsupervised domain adaptation, an emotion-aware denoising auto-encoder, a contrastive loss, an adversarial domain classifier and a moral classifier.
- The event-based domain strategy also worked on the MoralEvent dataset, where ME2-BERT outperformed BERT-base. Sentence-Transformer encoders were tested as well.
- Code and trained models are available at mlnteam-unical.github.io/resources/.
Fields, topics and concepts
📚 Shelves 2The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 works
🧭 Topics 1Research subjects and languages the work is about.Sentiment & emotion · 972 works
Cite
Cite as Lorenzo Zangari, Candida M. Greco, Davide Picca and Andrea Tagarelli. 2025. ME2-BERT: Are Events and Emotions what you need for Moral Foundation Prediction?. Proceedings of the 31st International Conference on Computational Linguistics.
@inproceedings{zangari2025me2,
title = {{ME2-BERT: Are Events and Emotions what you need for Moral Foundation Prediction?}},
author = {Lorenzo Zangari, Candida M. Greco, Davide Picca and Andrea Tagarelli},
booktitle = {Proceedings of the 31st International Conference on Computational Linguistics},
year = {2025},
url = {https://aclanthology.org/2025.coling-main.638/}
}References
- Marwa Abdulhai, Gregory Serapio-García, Clément Crepy, Daria Valter, John Canny, and Natasha Jaques. 2024. Moral foundations of large language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP.
- Guilherme FCF Almeida, José Luiz Nunes, Neele Engelmann, Alex Wiegmann, and Marcelo de Araújo. 2024. Exploring the psychology of llms’ moral and legal reasoning. Artificial Intelligence, 333. find
- Oscar Araque, Lorenzo Gatti, and Kyriaki Kalimeri. 2020. Moralstrength: Exploiting a moral lexicon and embedding similarity for moral foundations prediction. Knowledge-based systems, 191. find
- Oscar Araque, Lorenzo Gatti, and Kyriaki Kalimeri. 2022. Libertymfd: A lexicon to assess the moral foundation of liberty. In Proceedings of the 2022 ACM Conference on Information Technology for Social Good. find
- Mohammad Atari, Jesse Graham, and Morteza Dehghani. 2020. Foundations of morality in iran. Evolution and Human Behavior, 41(5). find
- Matthew Feinberg and Robb Willer. 2015. From gulf to bridge: When do moral arguments facilitate political influence? Personality and Social Psychology Bulletin, 41(12). find
- Jeremy Frimer. 2019. Moral foundations dictionary 2.0. find
- Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, Mario March, and Victor Lempitsky. 2016. Domain-adversarial training of neural networks. Journal of machine learning research, 17(59). find
- Justin Garten, Joe Hoover, Kate M Johnson, Reihane Boghrati, Carol Iskiwitch, and Morteza Dehghani. 2018. Dictionaries and distributions: Combining expert knowledge and large scale textual data content analysis: Distributed dictionary representation. Behavior research methods, 50. find
- Muhammad Ghifary, W Bastiaan Kleijn, Mengjie Zhang, David Balduzzi, and Wen Li. 2016. Deep reconstruction-classification networks for unsupervised domain adaptation. In Computer Vision–ECCV 2016: 14th European Conference. Springer. find
- Shai Ben-David, John Blitzer, Koby Crammer, Alex Kulesza, Fernando Pereira, and Jennifer Wortman Vaughan. 2010. A theory of learning from different domains. Machine learning, 79. find
- Jesse Graham, Jonathan Haidt, Sena Koleva, Matt Motyl, Ravi Iyer, Sean P. Wojcik, and Peter H. Ditto. 2013. Moral Foundations Theory: The pragmatic validity of moral pluralism. In Advances in Experimental Social Psychology, volume 47. Elsevier. find
- Kevin L Blankenship, Traci Y Craig, and Marielle G Machacek. 2021. The interplay between absolute language and moral reasoning on endorsement of moral foundations. Frontiers in Psychology, 12. find
- Jesse Graham, Jonathan Haidt, and Brian A. Nosek. 2009. Liberals and conservatives rely on different sets of moral foundations. Journal of personality and social psychology, 96(5). find
- Erik Cambria, Andrew Livingstone, and Amir Hussain. 2012. The hourglass of emotions. In Cognitive behavioural systems: COST 2102 international training school. Springer. find
- C Daryl Cameron, Kristen A Lindquist, and Kurt Gray. 2015. A constructionist review of morality and emotions: No evidence for specific links between moral content and discrete emotions. Personality and social psychology review, 19(4). find
- Stéphane Clinchant, Gabriela Csurka, and Boris Chidlovskii. 2016. A domain adaptation regularization for denoising autoencoders. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). Association for Computational Linguistics. find
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
- Nathalie DiBerardino and Luke Stark. 2023. (anti)-intentional harms: The conceptual pitfalls of emotion ai in education. Association for Computing Machinery. find
- Candida M. Greco, Lorenzo Zangari, Davide Picca, and Andrea Tagarelli. 2024. E2mocase: A dataset for emotional, event and moral observations in news articles on high-impact legal cases. Preprint, arXiv:2409.09001. find
- Siyi Guo, Negar Mokhberian, and Kristina Lerman. 2023. A data fusion framework for multi-domain morality learning. In Proceedings of the International AAAI Conference on Web and Social Media, volume 17. find
- Jonathan Haidt and Jesse Graham. 2007. When morality opposes justice: Conservatives have moral intuitions that liberals may not recognize. Social justice research, 20(1). find
- Jonathan Haidt and Craig Joseph. 2004. Intuitive ethics: how innately prepared intuitions generate culturally variable virtues. Daedalus, 133(4). find
- Jonathan Haidt et al. 2003. The moral emotions. Handbook of affective sciences, 11(2003). find
- Joe Hoover, Gwenyth Portillo-Wightman, Leigh Yeh, Shreya Havaldar, Aida Mostafazadeh Davani, Ying Lin, Brendan Kennedy, Mohammad Atari, Zahra Kamel, Madelyn Mendlen, et al. 2020a. Moral foundations twitter corpus: A collection of 35k tweets annotated for moral sentiment. Social Psychological and Per… find
- Joe Hoover, Gwenyth Portillo-Wightman, Leigh Yeh, Shreya Havaldar, Aida Mostafazadeh Davani, Ying Lin, Brendan Kennedy, Mohammad Atari, Zahra Kamel, Madelyn Mendlen, et al. 2020b. Moral foundations twitter corpus: A collection of 35k tweets annotated for moral sentiment. Social Psychological and Per… find
- Frederic R Hopp, Jacob T Fisher, Devin Cornell, Richard Huskey, and René Weber. 2021. The extended moral foundations dictionary (emfd): Development and applications of a crowd-sourced approach to extracting moral intuitions from text. Behavior research methods. find
- Zachary Horne and Derek Powell. 2016. How large is the role of emotion in judgments of moral dilemmas? PloS one, 11(7). find
- K. Iurino and G. Saucier. 2020. Testing measurement invariance of the moral foundations questionnaire across 27 countries. Assessment, 27. find
- Guoliang Kang, Lu Jiang, Yi Yang, and Alexander G Hauptmann. 2019. Contrastive adaptation network for unsupervised domain adaptation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. find
- Jonathan Kobbe, Ines Rehbein, Ioana Hulpus , , and Heiner Stuckenschmidt. 2020. Exploring morality in argumentation. In Proceedings of the 7th Workshop on Argument Mining. Association for Computational Linguistics. find
- Enrico Liscio, Alin E Dondera, Andrei Geadau, Catholijn M Jonker, and Pradeep K Murukannaiah. 2022. Cross-domain classification of moral values. In 2022 Findings of the Association for Computational Linguistics: NAACL 2022. find
- Bing Liu. 2020. Sentiment analysis: Mining opinions, sentiments, and emotions. Cambridge university press. find
- Alejo Lopez-Avila and Víctor Suárez-Paniagua. 2023. Combining denoising autoencoders with contrastive learning to fine-tune transformer models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. find
- Leland McInnes, John Healy, and James Melville. 2018. Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426.
- Negar Mokhberian, Frederic R. Hopp, Bahareh Harandizadeh, Fred Morstatter, and Kristina Lerman. 2022. Noise audits improve moral foundation classification. In IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. IEEE. find
- Tuan Dung Nguyen, Ziyu Chen, Nicholas George Carroll, Alasdair Tran, Colin Klein, and Lexing Xie. 2024. Measuring moral dimensions in social media with mformer. In Proceedings of the Eighteenth International AAAI Conference on Web and Social Media, ICWSM. AAAI Press. find
- Matthew E. Peters, Sebastian Ruder, and Noah A. Smith. 2019. To tune or not to tune? adapting pretrained representations to diverse tasks. In Proceedings of the 4th Workshop on Representation Learning for NLP (RepL4NLP-2019). Association for Computational Linguistics. find
- Robert Plutchik. 2001. The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American scientist, 89(4). find
- Vjosa Preniqi, Iacopo Ghinassi, Julia Ive, Charalampos Saitis, and Kyriaki Kalimeri. 2024. Moralbert: A fine-tuned language model for capturing moral values in social discussions. In Proceedings of the 2024 International Conference on Information Technology for Social Good. Association for Computing… find
- Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP.
- Shalom H. Schwartz. 1992. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. volume 25. Academic Press. find
- Connor Shorten, Taghi M Khoshgoftaar, and Borko Furht. 2021. Text data augmentation for deep learning. Journal of big Data, 8(1). find
- Peeyush Singhal, Rahee Walambe, Sheela Ramanna, and Ketan Kotecha. 2023. Domain adaptation: challenges, methods, datasets, and applications. IEEE access, 11. find
- Luke Stark. 2023. Artificial intelligence and the conjectural sciences. BJHS Themes, 8. find
- Melike Tekin and Sönmez Ekici. 2023. The relationship between emotions and morality. Frontiers in Psychology. find
- Jackson Trager, Alireza S Ziabari, Aida Mostafazadeh Davani, Preni Golazizian, Farzan Karimi-Malekabadi, Ali Omrani, Zhihe Li, Brendan Kennedy, Nils Karl Reimer, Melissa Reyes, et al. 2022. The moral foundations reddit corpus. arXiv preprint arXiv:2208.05545. — [arXiv:2208.05545](https://arxiv.org/abs/2208.05545) find
- Giuseppe Ugazio, Claus Lamm, and Tania Singer. 2012. The role of emotions for moral judgments depends on the type of emotion and moral scenario. Emotion, 12(3). find
- Ibo Van de Poel and Lambèr Royakkers. 2023. Ethics, technology, and engineering: An introduction. John Wiley & Sons. find
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems.
- Pascal Vincent, Hugo Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th International Conference on Machine Learning. Association for Computing Machinery. find
- Kexin Wang, Nils Reimers, and Iryna Gurevych. 2021. Tsdae: Using transformer-based sequential denoising auto-encoderfor unsupervised sentence embedding learning. In Findings of the Association for Computational Linguistics: EMNLP 2021. find
- Wei Xiang and Bang Wang. 2019. A survey of event extraction from text. IEEE Access, 7. find
- Xinliang Frederick Zhang, Winston Wu, Nicholas Beauchamp, and Lu Wang. 2024. MOKA: Moral knowledge augmentation for moral event extraction. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics. find
- Xiyang Zhang, Muhao Chen, and Jonathan May. 2021. Salience-aware event chain modeling for narrative understanding. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/zangari-2025-me2-bert-are-events-emotions/