Practising responsibility: Ethics in NLP as a hands-on course
Paper · 2026 · Malvina Nissim, Viviana Patti and Beatrice Savoldi
Summary
The paper describes a dedicated university course on the ethics of language technology. The authors argue that NLP curricula have lagged behind the field's growing attention to social impact. Ethics was often covered only in isolated lectures, and it is hard to teach because the area changes quickly and calls for critical reflection more than technical skill. Their offering, titled "Ethical Aspects in Natural Language Processing," was launched in 2021/2022 within Groningen's BSc Information Science and afterwards adapted for Master's programmes in Pavia and Turin.
The six weeks of content follow the whole NLP pipeline:
- bias and debiasing
- dual use and stakeholders
- data ownership, documentation and annotation
- evaluation and reporting practices
Teaching relies on active learning: interactive lectures, hands-on labs, and "learning by teaching." In group final projects, students explain ethical issues to outside audiences such as researchers, school pupils and the public.
The paper gives no quantitative evaluation. Its contribution is a tested, flexible course design, reusable teaching materials and student-made outreach products. It also offers an honest account of the costs and challenges, which may help educators adding social-impact topics to NLP teaching.
Key points
- Format: The course carries 5–6 ECTS with 28–36 contact hours over six weeks. Each week has a two-hour lecture and a two-hour lab seminar. Weekly group assignments are marked only pass/fail (0/1) but are required before the final project.
- Editions: The course has run in Groningen since 2021/2022, reaching its fifth edition in 2025/2026. It also ran in Pavia's MA Linguistics as a 36-hour crash course over six days, and in Turin's MA Language Technologies and Digital Humanities, where a philosopher co-taught it (both in 2023/24 and 2024/25).
- Classroom activities: These included live transcription of class talk to question what counts as data and who owns it, and emotion annotation exercises.
- Final projects: Projects included interviews with ACL researchers (e.g., Dirk Hovy, Saif Mohammad, Yulia Tsvetkov), high-school presentations, card games, podcasts, interactive demos, illustrated books, and leaflets for primary-school children and care-home residents.
- Materials and limitations: Materials are available at github.com/ethics-handson/teaching. The stated limitations are heavy logistical effort, subjective grading, production costs and local-language barriers.
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Social Sciences · 1,772 worksSafety Research · 543 worksEngineering · 133 worksEducation · 203 worksArchitecture · 2 works
🧭 Topics 1Research subjects and languages the work is about.Bias, fairness & safety · 517 works
Cite
Cite as Malvina Nissim, Viviana Patti and Beatrice Savoldi. 2026. Practising responsibility: Ethics in NLP as a hands-on course. Proceedings of the Seventh Workshop on Teaching Natural Language Processing (TeachNLP 2026).
@inproceedings{nissim2026practising,
title = {{Practising responsibility: Ethics in NLP as a hands-on course}},
author = {Malvina Nissim, Viviana Patti and Beatrice Savoldi},
booktitle = {Proceedings of the Seventh Workshop on Teaching Natural Language Processing (TeachNLP 2026)},
year = {2026},
doi = {10.18653/v1/2026.teachingnlp-1.14},
url = {https://doi.org/10.18653/v1/2026.teachingnlp-1.14}
}References
- Pieter Delobelle, Giuseppe Attanasio, Debora Nozza, Su Lin Blodgett, and Zeerak Talat. 2024. Metrics for what, metrics for whom: Assessing actionability of bias evaluation metrics in NLP. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 21669–21691, Mi… find
- John A Bargh and Yaacov Schul. 1980. On the cognitive benefits of teaching. Journal of educational psychology, 72(5):593. find
- Emily M. Bender and Batya Friedman. 2018. Data statements for natural language processing: Toward mitigating system bias and enabling better science. Transactions of the Association for Computational Linguistics, 6:587–604. find
- Casey Fiesler and Nicholas Proferes. 2018. “Participant” Perceptions of Twitter Research Ethics. Social Media + Society, 4(1). find
- Emily M. Bender and Alexander Koller. 2020. Climbing towards NLU: On meaning, form, and understanding in the age of data. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5185–5198, Online. Association for Computational Linguistics.
- Logan Fiorella and Richard E Mayer. 2013. The relative benefits of learning by teaching and teaching expectancy. Contemporary Educational Psychology, 38(4):281–288. find
- R. Stuart Geiger, Kevin Yu, Yanlai Yang, Mindy Dai, Jie Qiu, Rebekah Tang, and Jenny Huang. 2020. Garbage in, garbage out? do machine learning application papers in social computing report where human-labeled training data comes from? In Proceedings of the 2020 Conference on Fairness, Accountability… find
- Carl A Benware and Edward L Deci. 1984. Quality of learning with an active versus passive motivational set. American educational research journal, 21(4):755–765. find
- Steven Bird. 2020. Decolonising speech and language technology. In Proceedings of the 28th International Conference on Computational Linguistics, pages 3504–3519, Barcelona, Spain (Online). International Committee on Computational Linguistics.
- Lisa Gitelman. 2013. Raw data is an oxymoron. MIT press. find
- Su Lin Blodgett. 2021. Sociolinguistically Driven Approaches for Just Natural Language Processing. Doctoral dissertation, University of Massachusetts Amherst. UMass Amherst Doctoral Dissertations 2092. find
- Suchin Gururangan, Dallas Card, Sarah Dreier, Emily Gade, Leroy Wang, Zeyu Wang, Luke Zettlemoyer, and Noah A. Smith. 2022. Whose Language Counts as High Quality? Measuring Language Ideologies in Text Data Selection. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Proc… find
- Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (technology) is power: A critical survey of “bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5454– 5476, Online. Association for Computational Linguistics.
- Karen Hao. 2022. A new vision of artificial intelligence for the people. MIT Technology Review. Accessed: 2024-12-19. find
- Su Lin Blodgett, Gilsinia Lopez, Alexandra Olteanu, Robert Sim, and Hanna Wallach. 2021. Stereotyping Norwegian salmon: An inventory of pitfalls in fairness benchmark datasets. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint… find
- Karen Hao and Deepa Seetharaman. 2023. Cleaning up ChatGPT takes heavy toll on human workers. The Wall Street Journal. find
- Christian Hardmeier, Marta R Costa-jussà, Kellie Webster, Will Radford, and Su Lin Blodgett. 2021. How to write a bias statement: Recommendations for submissions to the workshop on gender bias in NLP. arXiv preprint arXiv:2104.03026. — [arXiv:2104.03026](https://arxiv.org/abs/2104.03026) find
- Samuel Bowman. 2022. The dangers of underclaiming: Reasons for caution when reporting how NLP systems fail. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7484–7499, Dublin, Ireland. Association for Computational Linguistics. find
- Dirk Hovy and Shannon L. Spruit. 2016. The Social Impact of Natural Language Processing. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 591–598, Berlin, Germany. Association for Computational Linguistics.
- Carmen Cervone, Martha Augoustinos, and Anne Maass. 2021. The language of derogation and hate: Functions, consequences, and reappropriation. Journal of language and social psychology, 40(1):80– 101. find
- Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jenny Liang, Jesse Dodge, Keisuke Sakaguchi, Maxwell Forbes, Jon Borchardt, Saadia Gabriel, Yulia Tsvetkov, Oren Etzioni, Maarten Sap, A Regina Rini, and Yejin Choi. 2025. Investigating machine moral judgement through the Delphi experim… find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/nissim-2026-practising-responsibility-ethics-nlp-as/