Reasoning About Gender: How Source Text Strategies Impact Italian–to-German Machine Translation Beyond the Binary
Summary
This study asks whether gender-fair choices in Italian source texts make it easier for LLMs to produce German translations that go beyond the masculine/feminine binary. The authors built a controlled test set of administrative and legal sentences, motivated by bilingual translation practice in South Tyrol. It covers 12 binary and non-binary source strategies, such as split forms, collective and invariable nouns, the schwa and the asterisk. They compared a reasoning model (R1) with a standard-inference model (V3). They also proposed an automatic evaluator that sorts outputs into four classes: non-binary, binary-gendered, single-gendered and incoherent. Both translations and evaluations were checked by humans.
Reasoning helped the model move binary inputs toward non-binary German. It also handled epicenes, neomorphemes and special characters better, and it reformulated through neutralization, visibility devices or paraphrase. However, reasoning did not improve consistency within sentences or the accuracy of the automatic evaluation. These findings give practical guidance on which source strategies to choose when gender-inclusive output is required.
Key points
- Test set: 12 gender-fair strategies, each with at least 20 sentences drawn from administrative and legal language.
- Evaluation framework: four output categories (non-binary, binary-gendered, single-gendered, incoherent), with human analysis used to test whether reasoning makes the automatic judgments more reliable. It did not.
- Vanilla inference (V3): most often fell back on masculine single-gendered forms, especially for epicenes, schwa forms and invariable nouns.
- Incoherent outputs: V3 produced 12 and R1 produced 8. Typical errors were:
- mismatched articles and nouns;
- redundant over-gendering;
- Italian-style asterisks copied directly into German.
- Most suitable source strategies: collective (COL) and invariable (INV) nouns, plus the asterisk. Neomorphemes like the schwa are discouraged without reasoning, partly because of tokenization failures.
Cite
@inproceedings{natale2026reasoning,
title = {{Reasoning About Gender: How Source Text Strategies Impact Italian–to-German Machine Translation Beyond the Binary}},
author = {Natale, Paolo Di and Schlutter, Laura and Chiocchetti, Elena and Alber, Marlies},
booktitle = {Proceedings of the 4th Workshop on Gender-Inclusive Translation Technologies (GITT 2026)},
year = {2026},
url = {https://aclanthology.org/2026.gitt-1.5/}
}References
- Angsal, Magnus P. 2015. Die geschlechtsneutralen Indefinitpronomen en und mensch im Schwedischen und Deutschen. Eine korpusgestützte Vergle-ichsstudie zu Sprachkritik und Gebrauch. Os-nabrücker Beiträge zur Sprachtheorie, 90:165–191. find
- Bröder, Hannah. 2024. Das sogenannte generische Maskulinum – wie geschlechtsübergreifend ist es wirklich? Bestandsaufnahme bisheriger Forschungen. In: Ewels, Andrea/Nübling, Damaris. In Ewels, Andrea and Damaris Nübling, editors, Geschlechter-bewusste Sprache. Argumente, Positionen, Perspektiven… find
- Bußmann, Hadumod and Marlis Hellinger, 2003. German. Engendering female visibility in German, pages 141–174. John Benjamins Publishing Company. find
- Calpestrati, Nicolò. 2022. Das grammatische Genus im Deutschen und im Italienischen: Formale Kriterien, praktische Anwendungen und didaktische Im-plikationen aus kontrastiver Sicht. In Auteri, Laura, Natascia Barrale, Arianna di Bella, and Sabine Hoffmann, editors, Wege der Germanistik in transkul-… find
- Chini, Marina. 1998. Genuserwerb des Italienischen durch deutsche Lerner. In Wegener, Heide, editor, Eine zweite Sprache lernen: empirische Untersuchungen zum Zweitspracherwerb, number 24 in Tübinger Beiträge zur Linguistik. Serie A. -Tübingen : Narr, 1981-2008 ; ZDB-ID: 576273-X, pages 39–60. Na… find
- Comandini, Gloria. 2021. Salve a tutt, tutt*, tuttu, tuttx e tutt@: l’uso delle strategie di neutralizzazione di genere nella comunità queer online. : Indagine su un corpus di italiano scritto informale sul web. Testo e Senso, (23):43–64, dic. find
- De Cesare, Anna-Maria and Giuliana Giusti. 2024. Lingua inclusiva e variazione linguistica. In Cesare, Anna-Maria De and Giuliana Giusti, editors, Lingua inclusiva: forme, funzioni, atteggiamenti e percezioni, volume 6 of LiVVaL Linguaggio e Variazione — Variation in Language, pages 3–18. Edizioni C… find
- Di Natale, Paolo, Egon W. Stemle, Elena Chiocchetti, Marlies Alber, Natascia Ralli, Isabella Stanizzi, and Elena Benini. 2025. The LegISTyr test set: Investigating off-the-shelf instruction-tuned LLMs for terminology-constrained translation in a low-resource language variety. In Gkirtzou, Katerina,… find
- Diewald, Gabriele and Damaris Nübling. 2022. Genus – Sexus – Gender. Number 95 in Linguistik – Impulse & Tendenzen. De Gruyter, Berlin/Boston. Series Title: Linguistik – Impulse & Tendenzen. find
- Diewald, Gabriele and Anja Steinhauer. 2022. Handbuch geschlechtergerechte Sprache: wie Sie angemessen und verständlich gendern. Duden. Dudenverlag, Berlin, 2., aktualisierte und erweiterte auflage edition. Series Title: Duden. find
- Donalies, Elke. 2018. Genus und korrespondierende einheiten. Abgerufen am 13.12.2025. find
- Dong, Qingxiu, Lei Li, Damai Dai, Ce Zheng, Jiaxi Ma, Rui Li, Honghao Xia, Jingjing Xu, Zhiyong Wu, Baobao Chang, Xu Sun, Lei Li, and Zhifang Sui. 2024. A survey on in-context learning. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 1107– 1128, Miami… find our card
- Doyen, Enzo and Amalia Todirascu. 2025. GeNRe: A French gender-neutral rewriting system using collective nouns. In Che, Wanxiang, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar, editors, Findings of the Association for Computational Linguistics: ACL 2025, pages 7889–7909, Vienna, Aust… find
- Eisenberg, Peter. 2020. Grundriss der deutschen Grammatik: Der Satz. Springer eBook Collection. J.B. Metzler, Stuttgart, 5., aktualisierte und überarbeitete auflage edition. Pages: 1 Series Title: Springer eBook Collection. find
- Fririksdóttir, Steinunn Rut. 2024. The GenderQueer test suite. In Haddow, Barry, Tom Kocmi, Philipp Koehn, and Christof Monz, editors, Proceedings of the Ninth Conference on Machine Translation, pages 327–340, Miami, Florida, USA, November. Association for Computational Linguistics. find
- Guo, Daya, D. Yang, H. Zhang, J. Song, P. Wang, Q. Zhu, R. Xu, R. Zhang, S. Ma, et al. 2025. Deepseek-r1 incentivizes reasoning in llms through reinforcement learning. Nature, 645:633–638. find
- Hellinger, Marlis and Hadumod Bußmann. 2015. The linguistic representation of women and men. In Hellinger, Marlis and Heiko Motschenbacher, editors, Gender Across Languages, volume 4, pages 1– 26. John Benjamins, Amsterdam/Philadelphia. find
- Jourdan, Fanny, Yannick Chevalier, and Cécile Favre. 2025. Fairtranslate: an english-french dataset for gender bias evaluation in machine translation by overcoming gender binarity. In Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’25, page 150–166, New… find
- Kojima, Takeshi, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. Large language models are zero-shot reasoners. In Advances in Neural Information Processing Systems, volume 35, pages 22199–22213. Curran Associates, Inc. find our card
- Lardelli, Manuel and Dagmar Gromann. 2022. Gender-Fair (Machine) Translation. pages 166–177. find
- Lardelli, Manuel and Dagmar Gromann. 2023. Gender-Fair Post-Editing: A Case Study Beyond the Binary. In Nurminen, Mary, Judith Brenner, Maarit Koponen, Sirkku Latomaa, Mikhail Mikhailov, Frederike Schierl, Tharindu Ranasinghe, Eva Vanmassenhove, Sergi Alvarez Vidal, Nora Aranberri, Mara Nunziatini,… find
- Li, Yafu, Ronghao Zhang, Zhilin Wang, Huajian Zhang, Leyang Cui, Yongjing Yin, Tong Xiao, and Yue Zhang. 2025. Lost in literalism: How supervised training shapes translationese in LLMs. In Che, Wanxiang, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar, editors, Proceedings of the 63rd… find
- Lindqvist, Anna, Emma Aurora Renström, and Marie Gustafsson Sendén. 2019. Reducing a Male Bias in Language? Establishing the Efficiency of Three Different Gender-Fair Language Strategies. Sex roles. A Journal of research, 81:109–117. find
- Liu, Pengfei, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2023. Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys, 55. find our card
- Löhr, Ronja. 2022. Ich denke, es ist sehr wichtig, dass sich so viele Menschen wie möglich repräsentiert fühlen“. In Diewald, Gabriele and Damaris Nübling, editors, Genus – Sexus – Gender, pages 349–380. De Gruyter, Berlin, Boston. find
- Madaan, Aman, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Karl Moritz Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. 2023. Self-refine: Iterative refinement w… find
- Marenghi, Federica, Anna Cardinaletti, and Alice Suozzi. 2026. Inclusive Language in Italian: An Experimental Investigation of the - Suffix. LiVVaL. Edizioni Ca’ Foscari - Venice University Press, Fondazione Università Ca’ Foscari, Venezia. Open access, peer reviewed. find
- Mohapatra, Arati and S Jaya Nirmala. 2025. Toward true neutrality: Evaluating inference-time debiasing strategies for gender coreference resolution in LLMs. In Huang, Chu-Ren, Yasunari Harada, Jong-Bok Kim, Nguyen T.M. Huyen, Le Thanh Huong, Pham Hien, Emmanuele Chersoni, Le Minh Nguyen, Rachel Edit… find
- Morgenroth, Thekla and Michelle K. Ryan. 2021. The effects of gender trouble: An integrative theoretical framework of the perpetuation and disruption of the gender/sex binary. Perspectives on Psychological Science, 16(6):1113–1142. Place: US Publisher: Sage Publications. find
- Muennighoff, Niklas, Zhiqing Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori Hashimoto. 2025. s1: Simple test-time scaling. find our card
- Murelli, Adriano. 2024. Linguaggio sensibile al genere e sistema morfologico: un confronto tra tedesco e italiano. In Cesare, Anna-Maria De and Giuliana Giusti, editors, Lingua inclusiva: forme, funzioni, atteggiamenti e percezioni, volume 6 of LiVVaL. Linguaggio e Variazione — Variation in Language… find
- Nye, Maxwell, Anders Johan Andreassen, Guy Gur-Ari, Henryk Michalewski, Jacob Austin, David Bieber, David Dohan, Aitor Lewkowycz, Maarten Bosma, David Luan, Charles Sutton, and Augustus Odena. 2021. Show your work: Scratchpads for intermediate computation with language models. find our card
- Paolucci, Angela Balducci, Manuel Lardelli, and Dagmar Gromann. 2023. Gender-fair language in translation: A case study. In Vanmassenhove, Eva, Beatrice Savoldi, Luisa Bentivogli, Joke Daems, and Janiça Hackenbuchner, editors, Proceedings of the First Workshop on Gender-Inclusive Translation Techno… find
- Pfeifer, Wolfgang. 2005. Etymologisches Wörterbuch des Deutschen. dtv, München. find
- Piergentili, Andrea, Beatrice Savoldi, Dennis Fucci, Matteo Negri, and Luisa Bentivogli. 2023. Hi guys or hi folks? benchmarking gender-neutral machine translation with the GeNTE corpus. In Bouamor, Houda, Juan Pino, and Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods i… find
- Rescigno, Argentina Anna and Johanna Monti. 2023. Gender bias in machine translation: a statistical evaluation of google translate and deepl for english, italian and german. Proceedings of the International Conference on Human-informed Translation and Interpreting Technology 2023. find
- Piergentili, Andrea, Beatrice Savoldi, Matteo Negri, and Luisa Bentivogli. 2024. Enhancing gender-inclusive machine translation with neomorphemes and large language models. In Scarton, Carolina, Charlotte Prescott, Chris Bayliss, Chris Oakley, Joanna Wright, Stuart Wrigley, Xingyi Song, Edward Gow-S… find
- Sant, Aleix, Carlos Escolano, Audrey Mash, Francesca De Luca Fornaciari, and Maite Melero. 2024. The power of prompts: Evaluating and mitigating gender bias in MT with LLMs. In Faleńska, Agnieszka, Christine Basta, Marta Costa-jussà, Seraphina Goldfarb-Tarrant, and Debora Nozza, editors, Proceedin… find
- Piergentili, Andrea, Beatrice Savoldi, Matteo Negri, and Luisa Bentivogli. 2025. An LLM-as-a-judge approach for scalable gender-neutral translation evaluation. In Hackenbuchner, Janiça, Luisa Bentivogli, Joke Daems, Chiara Manna, Beatrice Savoldi, and Eva Vanmassenhove, editors, Proceedings of the… find
- Pittner, Karin. 1998. Genus, Sexus und das Pronomen wer. pages 153–162, München. lincom europa. find
- Press, Ofir, Mingjie Zhang, Sewon Min, Ludwig Schmidt, Noah A. Smith, and Mike Lewis. 2023. Measuring and narrowing the compositionality gap in language models. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 5687–5711, Singapore. Association for Computational Linguis… find
- Rarrick, Spencer, Ranjita Naik, Sundar Poudel, and Vishal Chowdhary. 2024. GATE X-E : A challenge set for gender-fair translations from weakly-gendered languages. In Ku, Lun-Wei, Andre Martins, and Vivek Srikumar, editors, Findings of the Association for Computational Linguistics: ACL 2024, pages 85… find
- Reiss, Katharina and Hans J. Vermeer. 2013. Towards a General Theory of Translational Action: Skopos Theory Explained. St. Jerome Publishing, Manchester. Original work published 1984. find
- Renström, Emma A., Anna Lindqvist, Amanda Klysing, and Marie Gustafsson Sendén. 2024. Personal pronouns and person perception – Do paired and nonbinary pronouns evoke a normative gender bias? British Journal of Psychology, 115(2):253– 274. find
- Saunders, Danielle and Bill Byrne. 2020. Reducing gender bias in neural machine translation as a domain adaptation problem. In Jurafsky, Dan, Joyce Chai, Natalie Schluter, and Joel Tetreault, editors, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7724… find our card
- Savoldi, Beatrice, Marco Gaido, Luisa Bentivogli, Matteo Negri, and Marco Turchi. 2021. Gender Bias in Machine Translation. Transactions of the Association for Computational Linguistics, 9:845–874, August. find our card
- Savoldi, Beatrice, Marco Gaido, Matteo Negri, and Luisa Bentivogli. 2023. Test suites task: Evaluation of gender fairness in MT with MuST-SHE and INES. In Koehn, Philipp, Barry Haddow, Tom Kocmi, and Christof Monz, editors, Proceedings of the Eighth Conference on Machine Translation, pages 252–262,… find
- Savoldi, Beatrice, Giuseppe Attanasio, Eleonora Cupin, Eleni Gkovedarou, Janiça Hackenbuchner, Anne Lauscher, Matteo Negri, Andrea Piergentili, Manjinder Thind, and Luisa Bentivogli. 2025a. Mind the inclusivity gap: Multilingual gender-neutral translation evaluation with mGeNTE. In Christodoulopoul… find
- Savoldi, Beatrice, Alan Ramponi, Matteo Negri, and Luisa Bentivogli. 2025b. Translation in the hands of many: Centering lay users in machine translation interactions. In Christodoulopoulos, Christos, Tanmoy Chakraborty, Carolyn Rose, and Violet Peng, editors, Proceedings of the 2025 Conference on Em… find
- Schunack, Silke and Anja Binanzer. 2022. Revisiting gender-fair language and stereotypes – A comparison of word pairs, capital I forms and the asterisk. Zeitschrift für Sprachwissenschaft, 41(2):309– 337, November. Publisher: De Gruyter. find
- Sczesny, Sabine, Magda Formanowicz, and Franziska Moser. 2016. Can Gender-Fair Language Reduce Gender Stereotyping and Discrimination? Frontiers in Psychology, 7, February. Publisher: Frontiers. find
- Stanovsky, Gabriel, Noah A. Smith, and Luke Zettlemoyer. 2019. Evaluating gender bias in machine translation. In Korhonen, Anna, David Traum, and Lluı́s Màrquez, editors, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1679–1684, Florence, Italy, July.… find our card
- Steiger-Loerbroks, Vera and Lisa von Stockhausen. 2014. Mental representations of gender-fair nouns in German legal language: An eye-movement and questionnaire-based study. find
- Linguistische Berichte, 2014, January. van Berlekom, Elli, Sabine Sczesny, and Marie Gustafsson Sendén. 2024. Toward Visibility: Using the Swedish Gender-Inclusive Pronoun Hen Increases Gender Categorization of Androgynous Faces as Nonbinary. Journal of Language and Social Psychology, 43(5-6):525–5… find
- Wang, Jason. 2025. A tutorial on llm reasoning: Relevant methods behind chatgpt o1. find
- Wojahn, Daniel. 2013. De personliga pronome-nens makt : En studie av hur pronomen styr våra föreställningar om personer. pages 356–367. Institutionen för språk, litteratur och interkultur, Karlstads universitet. find
- Wöllstein, Angelika and Dudenredaktion. 2022. Duden - Die Grammatik Struktur und Verwendung der deutschen Sprache. Sätze - Wortgruppen - Wörter. Dudenverlag, Berlin, 10. völlig neu verfasste auflage edition. find
- Zahraei, Pardis Sadat and Ali Emami. 2025. Translate with care: Addressing gender bias, neutrality, and reasoning in large language model translations. In Che, Wanxiang, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar, editors, Findings of the Association for Computational Linguistics:… find
- Zheng, Lianmin, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. Judging llm-as-a-judge with mt-bench and chatbot arena. In Proceedings of the 37th International Conference on Ne… find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/natale-2026-reasoning-about-gender-how-source/