Challenges and Strategies in Cross-Cultural NLP
Written for the Research library (claude-opus-5-5) from the paper text. Original — aclanthology.org/2022.acl-long.482.pdf
Summary
This position and survey paper argues that NLP systems that serve speakers worldwide must adapt to culture as well as to language. The two are related but different: a single language can include many cultures, and a fairly uniform culture can span several languages. The authors propose a framework of four dimensions on which cultures vary and on which systems may show cultural bias:
- the form and style of language;
- common ground (shared concepts and commonsense knowledge);
- aboutness (which topics people find worth discussing);
- objectives or values.
For each dimension, they collect evidence from linguistics, anthropology and NLP. They then review strategies for closing these gaps, covering data collection, model training and adaptation, and translation that adapts content for a target culture. The paper introduces no new dataset or model. Its contribution is a taxonomy and a research agenda. This matters because cultural mismatch can cause misinterpretation and real harm, such as misdiagnosing depression. The authors call for participatory work with communities, culture-aware human evaluation, and decolonial approaches that let non-WEIRD groups set their own priorities.
Key points
- Within-language variation is often ignored. The Spanish PLM of Cañete et al. (2020) does not distinguish Spain from Argentina. In contrast, a PLM built for the Algerian Arabic dialect beat multilingual and general Arabic models on sentiment classification.
- In the MarVL dataset (Liu et al., 2021), roughly one quarter of concepts drawn from non-Western cultures had no counterpart among English concepts in WordNet.
- Ringel et al. (2019) used cultural differences as distant supervision. They derived English formality labels from German and sarcasm labels from Japanese.
- Common NLP domains are culture-specific. Beer reviews in sentiment analysis are one example, and image-based tasks show a North American and Western European bias.
- Two strategies for cross-cultural translation are discussed. Peskov et al. (2021) replace entities with rough equivalents from the target culture, while Kementchedjhieva et al. (2020) add explanatory appositives. Reference-based automatic metrics are considered unreliable for this kind of translation.
Cited by
- The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants
- Assessing Cross-Cultural Alignment between ChatGPT and Human Societies: An Empirical Study
- Culturally Aware Natural Language Inference
- BLEnD: A Benchmark for LLMs on Everyday Knowledge in Diverse Cultures and Languages
- Having Beer after Prayer? Measuring Cultural Bias in Large Language Models
- The ``Problem'' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation
- Benchmarking Machine Translation with Cultural Awareness
Cite
@inproceedings{hershcovich2022challenges,
title = {{Challenges and Strategies in Cross-Cultural NLP}},
author = {Hershcovich, Daniel and Frank, Stella and Lent, Heather and Lhoneux, Miryam de and Abdou, Mostafa and Brandl, Stephanie and Bugliarello, Emanuele and Piqueras, Laura Cabello and Chalkidis, Ilias and Cui, Ruixiang and Fierro, Constanza and Margatina, Katerina and Rust, Phillip and Søgaard, Anders},
booktitle = {Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
year = {2022},
doi = {10.18653/v1/2022.acl-long.482},
url = {https://doi.org/10.18653/v1/2022.acl-long.482}
}References
- Amine Abdaoui, Mohamed Berrimi, Mourad Oussalah, and Abdelouahab Moussaoui. 2021. Dziribert: a pre-trained language model for the Algerian dialect. arXiv preprint arXiv:2109.12346. find
- Victoria Abou-Khalil, Toru Ishida, Masayuki Otani, Brendan Flanagan, Hiroaki Ogata, and Donghui Lin. 2018. Learning culturally situated dialogue strategies to support language learners. Research and Practice in Technology Enhanced Learning, 13(1):1–20. find
- Anurag Acharya, Kartik Talamadupula, and Mark A. Finlayson. 2021. Toward an atlas of cultural commonsense for machine reasoning. In Proceedings of the Workshop on Common Sense Knowledge Graphs (CSKGs), Online. Held in conjunction with the 35th AAAI Conference on Artificial Intelligence (AAAI 2021). find
- David Ifeoluwa Adelani, Jade Z. Abbott, Graham Neubig, Daniel D’souza, Julia Kreutzer, Constantine Lignos, Chester Palen-Michel, Happy Buzaaba, Shruti https://innovationsfonden.dk/en ↗
- Rijhwani, Sebastian Ruder, Stephen Mayhew, Israel Abebe Azime, Shamsuddeen Hassan Muhammad, Chris Chinenye Emezue, Joyce Nakatumba-Nabende, Perez Ogayo, Aremu Anuoluwapo, Catherine Gitau, Derguene Mbaye, Jesujoba O. Alabi, Seid Muhie Yimam, Tajuddeen Gwadabe, Ignatius Ezeani, Rubungo Andre Niyongabo… find our card
- Željko Agić. 2017. Cross-lingual parser selection for low-resource languages. In Proceedings of the NoDaLiDa 2017 Workshop on Universal Dependencies (UDW 2017), pages 1–10, Gothenburg, Sweden. Association for Computational Linguistics. find
- Tim Althoff, Cristian Danescu-Niculescu-Mizil, and Dan Jurafsky. 2014. How to ask for a favor: A case study on the success of altruistic requests. In Proceedings of the International Conference on Weblogs and Social Media (ICWSM). find
- Waleed Ammar, George Mulcaire, Yulia Tsvetkov, Guillaume Lample, Chris Dyer, and Noah A. Smith. 2016. Massively multilingual word embeddings. ArXiv, abs/1602.01925. find our card
- Wissam Antoun, Fady Baly, and Hazem Hajj. 2020. AraBERT: Transformer-based model for Arabic language understanding. In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pages 9–15, Marseille, France. European Langu… find our card
- Noa Baker Gillis. 2021. Sexism in the judiciary: The importance of bias definition in NLP and in our courts. In Proceedings of the 3rd Workshop on Gender Bias in Natural Language Processing, pages 45–54, Online. Association for Computational Linguistics. find
- Albert Bandura. 1986. Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice-Hall series in social learning theory. Prentice-Hall. find
- Mikhail Bautin, Lohit Vijayarenu, and Steven Skiena. 2008. International sentiment analysis for news and blogs. In ICWSM. find
- Emily M. Bender, Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big? . In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, FAccT ’21, page 610–623, New York, NY, USA. Associ… find
- Paola Bentivoglio and Mercedes Sedano. 2011. Morphosyntactic variation in Spanish-speaking Latin America. The handbook of Hispanic sociolinguistics, pages 168–186. find
- Brent Berlin and Paul Kay. 1969. Basic color terms: Their universality and evolution. University of California Press. find
- Steven Bird. 2020. Decolonising speech and language technology. In Proceedings of the 28th International Conference on Computational Linguistics, pages 3504–3519, Barcelona, Spain (Online). International Committee on Computational Linguistics. find
- Abeba Birhane and Olivia Guest. 2021. Towards decolonising computational sciences. Kvinder, Køn & Forskning, 29(2):60–73. find
- Rexhina Blloshmi, Rocco Tripodi, and Roberto Navigli. 2020. XL-AMR: Enabling cross-lingual AMR parsing with transfer learning techniques. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2487–2500, Online. Association for Computational Linguist… find
- Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (technology) is power: A critical survey of “bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5454– 5476, Online. Association for Computational Linguistics. find our card
- Su Lin Blodgett and Brendan T. O’Connor. 2017. Racial disparity in natural language processing: A case study of social media African-American English. In Workshop on Fairness, Accountability, and Transparency in Machine Learning (FAT/ML 2017). find
- Keld Bodker, Finn Kensing, and Jesper Simonsen. 2009. Participatory IT design: Designing for business and workplace realities. MIT press. find
- Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Advances in Neural Information Processing Systems, volume 29. Curran Associates, Inc. find our card
- Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258. find our card
- Melissa Bowerman and Soonja Choi. 2001. Language acquisition and conceptual development, chapter Shaping meanings for language: Universal and language-specific in the acquisition of semantic categories. Cambridge University Press. cross-lingual representation learning at scale. In Proceedings of the… find
- Warren Breed. 1955. Social control in the newsroom: A functional analysis. Social Forces, 33:326–335. find
- Alexis Conneau and Guillaume Lample. 2019. Cross-lingual language model pretraining. In Advances in Neural Information Processing Systems, volume 32. Curran Associates, Inc. find
- Eleftheria Briakou, Sweta Agrawal, Joel Tetreault, and Marine Carpuat. 2021a. Evaluating the evaluation metrics for style transfer: A case study in multilingual formality transfer. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 1321–1336, Online and… find our card
- Eleftheria Briakou, Sweta Agrawal, Ke Zhang, Joel Tetreault, and Marine Carpuat. 2021b. A review of human evaluation for style transfer. In Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021), pages 58–67, Online. Association for Computational Linguisti… find
- Eleftheria Briakou and Marine Carpuat. 2021. Beyond noise: Mitigating the impact of fine-grained semantic divergences on neural machine translation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Langu… find
- Nina Brown, Thomas McIlwraith, and Laura Tubelle de González. 2020. Perspectives: An Open Introduction to Cultural Anthropology, 2 edition, chapter 4. Language. The American Anthropological Association. find
- Ewa Callahan and Susan C. Herring. 2011. Cultural bias in Wikipedia content on famous persons. J. Assoc. Inf. Sci. Technol., 62:1899–1915. find
- Michael Carl. 1998. Meaning preservation in machine translation. 10th European summer school in logic, language and information (ESSLI’98). find
- Sheila Castilho, Stephen Doherty, Federico Gaspari, and Joss Moorkens. 2018. Approaches to Human and Machine Translation Quality Assessment, pages 9–38. Springer International Publishing, Cham. find
- José Cañete, Gabriel Chaperon, Rodrigo Fuentes, Jou-Hui Ho, Hojin Kang, and Jorge Pérez. 2020. Spanish pre-trained BERT model and evaluation data. In PML4DC at ICLR 2020. find
- Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. find
- Unsupervised Alexis Conneau, Ruty Rinott, Guillaume Lample, Adina Williams, Samuel Bowman, Holger Schwenk, and Veselin Stoyanov. 2018. XNLI: Evaluating cross-lingual sentence representations. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2475–2485,… find
- Tim Dant. 1999. Material culture in the social world. McGraw-Hill Education (UK). find
- Aida Mostafazadeh Davani, Mark Díaz, and Vinodkumar Prabhakaran. 2021. Dealing with disagreements: Looking beyond the majority vote in subjective annotations. find our card
- Miryam de Lhoneux, Sheng Zhang, and Anders Søgaard. 2022. Zero-shot dependency parsing with worst-case aware automated curriculum learning. In Proceedings of ACL. find
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… find
- Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, and Matt Gardner. 2021. Documenting the English colossal clean crawled corpus. CoRR, abs/2104.08758. find
- David M. Eberhard, Gary F. Simons, and Charles D. Fennig. 2021. Ethnologue: Languages of the world. find
- Oliver Falck, Stephan Heblich, Alfred Lameli, and Jens Südekum. 2012. Dialects, cultural identity, and economic exchange. Journal of Urban Economics, 72(2):225–239. find
- Scott Friedman, Sonja Schmer-Galunder, Anthony Chen, and Jeffrey Rye. 2019. Relating word embedding gender biases to gender gaps: A cross-cultural analysis. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 18–24, Florence, Italy. Association for Computational… find
- Johan Galtung and Mari Holmboe Ruge. 1965. The structure of foreign news: The presentation of the Congo, Cuba and Cyprus crises in four Norwegian newspapers. Journal of Peace Research, 2(1):64–90. find
- Fengping Gao. 2005. Japanese: A heavily culture-laden language. Journal of Intercultural Communication, 10:1404–1634. find
- R Stuart Geiger, Kevin Yu, Yanlai Yang, Mindy Dai, Jie Qiu, Rebekah Tang, and Jenny Huang. 2020. Garbage in, garbage out? Do machine learning application papers in social computing report where human-labeled training data comes from? In Proceedings of the 2020 Conference on Fairness, Accountability,… find
- Mitchell L Gordon, Michelle S Lam, Joon Sung Park, Kayur Patel, Jeffrey T Hancock, Tatsunori Hashimoto, and Michael S Bernstein. 2022. Jury learning: Integrating dissenting voices into machine learning models. arXiv preprint arXiv:2202.02950. — [arXiv:2202.02950](https://arxiv.org/abs/2202.02950) find
- Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books. find
- Thilo Hagendorff. 2020. The ethics of AI ethics: An evaluation of guidelines. Minds and Machines, 30(1):99–120. find
- Paul H. P. Hanel, Gregory R. Maio, Ana K. S. Soares, Katia C. Vione, Gabriel L. de Holanda Coelho, Valdiney V. Gouveia, Appasaheb C. Patil, Shan-mukh V. Kamble, and Antony S. R. Manstead. 2018. Cross-cultural differences and similarities in human value instantiation. Frontiers in Psychology, 9:849. find
- Christine Hine. 2020. The evolution and diversification of Twitter as a cultural artefact in the British press 2007–2014. Journalism Studies, 21(5):678–696. find
- Geert Hofstede. 2001. Culture’s consequences: Comparing values, behaviors, institutions and organizations across nations. Sage publications. find
- Juliane House and Gabriele Kasper. 2011. Politeness markers in English and German. In Conversational routine, pages 157–186. De Gruyter Mouton. find
- Dirk Hovy and Diyi Yang. 2021. The importance of modeling social factors of language: Theory and practice. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 588–602, Online. Association for Computa… find our card
- Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, and Melvin Johnson. 2020. XTREME: A massively multilingual multi-task benchmark for evaluating cross-lingual generalization. CoRR, abs/2003.11080. find our card
- Rebecca Hwa, Philip Resnik, Amy Weinberg, Clara I. Cabezas, and Okan Kolak. 2005. Bootstrapping parsers via syntactic projection across parallel texts. Natural Language Engineering, 11:311 – 325. find
- Harsh Jhamtani, Varun Gangal, Eduard Hovy, and Eric Nyberg. 2017. Shakespearizing modern language using copy-enriched sequence to sequence models. In Proceedings of the Workshop on Stylistic Variation, pages 10–19, Copenhagen, Denmark. Association for Computational Linguistics. find our card
- Nina Hansen, Tom Postmes, Annika Tovote, and Annemarie Bos. 2014. How modernization instigates social change: Laptop usage as a driver of cultural value change and gender equality in a developing country. Journal of Cross-Cultural Psychology, 45(8):1229— -1248. find
- Yunjie Ji, Hao Liu, Bolei He, Xinyan Xiao, Hua Wu, and Yanhua Yu. 2020. Diversified multiple instance learning for document-level multi-aspect sentiment classification. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7012–7023, Online. Associa… find
- Shlomo Hareli, Konstantinos Kafetsios, and Ursula Hess. 2015. A cross-cultural study on emotion expression and the learning of social norms. Frontiers in psychology, 6:1501. find
- Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Maxwell Forbes, Jon Borchardt, Jenny Liang, Oren Etzioni, Maarten Sap, and Yejin Choi. 2021. Delphi: Towards machine ethics and norms. find
- Tatsunori Hashimoto, Megha Srivastava, Hongseok Namkoong, and Percy Liang. 2018. Fairness without demographics in repeated loss minimization. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, pages 1929–1938, Stockholmsmäs… find
- Di Jin, Zhijing Jin, Joey Tianyi Zhou, Lisa Orii, and Peter Szolovits. 2020. Hooks in the headline: Learning to generate headlines with controlled styles. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5082– 5093, Online. Association for Computation… find
- Martin Heidegger. 1927, 1953. Sein und Zeit, 16. aufl. edition. Niemeyer, Tübingen. find
- Eun Seo Jo and Timnit Gebru. 2020. Lessons from archives: Strategies for collecting sociocultural data in machine learning. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, FAT* ’20, page 306–316, New York, NY, USA. Association for Computing Machinery. find
- Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. The weirdest people in the world? Behavioral and brain sciences, 33(2-3):61–83. find
- Anna Jørgensen and Anders Søgaard. 2021. Evaluation of summarization systems across gender, age, and race. In Proceedings of the Third Workshop on New Frontiers in Summarization, pages 51–56, Online and in Dominican Republic. Association for Computational Linguistics. find
- Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6282–6293, Online. Association for Comp… find our card
- Nora Kassner, Philipp Dufter, and Hinrich Schütze. 2021. Multilingual LAMA: Investigating knowledge in multilingual pretrained language models. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 3250–3258, Online. Associ… find
- Yova Kementchedjhieva, Di Lu, and Joel Tetreault. 2020. The ApposCorpus: a new multilingual, multi-domain dataset for factual appositive generation. In Proceedings of the 28th International Conference on Computational Linguistics, pages 1989–2003, Barcelona, Spain (Online). International Committee o… find
- Diana Elizabeth Kendall, Rick Linden, and Jane Lothian Murray. 2005. Sociology in our times. Thomson Wadsworth Belmont, CA. find
- Laurence J Kirmayer et al. 2001. Cultural variations in the clinical presentation of depression and anxiety: implications for diagnosis and treatment. Journal of clinical psychiatry, 62:22–30. find
- Jon Kleinberg and Manish Raghavan. 2021. Algorithmic monoculture and social welfare. Proceedings of the National Academy of Sciences, 118(22). find
- Alexandre Klementiev, Ivan Titov, and Binod Bhattarai. 2012. Inducing crosslingual distributed representations of words. In Proceedings of COLING 2012, pages 1459–1474, Mumbai, India. find
- The COLING 2012 Organizing Committee. find
- Tatiana Larina. 2015. Culture-specific communicative styles as a framework for interpreting linguistic and cultural idiosyncrasies. International Review of Pragmatics, 7(2):195 – 215. find
- D. Li. 1997. New values in contrast: Western versus Chinese news reconstruction. Asia-Pacific Media Educator, 1:66–77. find
- Yaobo Liang, Nan Duan, Yeyun Gong, Ning Wu, Fenfei Guo, Weizhen Qi, Ming Gong, Linjun Shou, Daxin Jiang, Guihong Cao, Xiaodong Fan, Ruofei Zhang, Rahul Agrawal, Edward Cui, Sining Wei, Taroon Bharti, Ying Qiao, Jiun-Hung Chen, Winnie Wu, Shuguang Liu, Fan Yang, Daniel Campos, Rangan Majumder, and Mi… find
- Bill Yuchen Lin, Seyeon Lee, Xiaoyang Qiao, and Xiang Ren. 2021a. Common sense beyond English: Evaluating and improving multilingual language models for commonsense reasoning. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint… find
- Bill Yuchen Lin, Frank F. Xu, Kenny Zhu, and Seung-won Hwang. 2018. Mining cross-cultural differences and similarities in social media. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 709–719, Melbourne, Australia. Association… find
- Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O’Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona Diab, Veselin Stoyano… find our card
- Fangyu Liu, Emanuele Bugliarello, Edoardo Maria Ponti, Siva Reddy, Nigel Collier, and Desmond Elliott. 2021. Visually grounded reasoning across languages and cultures. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 10467–10485, Online and Punta Cana,… find
- Heather Lent, Emanuele Bugliarello, Miryam de Lhoneux, Chen Qiu, and Anders Søgaard. 2021. On language models for creoles. In Proceedings of the 25th Conference on Computational Natural Language Learning, pages 58–71, Online. Association for Computational Linguistics. find
- Qi Liu, Yue Zhang, and Jiangming Liu. 2018. Learning domain representation for multi-domain sentiment classification. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 541–5… find
- Daniel Levy, Yair Carmon, John C. Duchi, and Aaron Sidford. 2020. Large-scale methods for distributionally robust optimization. In NeurIPS. find
- Eric Loo. 2019. Reading “Asian values” into journalism practices in Asia. Oxford Research Encyclopedia of Communication. find
- Kate Loveys, Jonathan Torrez, Alex Fine, Glen Moriarty, and Glen Coppersmith. 2018. Cross-cultural differences in language markers of depression online. In Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, pages 78–87. find
- Henry Mainsah and Andrew Morrison. 2014. Participatory design through a cultural lens: Insights from postcolonial theory. In Proceedings of the 13th Participatory Design Conference: Short Papers, Industry Cases, Workshop Descriptions, Doctoral Consortium papers, and Keynote abstracts-Volume 2, pages… find
- Asifa Majid, Fiona Jordan, and Michael Dunn. 2015. Semantic systems in closely related languages. Language Sciences, 49:1–18. find
- Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of English: The Penn Treebank. Computational Linguistics, 19(2):313–330. find our card
- Eric Margolis and Stephen Laurence. 2021. Concepts. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy, Spring 2021 edition. Metaphysics Research Lab, Stanford University. find
- Jo McCormack, Murray Pratt, and Alistair Rolls Alistair Rolls. 2011. Hexagonal variations: Diversity, plurality and reinvention in contemporary France, volume 359. Rodopi. find
- Priyanka Nanayakkara, Jessica Hullman, and Nicholas Diakopoulos. 2021. Unpacking the expressed consequences of AI research in broader impact statements. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, AIES ’21, page 795–806, New York, NY, USA. Association for Computing Mac… find
- Eric Nelson. 2008. Heidegger and the Ethics of Facticity. SUNY Press. find
- Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Jan Hajič, Christopher D. Manning, Sampo Pyysalo, Sebastian Schuster, Francis Tyers, and Daniel Zeman. 2020. Universal Dependencies v2: An evergrowing multilingual treebank collection. In Proceedings of the 12th Language Resources and Evaluat… find
- Yonatan Oren, Shiori Sagawa, Tatsunori B. Hashimoto, and Percy Liang. 2019. Distributionally robust language modeling. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), p… find
- Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A survey on bias and fairness in machine learning. ACM Comput. Surv., 54(6). find our card
- Bhargavi Paranjape, Mandar Joshi, John Thickstun, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2020. An information bottleneck approach for controlling conciseness in rationale extraction. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1938– 19… find
- Antonio Valerio Miceli Barone. 2016. Towards cross-lingual distributed representations without parallel text trained with adversarial autoencoders. In Proceedings of the 1st Workshop on Representation Learning for NLP, pages 121–126, Berlin, Germany. Association for Computational Linguistics. find
- Michael Paul and Roxana Girju. 2009. Cross-cultural analysis of blogs and forums with mixed-collection topic models. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pages 1408–1417, Singapore. Association for Computational Linguistics. find
- Walter D. Mignolo. 2012. Local Histories/Global Designs: Coloniality, Subaltern Knowledges, and Border Thinking. Princeton University Press. find
- Ellie Pavlick and Tom Kwiatkowski. 2019. Inherent disagreements in human textual inferences. Transactions of the Association for Computational Linguistics, 7:677–694. find our card
- Shakir Mohamed, Marie-Therese Png, and William Isaac. 2020. Decolonial AI: Decolonial theory as sociotechnical foresight in artificial intelligence. Philosophy & Technology, 33(4):659–684. find
- Cristina Mora. 2013. Cultures and organizations: Software of the mind intercultural cooperation and its importance for survival. Journal of Media Research, 6(1):65. find
- Namrata Mukhija, Monojit Choudhury, and Kalika Bali. 2021. Designing language technologies for social good: The road not taken. find
- G. P. Murdock. 1970. Kin term patterns and their distribution. Ethnology, 9(165). find
- Denis Peskov, Viktor Hangya, Jordan Boyd-Graber, and Alexander Fraser. 2021. Adapting entities across languages and cultures. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 3725–3750, Punta Cana, Dominican Republic. Association for Computational Linguistics. find
- Dennis A. Pitta, Fung Hung-Gay, and Steven Isberg. 1999. Ethical issues across cultures: Managing the differing perspectives of China and the USA. The Journal of Consumer Marketing, 16(3):240–246. Copyright - Copyright MCB UP Limited (MCB) 1999; Last updated - 2021-09-09; SubjectsTermNotL-itGenreTex… find
- Barbara Plank, Dirk Hovy, and Anders Søgaard. 2014. Learning part-of-speech taggers with inter-annotator agreement loss. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pages 742–751, Gothenburg, Sweden. Association for Computational Li… find
- Melissa Roemmele, Cosmin Adrian Bejan, and Andrew S. Gordon. 2011. Choice of plausible alternatives: An evaluation of commonsense causal reasoning. In Logical Formalizations of Commonsense Reasoning, Papers from the 2011 AAAI Spring Symposium, Technical Report SS-11-06, Stanford, California, USA, Ma… find
- Edoardo Maria Ponti, Rahul Aralikatte, Disha Shrivastava, Siva Reddy, and Anders Søgaard. 2021. Minimax and neyman–Pearson meta-learning for outlier languages. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 1245–1260, Online. Association for Computational Lingui… find
- Rishiraj Saha Roy, Aishwarya Padmakumar, Guna Prasaad Jeganathan, and Ponnurangam Kumaraguru. 2015. Automated linguistic personalization of targeted marketing messages mining user-generated text on social media. In International Conference on Intelligent Text Processing and Computational Linguistics… find
- Edoardo Maria Ponti, Goran Glavaš, Olga Majewska, Qianchu Liu, Ivan Vulić, and Anna Korhonen. 2020. XCOPA: A multilingual dataset for causal commonsense reasoning. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2362–2376, Online. Association… find our card
- Sebastian Ruder, Noah Constant, Jan Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, and Melvin Johnson. 2021. XTREME-R: Towards more challenging and nuanced multilingual evaluation. CoRR, abs/2104.07412. find our card
- Vinodkumar Prabhakaran, Aida Mostafazadeh Davani, and Mark Diaz. 2021. On releasing annotator-level labels and information in datasets. In Proceedings of The Joint 15th Linguistic Annotation Workshop (LAW) and 3rd Designing Meaning Representations (DMR) Workshop, pages 133–138, Punta Cana, Dominican… find
- Shrimai Prabhumoye, Yulia Tsvetkov, Ruslan Salakhutdinov, and Alan W Black. 2018. Style transfer through back-translation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 866–876, Melbourne, Australia. Association for Computat… find our card
- Carina E. A. Prunkl, Carolyn Ashurst, Markus Anderljung, Helena Webb, Jan Leike, and Allan Dafoe. 2021. Institutionalizing ethics in AI through broader impact requirements. Nature Machine Intelligence, 3(2):104–110. find
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140):1–67. find
- Ehud Reiter. 2018. A structured review of the validity of BLEU. Computational Linguistics, 44(3):393–401. find our card
- Dor Ringel, Gal Lavee, Ido Guy, and Kira Radinsky. 2019. Cross-cultural transfer learning for text classification. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages… find
- Andrew G Ryder, Jian Yang, Xiongzhao Zhu, Shuqiao Yao, Jinyao Yi, Steven J Heine, and R Michael Bagby. 2008. The cultural shaping of depression: Somatic symptoms in China, psychological symptoms in North America? Journal of abnormal psychology, 117(2):300. find
- Shiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, and Percy Liang. 2020. Distributionally Robust Neural Networks. In International Conference on Learning Representations. find
- Magnus Sahlgren, Fredrik Carlsson, Fredrik Olsson, and Love Börjeson. 2021. It’s basically the same language anyway: the case for a nordic language model. In Proceedings of the 23rd Nordic Conference on Computational Linguistics (NoDaLiDa), pages 367– 372, Reykjavik, Iceland (Online). Linköping Univ… find
- Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi, and Noah A. Smith. 2019. The risk of racial bias in hate speech detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1668–1678, Florence, Italy. Association for Computational Linguistics. find our card
- Maarten Sap, Vered Shwartz, Antoine Bosselut, Yejin Choi, and Dan Roth. 2020. Commonsense reasoning for natural language processing. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts, pages 27–33, Online. Association for Computational Ling… find
- Marie Schäfer, Daniel B. M. Haun, and Michael Tomasello. 2015. Fair is not fair everywhere. Psychological Science, 26(8):1252–1260. PMID: 26115962. find
- P S Seibert, P Stridh-Igo, and C G Zimmerman. 2002. A checklist to facilitate cultural awareness and sensitivity. Journal of Medical Ethics, 28(3):143–146. find
- Tianxiao Shen, Tao Lei, Regina Barzilay, and Tommi Jaakkola. 2017. Style transfer from non-parallel text by cross-alignment. In Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc. find our card
- Vered Shwartz. 2022. Good night at 4 pm?! Time expressions in different cultures. In Findings of ACL. find
- Richard A Shweder, Jacqueline J Goodnow, Giyoo Hatano, Robert A LeVine, Hazel R Markus, and Peggy J Miller. 2007. The cultural psychology of development: One mind, many mentalities. Handbook of child psychology, 1. find
- Shikhar Singh, Nuan Wen, Yu Hou, Pegah Alipoormolabashi, Te-lin Wu, Xuezhe Ma, and Nanyun Peng. 2021. COM2SENSE: A commonsense reasoning benchmark with complementary sentences. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 883–898, Online. Association for Compu… find
- Anders Søgaard, Sebastian Ruder, and Ivan Vulić. 2018. On the limitations of unsupervised bilingual dictionary induction. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 778–788, Melbourne, Australia. Association for Computat… find our card
- Anders Søgaard, Ivan Vulić, Sebastian Ruder, and Manaal Faruqui. 2019. Cross-lingual word embeddings. Synthesis Lectures on Human Language Technologies, 12(2):1–132. find
- Irene Solaiman and Christy Dennison. 2021. Process for adapting language models to society (PALMS) with values-targeted datasets. Advances in Neural Information Processing Systems, 34. find
- Xingyi Song, Trevor Cohn, and Lucia Specia. 2013. BLEU deconstructed: Designing a better MT evaluation metric. Int. J. Comput. Linguistics Appl., 4:29– 44. find
- Statistical Machine Translation (S2MT 2015), pages 11–22, Beijing, China. Association for Computational Linguistics. find
- Jimin Sun, Hwijeen Ahn, Chan Young Park, Yulia Tsvetkov, and David R. Mortensen. 2021. Cross-cultural similarity features for cross-lingual transfer learning of pragmatically motivated tasks. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguisti… find
- Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, and William Yang Wang. 2019. Mitigating gender bias in natural language processing: Literature review. In Proceedings of the 57th Annual Meeting of the Association for Computati… find our card
- Zeerak Talat, Hagen Blix, Josef Valvoda, Maya Indira Ganesh, Ryan Cotterell, and Adina Williams. 2021. A word on machine ethics: A response to Jiang et al. (2021). find
- Jenny Thomas. 1983. Cross-Cultural Pragmatic Failure. Applied Linguistics, 4(2):91–112. find
- Jean-Paul Vinay and Jean Darbelnet. 1995. Comparative stylistics of French and English: A methodology for translation, volume 11. John Benjamins Publishing. find
- Kellie Webster, Xuezhi Wang, Ian Tenney, Alex Beutel, Emily Pitler, Ellie Pavlick, Jilin Chen, Ed Chi, and Slav Petrov. 2021. Measuring and reducing gendered correlations in pre-trained models. arXiv preprint. find our card
- Anna Wierzbicka. 1996. Semantics: Primes and Universals. Oxford University Press. find
- Anna Wierzbicka. 2009. Cross-cultural pragmatics. De Gruyter Mouton. find
- Lucia Specia, Stella Frank, Khalil Sima’an, and Desmond Elliott. 2016. A shared task on multimodal machine translation and crosslingual image description. In Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers, pages 543–553, Berlin, Germany. Association for Comp… find our card
- Steven Wilson, Rada Mihalcea, Ryan Boyd, and James Pennebaker. 2016. Disentangling topic models: A cross-cultural analysis of personal values through words. In Proceedings of the First Workshop on NLP and Computational Social Science, pages 143– 152, Austin, Texas. Association for Computational Ling… find
- Ami D Sperber, Robert F Devellis, and Brian Boehlecke. 1994. Cross-cultural translation: Methodology and validation. Journal of cross-cultural psychology, 25(4):501–524. find
- Walt Wolfram and William C. Friday. 1997. The role of dialect differences in cross-cultural communication: Proactive dialect awareness. Bulletin VALS-ASLA (Association suisse de linguistique appliquée), 65:143–154. find
- James P. Spradley. 1972. Culture and Cognition: Rules, Maps, and Plans. Chandler Publishing Company. find
- Elior Sulem, Omri Abend, and Ari Rappoport. 2015. Conceptual annotations preserve structure across translations: A French-English case study. In Proceedings of the 1st Workshop on Semantics-Driven Ian Woodward. 2007. Understanding Material Culture. SAGE Publications. find
- Shijie Wu and Mark Dredze. 2019. Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 833–844,… find our card
- Runxin Xu, Jun Cao, Mingxuan Wang, Jiaze Chen, Hao Zhou, Ying Zeng, Yuping Wang, Li Chen, Xiang Yin, Xijin Zhang, Songcheng Jiang, Yuxuan Wang, and Lei Li. 2020. Xiaomingbot: A Multilingual Robot News Reporter. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistic… find
- Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021. mT5: A massively multilingual pre-trained text-to-text transformer. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Ling… find
- Sheng Zhang, Xin Zhang, Weiming Zhang, and Anders Søgaard. 2021. Sociolectal analysis of pretrained language models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 4581–4588, Online and Punta Cana, Dominican Republic. Association for Computational Li… find
- Jieyu Zhao, Tianlu Wang, Mark Yatskar, Ryan Cotterell, Vicente Ordonez, and Kai-Wei Chang. 2019. Gender bias in contextualized word embeddings. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1… find our card
- Chunting Zhou, Daniel Levy, Xian Li, Marjan Ghazvininejad, and Graham Neubig. 2021. Distributionally robust multilingual machine translation. find
- David Yarowsky, Grace Ngai, and Richard Wicentowski. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of the First International Conference on Human Language Technology Research. find
- Da Yin, Liunian Harold Li, Ziniu Hu, Nanyun Peng, and Kai-Wei Chang. 2021. Broaden the vision: Geo-diverse visual commonsense reasoning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 2115–2129, Online and Punta Cana, Dominican Republic. Association… find
- Marcos Zampieri, Preslav Nakov, and Yves Scherrer. 2020. Natural language processing for similar languages, varieties, and dialects: A survey. Natural Language Engineering, 26(6):595–612. find
- Ziqian Zeng, Wenxuan Zhou, Xin Liu, and Yangqiu Song. 2019. A variational approach to weakly supervised document-level multi-aspect sentiment classification. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… find
- Jianmin Zhang, Jin-ge Yao, and Xiaojun Wan. 2016. Towards constructing sports news from live text commentary. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1361–1371, Berlin, Germany. Association for Computational Linguistic… find
- Sheng Zhang, Xin Zhang, Weiming Zhang, and Anders Søgaard. 2020. Worst-case-aware curriculum learning for zero and few shot transfer. CoRR, abs/2009.11138. — [arXiv:2009.11138](https://arxiv.org/abs/2009.11138) find