Elamur Research⌕
☰
home / papers / 2025 / Survey of Cultural Awareness in Language Models: Text and Beyond

Survey of Cultural Awareness in Language Models: Text and Beyond

Paper · 2025 · Siddhesh Pawar, Junyeong Park, Jiho Jin et al.

Summary

Large language models now sit behind chatbots, assistants, search and recommendation tools used around the world. Their training data, however, come mostly from Western sources. As a result, they can stereotype, flatten identities or respond insensitively to users from other backgrounds.

This survey maps how the NLP, computer vision and HCI communities have tried to make both text-only and multimodal systems (image, video, audio) more culturally aware. The authors first ground the idea of culture in anthropology and psychology. They rely mainly on White (1959) and add Hall's (1976) contrast between high- and low-context communication.

Literature was gathered from arXiv, Google Scholar and the ACL Anthology and filtered with PRISMA, giving more than 300 works. The review covers:

  • data sources and dataset construction,
  • alignment and fine-tuning strategies,
  • benchmarks and regional coverage,
  • ethics and the role of HCI,
  • the use of culturally aligned models in social science.

A recurring finding is that evaluation still leans on multiple-choice tests of explicit knowledge, while implicit cues in open dialogue go largely unmeasured. The work serves as a structured entry point and research agenda for building culturally inclusive AI.

Key points

  • Scope: 300+ papers selected via the PRISMA procedure. Benchmarks are considered from 2016 onward and method papers on pretrained LLMs from 2018 onward. Sources include ACL venues, EMNLP, ICLR, ICML, ICCV, CVPR, CHI and CSCW.
  • Conceptual framework: culture is located along three dimensions:
    • inside individuals (beliefs, norms, knowledge),
    • in interaction between people,
    • in material artifacts such as tools and art.
  • Evaluation gap: multiple-choice questions dominate. Long-form generation is mostly judged by humans or LLM-as-a-judge, and robust culture-specific automatic metrics are missing.
  • Vision data: web-scraped images suffer from availability, apprehension and negative set biases. The authors propose alternatives such as photographing objects with guidance from locals and anthropologists, or using frames from regional TV and video.
  • Future directions:
    • balance culture-specific models with broad cross-cultural ones,
    • study real users' reactions to cultural (mis)alignment.
  • Resources: a companion paper list is available at github.com/siddheshih/culture-awareness-llms. The article is published under the CC BY-NC-ND 4.0 license.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

Cite

Cite as Siddhesh Pawar, Junyeong Park, Jiho Jin, Arnav Arora, Junho Myung, Srishti Yadav, Faiz Ghifari Haznitrama, Inhwa Song, Alice Oh and Isabelle Augenstein. 2025. Survey of Cultural Awareness in Language Models: Text and Beyond. Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.1162/coli.a.14

@article{pawar2025survey,
  title = {{Survey of Cultural Awareness in Language Models: Text and Beyond}},
  author = {Siddhesh Pawar, Junyeong Park, Jiho Jin, Arnav Arora, Junho Myung, Srishti Yadav, Faiz Ghifari Haznitrama, Inhwa Song, Alice Oh and Isabelle Augenstein},
  journal = {Computational Linguistics},
  year = {2025},
  doi = {10.1162/coli.a.14},
  url = {https://doi.org/10.1162/coli.a.14}
}

References

183 references, 42 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. A, Pranav and Isabelle Augenstein. 2020. 2kenize: Tying subword sequences for Chinese script conversion. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7257–7272. https://doi.org/10.18653/v1/2020.acl -main.648 Abbasi, Mohammad Amin, Arash Ghafouri,… ↗
  2. Al-Laith, Ali, Daniel Hershcovich, Jens Bjerring-Hansen, Jakob Ingemann Parby, Alexander Conroy, and Timothy R. Tangherlini. 2024. Noise, novels, numbers. A framework for detecting and categorizing noise in Danish and Norwegian literature. In Proceedings of the 2024 Conference on Empirical Methods i… find
  3. AlKhamissi, Badr, Muhammad ElNokrashy, Mai Alkhamissi, and Mona Diab. 2024. Investigating cultural alignment of large language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12404–12422. https://doi.org/10.18653/v1/2… ↗
  4. Aloui, Manel, Hasna Chouikhi, Ghaith Chaabane, Haithem Kchaou, and Chehir Dhaouadi. 2024. 101 billion Arabic words dataset. ArXiv preprint, abs/2405.01590.
  5. Alyafeai, Zaid, Khalid Almubarak, Ahmed Ashraf, Deema Alnuhait, Saied Alshahrani, Gubran Abdulrahman, Gamil Ahmed, Qais Gawah, Zead Saleh, Mustafa Ghaleb, Yousef Ali, and Maged Al-shaibani. 2024. CIDAR: Culturally relevant instruction dataset for Arabic. In Findings of the Association for Computatio… find
  6. The MuSe 2024 multimodal sentiment analysis challenge: Social perception and humor recognition. find
  7. ArXiv preprint, abs/2406.07753. https://doi.org/10.1145/3689062.3689088 Amiriparian, Shahin, Filip Packań, Maurice Gerczuk, and Björn W. Schuller. 2024b. ExHuBERT: Enhancing HuBERT through block extension and fine-tuning on 37 emotion datasets. ArXiv preprint, abs/2406.10275. https://doi.org/10 .… ↗
  8. Antol, Stanislaw, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C. Lawrence Zitnick, and Devi Parikh. 2015. VQA: Visual question answering. In 2015 IEEE International Conference on Computer Vision, ICCV 2015, pages 2425–2433. https://doi.org/10.1109/ICCV .2015.279 Arango Monnar, Ayme… ↗
  9. Arvai, Joseph. 2013. Thinking, fast and slow, Daniel Kahneman, Farrar, Straus & Giroux. Journal of Risk Research, 16(10):1322–1324. https://doi.org/10 .1080/13669877.2013.766389 Asai, Akari, Jungo Kasai, Jonathan Clark, Kenton Lee, Eunsol Choi, and Hannaneh Hajishirzi. 2021. XOR QA: Cross-lingual op… find
  10. Bai, Yuelin, Xinrun Du, Yiming Liang, Yonggang Jin, Ziqiang Liu, Junting Zhou, Tianyu Zheng, Xincheng Zhang, Nuo Ma, Zekun Wang, et al. 2024. COIG-CQIA: Quality is all you need for Chinese instruction fine-tuning. ArXiv preprint, abs/2403.18058. find
  11. Bail, Christopher A. 2024. Can generative AI improve social science? Proceedings of the National Academy of Sciences, 121(21):e2314021121. https://doi.org/10.1073/pnas.2314021121, PubMed: 38722813 Balestrucci, Pier Felice, Silvia Casola, Soda Marem Lo, Valerio Basile, and Alessandro Mazzei. 2024. I… ↗
  12. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 14480–14494. https://doi.org/10 .18653/v1/2024.findings-emnlp.847 Bann, Eugene Y. and Joanna J. Bryson. 2013. Measuring cultural relativity of emotional valence and arousal using semantic clustering and Twitter. In COGSC… find
  13. Bansal, Hritik, Da Yin, Masoud Monajatipoor, and Kai-Wei Chang. 2022. How well can text-to-image generative models understand ethical natural language interventions? In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 1358–1370. https://doi.org/10 .18653/… find
  14. Bashkow, Ira. 2004. A neo-Boasian conception of cultural boundaries. American Anthropologist, 106(3):443–458. find
  15. Basu, Abhipsa, R. Venkatesh Babu, and Danish Pruthi. 2023. Inspecting the geographical representativeness of images from text-to-image models. In IEEE/CVF International Conference on Computer Vision, ICCV 2023, pages 5113–5124. https://doi.org/10.1109/ICCV51070.2023 .00474 Bayramli, Zahra, Ayhan Su… ↗
  16. Beck, Tilman, Hendrik Schuff, Anne Lauscher, and Iryna Gurevych. 2024. Sensitivity, performance, robustness: Deconstructing the effect of sociodemographic prompting. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)…
  17. Bender, Emily M., Timnit Gebru, Angelina McMillan-Major, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pages 610–623. https://doi.org/10.1145/3442188 .344… — [doi:10.1145/3442188](https://doi.org/10.1145/3442188) ↗
  18. Bennett III, Robert H., Paul A. Fadil, and Robin T. Greenwood. 1994. Cultural alignment in response to strategic organizational change: New considerations for a change framework. Journal of Managerial Issues, pages 474–490. find
  19. Berger, Arthur Asa. 2004. Deconstructing Travel: Cultural Perspectives on Tourism. find
  20. Rowman Altamira. Bhakthavatsalam, Sumithra, Chloe Anastasiades, and Peter Clark. 2020. GenericsKB: A knowledge base of generic statements. ArXiv preprint, abs/2005.00660. find
  21. Bhatia, Mehar and Vered Shwartz. 2023. GD-COMET: A geo-diverse commonsense inference model. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7993–8001. https://doi.org/10.18653/v1/2023 .emnlp-main.496 Bhatt, Shaily and Fernando Diaz. 2024. Extrinsic ev… ↗
  22. David McKay Company. Bongini, Pietro, Federico Becattini, Andrew D. Bagdanov, and Alberto Del Bimbo. 2020. Visual question answering for cultural heritage. In IOP Conference Series: Materials Science and Engineering, volume 949, page 012074. https://doi.org/10.1088/1757-899X/949/1/012074 Borah, Ang… ↗
  23. Burton, Jason W., Ezequiel Lopez-Lopez, Shahar Hechtlinger, Zoe Rahwan, Samuel Aeschbach, Michiel A. Bakker, Joshua A. Becker, Aleks Berditchevskaia, Julian Berger, Levin Brinkmann, et al. 2024. How large language models can reshape collective intelligence. Nature Human Behaviour, 8(9):1643–1655. ht… find
  24. Cahyawijaya, Samuel, Holy Lovenia, Fajri Koto, Rifki Afina Putri, Emmanuel Dave, Jhonson Lee, Nuur Shadieq, Wawan Cenggoro, Salsabil Maulana Akbar, Muhammad Ihza Mahendra, et al. 2024b. Cendol: Open instruction-tuned generative large language models for Indonesian languages. ArXiv preprint, abs/2404… find
  25. Cao, Yong, Min Chen, and Daniel Hershcovich. 2024. Bridging cultural nuances in dialogue agents through cultural value surveys. In Findings of the Association for Computational Linguistics: EACL 2024, pages 929–945.
  26. Cao, Yong, Yova Kementchedjhieva, Ruixiang Cui, Antonia Karamolegkou, Li Zhou, Megan Dare, Lucia Donatelli, and Daniel Hershcovich. 2024b. Cultural adaptation of recipes. Transactions of the Association for Computational Linguistics, 12:80–99. https://doi.org/10.1162/tacl a 00634 Cao, Yong, Wenyan… ↗
  27. Pew Global Attitudes Survey. Accessed: 2022. find
  28. Cetinic, Eva. 2022. The myth of culturally agnostic AI models. ArXiv preprint, abs/2211.15271. — [arXiv:2211.15271](https://arxiv.org/abs/2211.15271) find
  29. CH-Wang, Sky, Arkadiy Saakyan, Oliver Li, Zhou Yu, and Smaranda Muresan. 2023. Sociocultural norm similarities and differences via situational alignment and explainable textual entailment. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 3548–3564. htt… find
  30. Chang, Chen-Chi, Ching-Yuan Chen, Hung-Shin Lee, and Chih-Cheng Lee. 2024. Benchmarking cognitive domains for LLMs: Insights from Taiwanese Hakka culture. ArXiv preprint, abs/2409.01556. https://doi.org/10.1109/O -COCOSDA64382.2024.10800594 Chen, Andong, Lianzhang Lou, Kehai Chen, Xuefeng Bai, Yang…
  31. Chen, Lichang, Shiyang Li, Jun Yan, Hai Wang, Kalpa Gunaratna, Vikas Yadav, Zheng Tang, Vijay Srinivasan, Tianyi Zhou, Heng Huang, and Hongxia Jin. 2024b. AlpaGasus: Training a better Alpaca with fewer data. In the Twelfth International Conference on Learning Representations.
  32. Chen, Po-Heng, Sijia Cheng, Wei-Lin Chen, Yen-Ting Lin, and Yun-Nung Chen. 2024c. Measuring Taiwanese Mandarin language understanding. arXiv:2403.20180. — [arXiv:2403.20180](https://arxiv.org/abs/2403.20180) find
  33. Cheng, Myra, Esin Durmus, and Dan Jurafsky. 2023. Marked personas: Using natural language prompts to measure stereotypes in language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1504–1532. https://doi.org/10.18653/v…
  34. Cho, Jaemin, Abhay Zala, and Mohit Bansal. 2023. DALL-EVAL: Probing the reasoning skills and social biases of text-to-image generation models. In IEEE/CVF International Conference on Computer Vision, ICCV 2023, pages 3020–3031. https://doi.org/10.1109/ICCV51070.2023 .00283 Choenni, Rochelle, Anne L… ↗
  35. Clarke, Christopher, Roland Daynauth, Jason Mars, Charlene Wilkinson, and Hubert Devonish. 2024. GuyLingo: The Republic of Guyana Creole corpora. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume… find
  36. Davis, Ernest and Gary Marcus. 2015. Commonsense reasoning and commonsense knowledge in artificial intelligence. Communications of the ACM, 58(9):92–103. https://doi.org/10 .1145/2701413 De Angelis, Luigi, Francesco Baglivo, Guglielmo Arzilli, Gaetano Pierpaolo Privitera, Paolo Ferragina, Alberto Eu… find
  37. Deng, Juntao, Xu Cao, and Bingqi Cheng. 2024. Research on generating cultural relic images based on a low-rank adaptive diffusion model. In Proceedings of the 2024 Guangdong-Hong Kong-Macao Greater Bay Area International Conference on Digital Economy and Artificial Intelligence, pages 629–634. https… find
  38. Ding, Bosheng, Junjie Hu, Lidong Bing, Mahani Aljunied, Shafiq Joty, Luo Si, and Chunyan Miao. 2022. GlobalWoZ: Globalizing MultiWoZ to develop multilingual task-oriented dialogue systems. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Pape… find
  39. Dubois, Yann, Chen Xuechen Li, Rohan Taori, Tianyi Zhang, Ishaan Gulrajani, Jimmy Ba, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023. AlpacaFarm: A simulation framework for methods that learn from human feedback. In Advances in Neural Information Processing Systems 36: Annual Confere…
  40. Dwivedi, Ashutosh, Pradhyumna Lavania, and Ashutosh Modi. 2023. EtiCor: Corpus for analyzing LLMs for etiquettes. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 6921–6931. https://doi.org/10.18653/v1/2023 .emnlp-main.428 Elmadany, AbdelRahim, Ife Ade… ↗
  41. Cross-cultural Research Methods. Rowman Altamira. Ennen, Philipp, Po-Chun Hsu, Chan-Jan Hsu, Chang-Le Liu, Yen-Chen Wu, Yin-Hsiang Liao, Chin-Tung Lin, Da-Shan Shiu, and Wei-Yun Ma. 2023. Extending the pre-training of bloom for improved support of traditional Chinese: Models, methods and results. ar… — [arXiv:2303.04715](https://arxiv.org/abs/2303.04715) find
  42. Ersoy, Asım, Gerson Vizcarra, Tahsin Mayeesha, and Benjamin Muller. 2023. In what languages are generative language models the most formal? Analyzing formality distribution across languages. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 2650–2666. https://doi.org /1… ↗
  43. Etxaniz, Julen, Gorka Azkune, Aitor Soroa, Oier Lopez de Lacalle, and Mikel Artetxe. 2024. BertaQA: How much do language models know about local culture? ArXiv preprint, abs/2406.07302. — [arXiv:2406.07302](https://arxiv.org/abs/2406.07302) find
  44. Faisal, Fahim, Orevaoghene Ahia, Aarohi Srivastava, Kabir Ahuja, David Chiang, Yulia Tsvetkov, and Antonios Anastasopoulos. 2024. DIALECTBENCH: A NLP benchmark for dialects, varieties, and closely-related languages. ArXiv preprint, abs/2403.11009. https://doi.org/10.18653/v1/2024.acl-long.777 Fan,… ↗
  45. Forbes, Maxwell, Jena D. Hwang, Vered Shwartz, Maarten Sap, and Yejin Choi. 2020. Social chemistry 101: Learning to reason about social and moral norms. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 653–670. https://doi.org/10.18653/v1/2020… ↗
  46. Fung, Yi, Tuhin Chakrabarty, Hao Guo, Owen Rambow, Smaranda Muresan, and Heng Ji. 2023. NORMSAGE: Multi-lingual multi-cultural norm discovery from conversations on-the-fly. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 15217–15230. https://doi.org /… ↗
  47. Gehman, Samuel, Suchin Gururangan, Maarten Sap, Yejin Choi, and Noah A. Smith. 2020. RealToxicityPrompts: Evaluating neural toxic degeneration in language models. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3356–3369. https://doi.org/10.18653/v1/2020 .findings-emn… ↗
  48. Ghosh, Dhruba, Hannaneh Hajishirzi, and Ludwig Schmidt. 2023. GenEval: An object-focused framework for evaluating text-to-image alignment. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023. find
  49. Goldman, Josh and John K. Tsotsos. 2024. Statistical challenges with dataset construction: Why you will never have enough images. ArXiv preprint, abs/2408.11160. — [arXiv:2408.11160](https://arxiv.org/abs/2408.11160) find
  50. Greenwald, Anthony G., Debbie E. McGhee, and Jordan L. K. Schwartz. 1998. Measuring individual differences in implicit cognition: The implicit association test. Journal of Personality and Social Psychology, 74(6):1464. https://doi.org/10.1037//0022-3514.74.6.1464, PubMed: 9654756 Grossmann, Igor, M… — [doi:10.1037//0022-3514.74.6.1464](https://doi.org/10.1037//0022-3514.74.6.1464) ↗
  51. Beyond Culture. Anchor. Halpern, Ben. 1955. The dynamic elements of culture. Ethics, 65:235–249. https://doi.org/10.1086/291013 Hamilton, Mark, Stephanie Fu, Mindren Lu, Johnny Bui, Darius Bopp, Zhenbang Chen, Felix Tran, Margaret Wang, Marina Rogers, Lei Zhang, et al. 2021. MosAIc: Finding artisti… ↗
  52. Havaldar, Shreya, Salvatore Giorgi, Sunny Rai, Thomas Talhelm, Sharath Chandra Guntuku, and Lyle Ungar. 2024. Building knowledge-guided lexica to model cultural variation. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lang… find
  53. Hayati, Shirley Anugrah, Minhwa Lee, Dheeraj Rajagopal, and Dongyeop Kang. 2024. How far can we extract diverse perspectives from large language models? In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 5336–5366. https://doi.org/10.18653/v1/2024.emnlp… ↗
  54. Hee, Ming Shan, Shivam Sharma, Rui Cao, Palash Nandi, Preslav Nakov, Tanmoy Chakraborty, and Roy Ka-Wei Lee. 2024. Recent advances in hate speech moderation: Multimodality and the role of large models. ArXiv preprint, abs/2401.16727. https://doi.org/10 .18653/v1/2024.findings-emnlp.254 Hegde, Siddha… find
  55. Hendrycks, Dan, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021. Measuring massive multitask language understanding. In 9th International Conference on Learning Representations, ICLR 2021, OpenReview.net.
  56. Henrich, Joseph, Steven J. Heine, and Ara Norenzayan. 2010. The weirdest people in the world? Behavioral and Brain Sciences, 33(2–3):61–83. https://doi.org/10 .1017/S0140525X0999152X, PubMed: 20550733 Hershcovich, Daniel, Stella Frank, Heather Lent, Miryam de Lhoneux, Mostafa Abdou, Stephanie Brandl… — [doi:10.18653/v1/2022](https://doi.org/10.18653/v1/2022) find
  57. Heylighen, Francis and Jean-Marc Dewaele. 1999. Formality of language: definition, measurement and behavioral determinants. Interner Bericht, Center “Leo Apostel”, Vrije Universiteit Brüssel, 4(1). find
  58. Ho, Jonathan, William Chan, Chitwan Saharia, Jay Whang, Ruiqi Gao, Alexey Gritsenko, Diederik P. Kingma, Ben Poole, Mohammad Norouzi, David J. Fleet, et al. 2022. Imagen video: High definition video generation with diffusion models. ArXiv preprint, abs/2210.02303. — [arXiv:2210.02303](https://arxiv.org/abs/2210.02303) find
  59. Hobson, David G., Haiqi Zhou, Derek Ruths, and Andrew Piper. 2024. Story morals: Surfacing value-driven narrative schemas using large language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 12998–13032. https://doi.org/10.18653/v1/2024 .emnlp… ↗
  60. Hofstede, Geert, Gert Jan Hofstede, and Michael Minkov. 2010. Cultures and Organizations: Software of the Mind, third edition. find
  61. McGraw-Hill Professional. Holton, Robert. 2000. Globalization’s cultural consequences. The Annals of the American Academy of Political and Social Science, 570(1):140–152. https://doi.org/10 .1177/0002716200570001011 Horton, John J. 2023. Large language models as simulated economic agents: What can w… — [doi:10.18653/v1/2021.naacl](https://doi.org/10.18653/v1/2021.naacl) find
  62. Hsu, Chan Jan, Chang-Le Liu, Feng-Ting Liao, Po-Chun Hsu, Yi-Chang Chen, and Da shan Shiu. 2023. Advancing the evaluation of traditional Chinese language models: Towards a comprehensive benchmark suite. arXiv preprint arXiv:2309.08448. Hu, Songbo, Han Zhou, Mete Hergul, Milan Gritta, Guchun Zhang, I… find
  63. Huang, Yufei and Deyi Xiong. 2024. CBBQ: A Chinese bias benchmark dataset curated with human-AI collaboration for large language models. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 2917–2929. Hung… find
  64. Imai, Mutsumi, Junko Kanero, and Takahiko Masuda. 2016. The relation between language, culture, and thought. Current Opinion in Psychology, 8:70–77. https://doi.org/10.1016/j.copsyc.2015.10 .011, PubMed: 29506807 ImaniGooghari, Ayyoob, Peiqin Lin, Amir Hossein Kargaran, Silvia Severini, Masoud Jali… ↗
  65. Jakesch, Maurice, Advait Bhat, Daniel Buschek, Lior Zalmanson, and Mor Naaman. 2023. Co-writing with opinionated language models affects users’ views. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, Hamburg, Germany, April 23–28, 2023, pages 111:1–111:15. h… find
  66. Jiang, Ming and Mansi Joshi. 2024. CPopQA: Ranking cultural concept popularity by LLMs. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers), pages 615–630. https://doi.org/10.18653… find
  67. Jones, Ruth and Ann Irvine. 2013. The (un)faithful machine translator. In Proceedings of the 7th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities, pages 96–101. find
  68. Joshi, Pratik, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6282–6293. https://doi.org/10 .18653/v…
  69. Kabra, Anubha, Emmy Liu, Simran Khanuja, Alham Fikri Aji, Genta Winata, Samuel Cahyawijaya, Anuoluwapo Aremu, Perez Ogayo, and Graham Neubig. 2023. Multi-lingual and multi-cultural figurative language understanding. In Findings of the Association for Computational Linguistics: ACL 2023, pages 8269–8…
  70. Keleg, Amr and Walid Magdy. 2023. DLAMA: A framework for curating culturally diverse facts for probing the knowledge of pretrained language models. In Findings of the Association for Computational Linguistics: ACL 2023, pages 6245–6266. https://doi.org/10.18653/v1/2023.findings-acl .389 Khan, Shahi… ↗
  71. Kim, Haven, Jongmin Jung, Dasaem Jeong, and Juhan Nam. 2024b. K-pop lyric translation: Dataset, analysis, and neural-modelling. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 9974–9987. find
  72. Kim, Jaehong, Chaeyoon Jeong, Seongchan Park, Meeyoung Cha, and Wonjae Lee. 2024c. How do moral emotions shape political participation? A cross-cultural analysis of online petitions using language models. In Findings of the Association for Computational Linguistics ACL 2024, pages 16274–16289. https… find
  73. Kunda, Maithilee and Irina Rabkina. 2020. Creative captioning: An AI grand challenge based on the Dixit board game. ArXiv preprint, abs/2010.00048. — [arXiv:2010.00048](https://arxiv.org/abs/2010.00048) find
  74. Kuznetsova, Alina, Hassan Rom, Neil Alldrin, Jasper Uijlings, Ivan Krasin, Jordi Pont-Tuset, Shahab Kamali, Stefan Popov, Matteo Malloci, Alexander Kolesnikov, et al. 2020. The open images dataset V4: Unified image classification, object detection, and visual relationship detection at scale. Interna… — [doi:10.1007/s11263-020-01316-z](https://doi.org/10.1007/s11263-020-01316-z) find
  75. Ladhak, Faisal, Esin Durmus, Mirac Suzgun, Tianyi Zhang, Dan Jurafsky, Kathleen McKeown, and Tatsunori Hashimoto. 2023. When do pre-training biases propagate to downstream tasks? A case study in text summarization. In Proceedings of the 17th Conference of the European Chapter of the Association for… find
  76. Lee, Jiyoung, Minwoo Kim, Seungho Kim, Junghwan Kim, Seunghyun Won, Hwaran Lee, and Edward Choi. 2024a. KorNAT: LLM alignment benchmark for Korean social values and common knowledge. ArXiv preprint, abs/2402.13605. https://doi.org/10.18653/v1/2024 .findings-acl.666 Lee, Nayeon, Chani Jung, Junho Myu… ↗
  77. Li, Baiqi, Zhiqiu Lin, Deepak Pathak, Jiayao Emily Li, Xide Xia, Graham Neubig, Pengchuan Zhang, and Deva Ramanan. 2024a. GenAI-Bench: A holistic benchmark for compositional text-to-visual generation. In Synthetic Data for Computer Vision Workshop@ CVPR 2024. https://doi.org/10.1109/CVPRW63382.2024… ↗
  78. Li, Chengxi, Kai Fan, Jiajun Bu, Boxing Chen, Zhongqiang Huang, and Zhi Yu. 2023a. find
  79. Translate the beauty in songs: Jointly learning to align melody and translate lyrics. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 27–39. https://doi.org/10.18653/v1/2023.findings-emnlp.3 Li, Cheng, Damien Teney, Linyi Yang, Qingsong Wen, Xing Xie, and Jindong Wan… ↗
  80. Li, Chong, Wen Yang, Jiajun Zhang, Jinliang Lu, Shaonan Wang, and Chengqing Zong. 2024d. X-Instruction: Aligning language model in low-resource languages with self-curated cross-lingual instructions. In Findings of the Association for Computational Linguistics ACL 2024, pages 546–566. https://doi.or… ↗
  81. Li, Haonan, Yixuan Zhang, Fajri Koto, Yifei Yang, Hai Zhao, Yeyun Gong, Nan Duan, and Timothy Baldwin. 2024f. CMMLU: Measuring massive multitask language understanding in Chinese. In Findings of the Association for Computational Linguistics ACL 2024, pages 11260–11285. https://doi.org/10.18653/v1/20… ↗
  82. Li, Oliver, Mallika Subramanian, Arkadiy Saakyan, Sky C. H.-Wang, and Smaranda Muresan. 2023b. NormDial: A Comparable bilingual synthetic dialog dataset for modeling social norm adherence and violation. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages… find
  83. Li, Wei, Ren Ma, Jiang Wu, Chenya Gu, Jiahui Peng, Jinyang Len, Songyang Zhang, Hang Yan, Dahua Lin, and Conghui He. 2024h. FoundaBench: Evaluating Chinese fundamental knowledge capabilities of large language models. ArXiv preprint, abs/2404.18359. — [arXiv:2404.18359](https://arxiv.org/abs/2404.18359) find
  84. Li, Wenjun, Ying Cai, Ziyang Wu, Wenyi Zhang, Yifan Chen, Rundong Qi, Mengqi Dong, Peigen Chen, Xiao Dong, Fenghao Shi, et al. 2024i. A survey of foundation models for music understanding. ArXiv preprint, abs/2409.09601. — [arXiv:2409.09601](https://arxiv.org/abs/2409.09601) find
  85. Li, Wenyan, Crystina Zhang, Jiaang Li, Qiwei Peng, Raphael Tang, Li Zhou, Weijia Zhang, Guimin Hu, Yifei Yuan, Anders Søgaard, Daniel Hershcovich, and Desmond Elliott. 2024j. FoodieQA: A multimodal dataset for fine-grained understanding of Chinese food culture. In Proceedings of the 2024 Conference… find
  86. Lin, Tsung Yi, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Proceedings, Part V 13, pages 740–755. https://doi.org/10 .1007/978-…
  87. Liu, Bingshuai, Longyue Wang, Chenyang Lyu, Yong Zhang, Jinsong Su, Shuming Shi, and Zhaopeng Tu. 2023a. On the cultural gap in text-to-image generation. ArXiv preprint, abs/2307.02971. https://doi.org/10.3233/FAIA240581 — [doi:10.3233/faia240581](https://doi.org/10.3233/faia240581) ↗
  88. Liu, Chen, Gregor Geigle, Robin Krebs, and Iryna Gurevych. 2022a. FigMemes: A dataset for figurative language identification in politically-opinionated memes. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7069–7086. https://doi.org/10.18653/v1/2022… ↗
  89. Liu, Dayiheng, Kexin Yang, Qian Qu, and Jiancheng Lv. 2019. Ancient–modern Chinese translation with a new large training dataset. ACM Transactions on Asian and Low-Resource Language Information Processing, 19(1). https://doi.org/10.1145/3325887 — [doi:10.1145/3325887](https://doi.org/10.1145/3325887) ↗
  90. Liu, Emmy, Chenxuan Cui, Kenneth Zheng, and Graham Neubig. 2022b. Testing the ability of language models to interpret figurative language. In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4437–445…
  91. Liu, Yang, Meng Xu, Shuo Wang, Liner Yang, Haoyu Wang, Zhenghao Liu, Cunliang Kong, Yun Chen, Maosong Sun, and Erhong Yang. 2024c. OMGEval: An open multilingual generative evaluation benchmark for large language models. ArXiv preprint, abs/2402.13524. — [arXiv:2402.13524](https://arxiv.org/abs/2402.13524) find
  92. Liu, Zhi Song, Robin Courant, and Vicky Kalogeiton. 2024. FunnyNet-W: Multimodal learning of funny moments in videos in the wild. International Journal of Computer Vision, pages 1–22. https://doi.org/10.1007/s11263-024 -02000-2 Liu, Zhixuan, Youeun Shin, Beverley-Claire Okogwu, Youngsik Yun, Lia Col… — [doi:10.1007/s11263-024](https://doi.org/10.1007/s11263-024) ↗
  93. Liu, Zihan, Han Li, Anfan Chen, Renwen Zhang, and Yi-Chieh Lee. 2024d. Understanding public perceptions of AI conversational agents: A cross-cultural analysis. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3613904.3642840 Liu, Zoey, Crystal… ↗
  94. Ma, Weicheng, Samiha Datta, Lili Wang, and Soroush Vosoughi. 2022. EnCBP: A new benchmark dataset for finer-grained cultural background prediction in English. In Findings of the Association for Computational Linguistics: ACL 2022, pages 2811–2823. https://doi.org/10 .18653/v1/2022.findings-acl.221 M… find
  95. Makridis, Georgios, Athanasios Oikonomou, and Vasileios Koukos. 2024. FairyLandAI: Personalized fairy tales utilizing ChatGPT and DALLE-3. ArXiv preprint, abs/2407.09467. — [arXiv:2407.09467](https://arxiv.org/abs/2407.09467) find
  96. Manvi, Rohin, Samar Khanna, Marshall Burke, David B. Lobell, and Stefano Ermon. 2024. Large language models are geographically biased. In Proceedings of the 41st International Conference on Machine Learning, volume 235 of Proceedings of Machine Learning Research, pages 34654–34669. find
  97. Manzoor, Muhammad Arslan, Yuxia Wang, Minghan Wang, and Preslav Nakov. 2024. Can machines resonate with humans? Evaluating the emotional and empathic comprehension of LMs. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 14683–14701. https://doi.org/10.18653/v1/2024 .f… ↗
  98. Masud, Sarah, Sahajpreet Singh, Viktor Hangya, Alexander Fraser, and Tanmoy Chakraborty. 2024. Hate personified: Investigating the role of LLMs in content moderation. In Proceedings of the 2024 find
  99. Conference on Empirical Methods in Natural Language Processing, pages 15847–15863. https://doi.org/10.18653/v1/2024 .emnlp-main.886 Mathur, Leena, Ralph Adolphs, and Maja J. Matarić. 2023. Towards intercultural affect recognition: Audio-visual affect recognition in the wild across six cultures. In… ↗
  100. Meadows, Gwenyth Isobel, Nicholas Wai Long Lau, Eva Adelina Susanto, Chi Lok Yu, and Aditya Paul. 2024. LocalValueBench: A collaboratively built and extensible benchmark for evaluating localized value alignment and ethical safety in large language models. ArXiv preprint, abs/2408.01460. — [arXiv:2408.01460](https://arxiv.org/abs/2408.01460) find
  101. Menadue, Christopher Benjamin and Karen Diane Cheer. 2017. Human culture and science fiction: A review of the literature, 1980–2016. Sage Open, 7(3):2158244017723690. https://doi.org/10.1177/2158244017723690 Menicatti, Roberto, Barbara Bruno, and Antonio Sgorbissa. 2017. Modelling the influence of… — [doi:10.1177/2158244017723690](https://doi.org/10.1177/2158244017723690) ↗
  102. Migon Favaretto, Rodolfo, Soraia Raupp Musse, Angelo Brandelli Costa, Rodolfo Migon Favaretto, Soraia Raupp Musse, and Angelo Brandelli Costa. 2019. Detecting Hofstede cultural dimensions. Emotion, Personality and Cultural Aspects in Crowds: Towards a Geometrical Mind, pages 93–103. https://doi.org/… find
  103. Mim, Nusrat Jahan, Dipannita Nandi, Sadaf Sumyia Khan, Arundhuti Dey, and Syed Ishtiaque Ahmed. 2024. In-between visuals and visible: The impacts of text-to-image generative AI tools on digital image-making practices in the Global South. In Proceedings of the 2024 CHI Conference on Human Factors in…
  104. Mittal, Surbhi, Arnav Sudan, Mayank Vatsa, Richa Singh, Tamar Glaser, and Tal Hassner. 2024. Navigating text-to-image generative bias across Indic languages. ArXiv preprint, abs/2408.00283. https://doi.org/10.1007/978-3-031 -73223-2 4 Moghimifar, Farhad, Shilin Qu, Tongtong Wu, Yuan-Fang Li, and Gho… ↗
  105. Moradi, Armin, Nicola Neophytou, and Golnoosh Farnadi. 2024. Advancing cultural inclusivity: Optimizing embedding spaces for balanced music recommendations. ArXiv preprint, abs/2405.17607. — [arXiv:2405.17607](https://arxiv.org/abs/2405.17607) find
  106. Moseley, Christopher. 2010. Atlas of the World’s Languages in Danger. find
  107. Unesco. Mostafazadeh Davani, Aida, Mark Diaz, Dylan K. Baker, and Vinodkumar Prabhakaran. 2024. D3CODE: Disentangling disagreements in data across cultures on offensiveness detection and evaluation. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 1851… find
  108. Mukherjee, Anjishnu, Aylin Caliskan, Ziwei Zhu, and Antonios Anastasopoulos. 2024a. Global gallery: The fine art of painting culture portraits through multilingual instruction tuning. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics…
  109. Nadejde, Maria, Anna Currey, Benjamin Hsu, Xing Niu, Marcello Federico, and Georgiana Dinu. 2022. CoCoA-MT: A dataset and benchmark for contrastive controlled MT with application to formality. In Findings of the Association for Computational Linguistics: NAACL 2022, pages 616–632. https://doi.org/10…
  110. Narayan, Malur, John Pasmore, Elton Sampaio, Vijay Raghavan, and Gabriella Waters. 2024. Bias neutralization framework: Measuring fairness in large language models with bias intelligence quotient (BiQ). ArXiv preprint, abs/2404.18276. Navigli, Roberto, Simone Conia, and Björn Ross. 2023. Biases in… — [arXiv:2404.18276](https://arxiv.org/abs/2404.18276) find
  111. Nayak, Shravan, Kanishk Jain, Rabiul Awal, Siva Reddy, Sjoerd van Steenkiste, Lisa Anne Hendricks, Karolina Stańczak, and Aishwarya Agrawal. 2024. Benchmarking vision language models for cultural understanding. ArXiv preprint, abs/2407.10920. https://doi.org/10 .18653/v1/2024.emnlp-main.329 Naylor,…
  112. Culture and Change: An Introduction. Bloomsbury Publishing USA. Neiberg, Daniel, Petri Laukka, and Hillary Anger Elfenbein. 2011. Intra-, inter-, and cross-cultural classification of vocal affect. In Interspeech 2011, pages 1581–1584. https://doi.org/10.21437/Interspeech.2011-475 Neplenbroek, Vera,… — [doi:10.18653/v1/2022.acl-long](https://doi.org/10.18653/v1/2022.acl-long) ↗
  113. Prentice Hall New York. Nguyen, Thuat, Chien Van Nguyen, Viet Dac Lai, Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Ryan A. Rossi, and Thien Huu Nguyen. 2024. CulturaX: A cleaned, enormous, and multilingual dataset for large language models in 167 languages. In Proceedings of the 2024 Joint Intern…
  114. Nguyen, Tuan-Phong, Simon Razniewski, Aparna S. Varde, and Gerhard Weikum. 2023a. Extracting cultural commonsense knowledge at scale. In Proceedings of the ACM Web Conference 2023, WWW 2023, pages 1907–1917. https://doi.org/10 .1145/3543507.3583535 Nguyen, Tuan Phong, Simon Razniewski, and Gerhard W… find
  115. Nguyen, Xuan Phi, Wenxuan Zhang, Xin Li, Mahani Aljunied, Qingyu Tan, Liying Cheng, Guanzheng Chen, Yue Deng, Sen Yang, Chaoqun Liu, et al. 2023b. SeaLLMs–Large language models for Southeast Asia. ArXiv preprint, abs/2312.00738.
  116. Nigst, Lorenz, Maxim Romanov, Sarah Bowen Savant, Masoumeh Seydi, and Peter Verkinderen. 2021. OpenITI: A machine-readable corpus of Islamicate texts (2021.2. 5)[Data Set]. find
  117. Nisbett, Richard E. and Takahiko Masuda. 2003. Culture and point of view. Proceedings of the National Academy of Sciences of the United States of America, 100:11163–11170. https://doi.org/10 .1073/pnas.1934527100, PubMed: 12960375 Nivre, Joakim, Daniel Zeman, Filip Ginter, and Francis Tyers. 2017. U… find
  118. Nordhoff, Sebastian. 2012. Linked data for linguistic diversity research: Glottolog/Langdoc and ASJP online. In Linked Data in Linguistics: Representing and Connecting Language Data and Language Metadata. Springer, pages 191–200. https://doi.org/10.1007/978-3-642 -28249-2 18 Noroozi, Fatemeh, Cipria… — [doi:10.1007/978-3-642](https://doi.org/10.1007/978-3-642) ↗
  119. Ofer, Dan and Dafna Shahaf. 2022. Cards against AI: Predicting humor in a fill-in-the-blank party game. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5397–5403. https://doi.org/10.18653/v1/2022 .findings-emnlp.394 OpenAI. XXXX. ChatGPT. https://chat .openai.com/ Ope… ↗
  120. Owen, Louis, Vishesh Tripathi, Abhay Kumar, and Biddwan Ahmed. 2024. find
  121. Komodo: A linguistic expedition into Indonesia’s regional languages. ArXiv preprint, abs/2403.09362. Ozaki, Shintaro, Kazuki Hayashi, Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, and Taro Watanabe. 2024. Towards cross-lingual explanation of artwork in large-scale vision language models. ArXi… find
  122. Page, Matthew J., Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer, Jennifer M. Tetzlaff, Elie A. Akl, Sue E. Brennan, et al. 2021. find
  123. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372:n71. find
  124. Palta, Shramay and Rachel Rudinger. 2023. FORK: A bite-sized test set for probing culinary cultural biases in commonsense reasoning models. In Findings of the Association for Computational Linguistics: ACL 2023, pages 9952–9962. https://doi.org/10.18653/v1/2023 .findings-acl.631 Pandya, Keivalya and… ↗
  125. Pappas, Nikolaos, Miriam Redi, Mercan Topkara, Brendan Jou, Hongyi Liu, Tao Chen, and Shih-Fu Chang. 2016. Multilingual visual sentiment concept matching. In Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, pages 151–158. https://doi.org/10.1145/2911996.2912016 Parid… — [doi:10.1145/2911996.2912016](https://doi.org/10.1145/2911996.2912016) ↗
  126. Perez, Ethan, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. 2022. Red teaming language models with language models. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3419–3448. htt…
  127. Pipatanakul, Kunat, Phatrasek Jirabovonvisut, Potsawee Manakul, Sittipong Sripaisarnmongkol, Ruangsak Patomwong, Pathomporn Chokchainant, and Kasima Tharnpipitchai. 2023. Typhoon: Thai large language models. ArXiv preprint, abs/2312.13951. — [arXiv:2312.13951](https://arxiv.org/abs/2312.13951) find
  128. Pires, Ramon, Hugo Abonizio, Thales Sales Almeida, and Rodrigo Nogueira. 2023. Sabiá: Portuguese large language models. In Brazilian Conference on Intelligent Systems, pages 226–240. https://doi.org/10.1007/978-3-031-45392-2 15 Pistilli, Giada, Alina Leidinger, Yacine Jernite, Atoosa Kasirzadeh, A… ↗
  129. Pramanick, Shraman, Dimitar Dimitrov, Rituparna Mukherjee, Shivam Sharma, Md. Shad Akhtar, Preslav Nakov, and Tanmoy Chakraborty. 2021. Detecting harmful memes and their targets. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 2783–2796. https://doi.org/10 .18653…
  130. Radharapu, Bhaktipriya, Kevin Robinson, Lora Aroyo, and Preethi Lahoti. 2023. AART: AI-assisted red-teaming with diverse data generation for new LLM-powered applications. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 380–395. https:/… find
  131. Rai, Sunny, Khushang Zilesh Zaveri, Shreya Havaldar, Soumna Nema, Lyle Ungar, and Sharath Chandra Guntuku. 2024. A cross-cultural analysis of social norms in bollywood and hollywood movies. ArXiv preprint, abs/2402.11333. — [arXiv:2402.11333](https://arxiv.org/abs/2402.11333) find
  132. Ramesh, Aditya, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022. Hierarchical text-conditional image generation with clip latents. ArXiv preprint, abs/2204.06125.
  133. Ramezani, Aida and Yang Xu. 2023. Knowledge of cultural moral norms in large language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 428–446. https://doi.org/10.18653/v1/2023.acl-long.26 Ramponi, Alan. 2024. Language… ↗
  134. AVEC 2019 workshop and challenge: State-of-mind, detecting depression with AI, and cross-cultural affect recognition. In Proceedings of the 9th International on Audio/visual Emotion Challenge and Workshop, pages 3–12. https://doi.org/10.1145/3347320 .3357688 Rizwan, Hammad, Muhammad Haroon Shakeel,… ↗
  135. Roemmele, Melissa, Cosmin Adrian Bejan, and Andrew S. Gordon. 2011. Choice of plausible alternatives: An evaluation of commonsense causal reasoning. In 2011 AAAI Spring Symposium Series. find
  136. Rohmawati, Inayah Ahyana, Esti Junining, and Pratnyawati Nuridi Suwarso. 2022. The idioms and culture-specific items translation strategy for a classic novel. Journey: Journal of English Language and Pedagogy, 5(2):169–181. https://doi.org/10.33503/journey.v5i2.554 Rojas, William Gaviria, Sudnya Fr… ↗
  137. Ruiz, Nataniel, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. 2023. DreamBooth: Fine tuning text-to-image diffusion models for subject-driven generation. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2023, pages 22500–22510. https://doi.org… ↗
  138. Santurkar, Shibani, Esin Durmus, Faisal Ladhak, Cinoo Lee, Percy Liang, and Tatsunori Hashimoto. 2023. Whose opinions do language models reflect? In International Conference on Machine Learning, ICML 2023, 23–29 July 2023, volume 202 of Proceedings of Machine Learning Research, pages 29971–30004.
  139. Sap, Maarten, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. 2019. Social IQa: Commonsense reasoning about social interactions. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Process…
  140. Saxon, Michael and William Yang Wang. 2023. Multilingual conceptual coverage in text-to-image models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4831–4848. https://doi.org/10.18653/v1/2023.acl-long.266 Scao, Teven Le, An… ↗
  141. Schneider, Florian and Sunayana Sitaram. 2024. M5 –A diverse benchmark to assess the performance of large multimodal models across multilingual and multicultural vision-language tasks. ArXiv preprint, abs/2407.03791. https://doi.org/10.18653/v1/2024.findings -emnlp.250 Schramm, W. 1954. The Process… ↗
  142. Schuhmann, Christoph, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, Patrick Schramowski, Srivatsa Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, and Jenia Jitsev. 2022. LAION-5B: An open lar…
  143. Schulhoff, Sander, Michael Ilie, Nishant Balepur, Konstantine Kahadze, Amanda Liu, Chenglei Si, Yinheng Li, Aayush Gupta, HyoJung Han, Sevien Schulhoff, et al. 2024. The prompt report: A systematic survey of prompting techniques. arXiv preprint arXiv:2406.06608.
  144. Schwartz, Shalom H. 2012. An overview of the Schwartz theory of basic values. Online Readings in Psychology and Culture, 2(1):11. https://doi.org/10.9707/2307 -0919.1116 Scott, Michael ‘Adrir’, Sharath Chandra Guntuku, Huan Yang, Weisi Lin, and George Ghinea. 2015. Modelling human factors in percept… — [doi:10.9707/2307](https://doi.org/10.9707/2307) ↗
  145. Bobs-Merrill. Sengupta, Neha, Sunil Kumar Sahu, Bokang Jia, Satheesh Katipomu, Haonan Li, Fajri Koto, Osama Mohammed Afzal, Samta Kamboj, Onkar Pandit, Rahul Pal, et al. 2023. Jais and Jais-chat: Arabic-centric foundation and instruction-tuned open generative large language models. ArXiv preprint, a…
  146. Seth, Agrima, Sanchit Ahuja, Kalika Bali, and Sunayana Sitaram. 2024. DOSA: A dataset of social artifacts from different Indian geographical subcultures. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), page… find
  147. Shah, Priyanshi and Ziad Kobti. 2020. Multimodal fake news detection using a cultural algorithm with situational and normative knowledge. 2020 IEEE Congress on Evolutionary Computation (CEC), pages 1–7. https://doi.org/10.1109/CEC48606.2020.9185643 Shaikh, Omar, Caleb Ziems, William Held, Aryan Par… ↗
  148. Shad Akhtar, Dimitar Dimitrov, Giovanni Da San Martino, Hamed Firooz, Alon Y. Halevy, Fabrizio Silvestri, Preslav Nakov, and Tanmoy Chakraborty. 2022. Detecting and understanding harmful memes: A survey. In Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJ… find
  149. Song, Inhwa, Sachin R. Pendse, Neha Kumar, and Munmun De Choudhury. 2024. The typing cure: Experiences with large language model chatbots for mental health support. ArXiv preprint, abs/2401.14362. — [arXiv:2401.14362](https://arxiv.org/abs/2401.14362) find
  150. Speer, Robyn, Joshua Chin, and Catherine Havasi. 2017. ConceptNet 5.5: An Open multilingual graph of general knowledge. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4–9, 2017, San Francisco, California, USA, pages 4444–4451. https://doi.org /10.1609/aaai.v3… ↗
  151. Tam, Zhi Rui, Ya-Ting Pai, Yen-Wei Lee, Jun-Da Chen, Wei-Min Chu, Sega Cheng, and Hong-Han Shuai. 2024. An improved traditional Chinese evaluation suite for foundation model. arXiv preprint arXiv:2403.01858. — [arXiv:2403.01858](https://arxiv.org/abs/2403.01858) find
  152. Tang, Jingqun, Qi Liu, Yongjie Ye, Jinghui Lu, Shu Wei, Chunhui Lin, Wanqing Li, Mohamad Fitri Faiz Bin Mahmood, Hao Feng, Zhen Zhao, et al. 2024a. MTVQA: Benchmarking multilingual text-centric visual question answering. ArXiv preprint, abs/2405.11985. find
  153. Tang, Xuemei, Qi Su, Jun Wang, and Zekun Deng. 2024b. CHisIEC: An information extraction corpus for ancient Chinese history. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 3192–3202. Tao, Yan, Olga V… find
  154. Tran, Minh, Yufeng Yin, and Mohammad Soleymani. 2023. Personalized adaptation with pre-trained speech encoders for continuous emotion recognition. In 24th Annual Conference of the International Speech Communication Association, Interspeech 2023, pages 636–640. https://doi.org /10.21437/Interspeech.2… ↗
  155. Wagner, Claudia, Markus Strohmaier, Alexandra Olteanu, Emre Kıcıman, Noshir Contractor, and Tina Eliassi-Rad. 2021. Measuring algorithmically infused societies. Nature, 595(7866):197–204. https://doi.org/10.1038/s41586 -021-03666-1, PubMed: 34194046 Walker, Mirella, Fang Jiang, Thomas Vetter, and Sa… ↗
  156. Wang, Bin, Geyu Lin, Zhengyuan Liu, Chengwei Wei, and Nancy F. Chen. 2024a. CRAFT: Extracting and tuning cultural instructions from the wild. ArXiv preprint, abs/2405.03138. https://doi.org/10.18653/v1/2024.c3nlp-1.4 Wang, Bin, Zhengyuan Liu, Xin Huang, Fangkai Jiao, Yang Ding, AiTi Aw, and Nancy C… ↗
  157. Wang, Yuwei, Enmeng Lu, Zizhe Ruan, Yao Liang, and Yi Zeng. 2024f. Stream: Social data and knowledge collective intelligence platform for TRaining Ethical AI Models. AI & SOCIETY, pages 1–9. https://doi.org/10.1007/s00146-023-01851-6 Wang, Yuxuan, Yijun Liu, Fei Yu, Chen Huang, Kexin Li, Zhiguo Wan… ↗
  158. Weber, Maurice, Carlo Siebenschuh, Rory Butler, Anton Alexandrov, Valdemar Thanner, Georgios Tsolakis, Haris Jabbar, Ian T. Foster, Bo Li, Rick Stevens, and Ce Zhang. 2023. WordScape: A pipeline to extract multilingual, visually rich documents with layout annotations from Web crawl data. In Advances… find
  159. Weck, Benno, Ilaria Manco, Emmanouil Benetos, Elio Quinton, George Fazekas, and Dmitry Bogdanov. 2024. MuChoMusic: Evaluating music understanding in multimodal audio-language models. ArXiv preprint, abs/2408.01337. — [arXiv:2408.01337](https://arxiv.org/abs/2408.01337) find
  160. Wei, Yuting, Yuanxing Xu, Xinru Wei, Simin Yang, Yangfu Zhu, Yuqing Li, Di Liu, and Bin Wu. 2024. AC-EVAL: Evaluating ancient Chinese language understanding in large language models. ArXiv preprint, abs/2403.06574. https://doi.org/10.18653/v1/2024.findings-emnlp.87 Weidinger, Laura, Maribeth Rauh,… ↗
  161. White, Isadora, Sashrika Pandey, and Michelle Pan. 2024. Communicate to play: Pragmatic reasoning for efficient cross-cultural communication. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 12201–12216. https://doi.org/10.18653/v1/2024.findings-emnlp.711 White, Lesli… ↗
  162. MIT Press. Wibowo, Haryo, Erland Fuadi, Made Nityasya, Radityo Eko Prasojo, and Alham Aji. 2024. COPAL-ID: Indonesian language reasoning with local culture and nuances. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Languag… find
  163. Wunarso, Novita Belinda and Yustinus Eko Soelistio. 2017. Towards Indonesian speech-emotion automatic recognition (I-SpEAR). In 2017 4th International Conference on New Media Studies (CONMEDIA), pages 98–101. https://doi.org/10.1109/CONMEDIA.2017.8266038 Wuraola, Ifeoluwa, Nina Dethlefs, and Daniel… ↗
  164. Yang, Diyi, Caleb Ziems, William Held, Omar Shaikh, Michael S. Bernstein, and John Mitchell. 2024. Social skill training with large language models. ArXiv preprint, abs/2404.04204. — [arXiv:2404.04204](https://arxiv.org/abs/2404.04204) find
  165. Yao, Binwei, Ming Jiang, Tara Bobinac, Diyi Yang, and Junjie Hu. 2024a. Benchmarking machine translation with cultural awareness. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 13078–13096. https://doi.org/10.18653/v1/2024.findings-emnlp.765 ↗
  166. Yao, Jing, Xiaoyuan Yi, Yifan Gong, Xiting Wang, and Xing Xie. 2024b. Value FULCRA: Mapping large language models to the multidimensional spectrum of basic human value. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Languag… find
  167. Ye, Andre, Sebastin Santy, Jena D. Hwang, Amy X. Zhang, and Ranjay Krishna. 2023. Computer vision datasets and models exhibit cultural and linguistic diversity in perception. arXiv preprint arXiv:2310.14356v3. — [arXiv:2310.14356](https://arxiv.org/abs/2310.14356) find
  168. Ye, Fulong, Guang Liu, Xinya Wu, and Ledell Wu. 2024. AltDiffusion: A multilingual text-to-image diffusion model. In Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on… find
  169. Yin, Ziqi, Hao Wang, Kaito Horio, Daisuke Kawahara, and Satoshi Sekine. 2024. Should we respect LLMs? A cross-lingual study on the influence of prompt politeness on LLM performance. ArXiv preprint, abs/2402.14531. https://doi.org/10.18653/v1/2024.sicon-1.2 Yoo, Kang Min, Jaegeun Han, Sookyo In, Hee… ↗
  170. Young, Peter, Alice Lai, Micah Hodosh, and Julia Hockenmaier. 2014. From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions. Transactions of the Association for Computational Linguistics, 2:67–78. https://doi.org/10 .1162/tacl a 00166 Yu,… find
  171. Yuan, Ye, Kexin Tang, Jianhao Shen, Ming Zhang, and Chenguang Wang. 2024. Measuring social norms of large language models. In Findings of the Association for Computational Linguistics: NAACL 2024, pages 650–699. https://doi.org/10.18653/v1/2024.findings -naacl.43 Yun, Youngsik and Jihie Kim. 2024.… ↗
  172. Zhang, Gengyuan, Yurui Zhang, Kerui Zhang, and Volker Tresp. 2024c. Can vision-language models be a good guesser? Exploring VLMs for times and location reasoning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 636–645. https://doi.org/10.1109 /WACV57701.20… — [doi:10.1109/iccv.2017.629](https://doi.org/10.1109/iccv.2017.629) find
  173. Zhang, Wei, Wong Kam-Kwai, Biying Xu, Yiwen Ren, Yuhuai Li, Minfeng Zhu, Yingchaojie Feng, and Wei Chen. 2024g. CultiVerse: Towards cross-cultural understanding for paintings with large language model. ArXiv preprint, abs/2405.00435. — [arXiv:2405.00435](https://arxiv.org/abs/2405.00435) find
  174. Zhang, Wenjing, Siqi Xiao, Xuejiao Lei, Ning Wang, Huazheng Zhang, Meijuan An, Bikun Yang, Zhaoxiang Liu, Kai Wang, and Shiguo Lian. 2024h. Methodology of adapting large English language models for specific cultural contexts. ArXiv preprint, abs/2406.18192. find
  175. Zhang, Wenxuan, Mahani Aljunied, Chang Gao, Yew Ken Chia, and Lidong Bing. 2023. M3Exam: A multilingual, multimodal, multilevel benchmark for examining large language models. In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, Neu… find
  176. Zhang, Yigeng, Fabio Gonzalez, and Thamar Solorio. 2024. Interpreting themes from educational stories. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 9190–9203. find
  177. Zhang, Zhu, Jianxin Ma, Chang Zhou, Rui Men, Zhikang Li, Ming Ding, Jie Tang, Jingren Zhou, and Hongxia Yang. 2021. M6-UFC: Unifying multi-modal controls for conditional image synthesis via non-autoregressive generative transformers. ArXiv preprint, abs/2105.14211. — [arXiv:2105.14211](https://arxiv.org/abs/2105.14211) find
  178. Zhao, Jiaxu, Meng Fang, Zijing Shi, Yitong Li, Ling Chen, and Mykola Pechenizkiy. 2023. CHBias: Bias evaluation and mitigation of Chinese conversational language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13538–13… find
  179. Zhao, Yijun, Jiangyu Pan, Yan Dong, Tianshu Dong, Guanyun Wang, Fangtian Ying, Qihang Shen, and Jiacheng Cao. 2024b. Language urban odyssey: A serious game for enhancing second language acquisition through large language models. In Extended Abstracts of the CHI Conference on Human Factors in Computi… find
  180. Zhi-Xuan, Tan, Micah Carroll, Matija Franklin, and Hal Ashton. 2024. Beyond preferences in AI alignment. ArXiv preprint, abs/2408.16984. https://doi.org/10.1007/s11098-024 -02249-w Zhou, Bo, Qianglong Chen, Tianyu Wang, Xiaomi Zhong, and Yin Zhang. 2023a. WYWEB: A NLP evaluation benchmark for class… ↗
  181. Zhou, Wangchunshu, Yan Zeng, Shizhe Diao, and Xinsong Zhang. 2022. VLUE: A multi-task multi-dimension benchmark for evaluating vision-language pre-training. In International Conference on Machine Learning, ICML 2022, volume 162 of Proceedings of Machine Learning Research, pages 27395–27411. find
  182. Zhu, Shucheng, Weikang Wang, and Ying Liu. 2024. Quite good, but not enough: Nationality bias in large language models -a case study of ChatGPT. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 13489–1… find
  183. Ziems, Caleb, Jane Dwivedi-Yu, Yi-Chia Wang, Alon Halevy, and Diyi Yang. 2023. NormBank: A knowledge bank of situational social norms. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7756–7776. https://doi.org/10.18653/v1 /202…

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/pawar-2025-survey-cultural-awareness-language-models/