Elamur Research⌕
☰
home / papers / 2026 / Culture by Design: A Sociotechnical Framework for Culturally Grounded AI for Mental Health

Culture by Design: A Sociotechnical Framework for Culturally Grounded AI for Mental Health

Paper · 2026 · Sunny Rai, Elizabeth Stade, Graise Zhou et al.

Summary

Most AI tools for mental health are built on data from WEIRD populations, often scraped from a few English-dominant social platforms. This undermines their validity and fairness elsewhere, because the way people voice distress, present symptoms, seek help and disclose problems differs across cultures. The authors argue that culture should be a core design requirement from the start, not a patch applied afterwards. They call this principle "culture by design," modelled on privacy by design and ethics by design.

This is a position and framework paper, not an empirical study. It draws on NLP, HCI, clinical psychology and global mental health to propose ten recommendations, organised across three stages of the lifecycle: how data is designed, how models are built and assessed, and how systems are rolled out and governed. A figure contrasts where the global mental-health burden falls with where Facebook, Twitter and Reddit users are concentrated, showing that common data sources miss much of the world. The contribution is a practical roadmap for building mental-health AI that is equitable and fits local contexts.

Key points

  • Ten recommendations in three phases. Examples include:
    • defining the target population precisely
    • identifying cultural idioms of distress, such as "tension" in India and shenjing shuairuo in China
    • widening input modalities, for instance voice transcribed with ASR
    • involving communities in data collection
    • building multicultural competency
    • adapting to structural constraints
    • producing resources that benefit the target culture
  • Proposed minimum reporting for datasets and models:
    • data source and language(s)
    • distributions of country/region/race, age and gender
    • label provenance: self-report, clinical diagnosis or machine prediction
  • Figure 2 compares Global Burden of Disease 2021 prevalence with user shares on Facebook (2024), Twitter (2023) and Reddit (2023).
  • Governance proposals include:
    • review by local ethics boards in addition to the home institution's IRB
    • clear informed consent covering data withdrawal from trained models
    • a central public registry of mental-health apps
    • culturally relevant outcome measures, such as family well-being in collectivist settings
  • Stated limitation: the paper does not empirically measure how much any recommendation affects model performance, safety or equity.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

🎓Stanford UniversityStanford · United States434 works · 314,419 citations🎓University of PennsylvaniaPhiladelphia · United States221 works · 63,234 citations🎓University of Illinois Urbana-ChampaignUrbana · United States184 works · 69,372 citations

 Fields, topics and concepts

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Social Sciences · 1,772 worksPsychology · 1,552 worksSafety Research · 543 worksSocial Psychology · 306 worksApplied Psychology · 21 works

Cite

Cite as Sunny Rai, Elizabeth Stade, Graise Zhou, Neil Sehgal, Simone Schriger, Sara Gerke, Lyle Ungar and Sharath Chandra Guntuku. 2026. Culture by Design: A Sociotechnical Framework for Culturally Grounded AI for Mental Health. Proceedings of the 11th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026).

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.18653/v1/2026.clpsych-1.10

@inproceedings{rai2026culture,
  title = {{Culture by Design: A Sociotechnical Framework for Culturally Grounded AI for Mental Health}},
  author = {Sunny Rai, Elizabeth Stade, Graise Zhou, Neil Sehgal, Simone Schriger, Sara Gerke, Lyle Ungar and Sharath Chandra Guntuku},
  booktitle = {Proceedings of the 11th Workshop on Computational Linguistics and Clinical Psychology (CLPsych 2026)},
  year = {2026},
  doi = {10.18653/v1/2026.clpsych-1.10},
  url = {https://doi.org/10.18653/v1/2026.clpsych-1.10}
}

References

52 references, 5 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Carlos Aguirre, Keith Harrigian, and Mark Dredze. 2021. Gender and racial fairness in depression research using social media. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 2932–2949. Association for Computational Li… find
  2. Emily M. Bender and Batya Friedman. 2018. Data statements for natural language processing: Toward mitigating system bias and enabling better science. Transactions of the Association for Computational Linguistics, 6:587–604. find
  3. Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (technology) is power: A critical survey of “bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5454– 5476, Online. Association for Computational Linguistics.
  4. Philip Brey and Brandt Dainow. 2024. Ethics by design for artificial intelligence. AI and Ethics, 4(4):1265– 1277. find
  5. Jessica Bunyi, Kathryn E. Ringland, and Stephen M. Schueller. 2021. Accessibility and digital mental health: Considerations for more accessible and equitable mental health apps. Frontiers in Digital Health, 3:742196. find
  6. Moira Burke, Justin Cheng, and Benjamin de Gant. 2020. Social comparison and facebook: Feedback, positivity, and opportunities for comparison. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1–13, New York, NY, USA. Association for Computing Machinery. find
  7. R. R. Cabral and Timothy B. Smith. 2011. Racial/ethnic matching of clients and therapists in mental health services: A meta-analytic review of preferences, perceptions, and outcomes. Journal of Counseling Psychology, 58(4):537–554. find
  8. Clara Calia, Amit Chakrabarti, Emmanuel Sarabwe, and Anna Chiumento. 2023. Maximising impactful, locally relevant global mental health research conducted in low and middle income country settings: Ethical considerations. Wellcome open research, 7:240. find
  9. Ann Cavoukian. 2009. Privacy by design: The 7 foundational principles. Technical report, Information and Privacy Commissioner of Ontario, Toronto, Canada. find
  10. Yu Ying Chiu, Ashish Sharma, Inna Wanyin Lin, and Tim Althoff. 2024. A computational framework for behavioral assessment of llm therapists. arXiv preprint arXiv:2401.00820. — [arXiv:2401.00820](https://arxiv.org/abs/2401.00820) find
  11. Young Min Cho, Sunny Rai, Lyle Ungar, João Sedoc, and Sharath Guntuku. 2023. An integrative survey on mental health conversational agents to bridge computer science and medical perspectives. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 11346–11369,… find
  12. Catrin Cork, Bonnie N. Kaiser, and Ross G. White. 2019. The integration of idioms of distress into mental health assessments and interventions: A systematic review. Global Mental Health, 6:e7. find
  13. Alexander D’Amour, Katherine Heller, Dan Moldovan, Ben Adlam, Babak Alipanahi, Alex Beutel, Christina Chen, Jonathan Deaton, Jacob Eisenstein, Matthew D Hoffman, and 1 others. 2022. Underspecification presents challenges for credibility in modern machine learning. Journal of Machine Learning Researc… find
  14. Jean-Marc Dewaele, Konstantinos V Petrides, and Adrian Furnham. 2008. Effects of trait emotional intelligence and sociobiographical variables on communicative anxiety and foreign language anxiety among adult multilinguals: A review and empirical investigation. Language learning, 58(4):911–960. find
  15. Michael B First. 1997. Structured clinical interview for dsm-iv axis i disorders. Biometrics research department. find
  16. Xiaoqi Ge, Chenyue Xu, Donna Misaki, Hazel R. Markus, and Jeanne L. Tsai. 2024. How culture shapes what people want from AI. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 1–15, Honolulu, HI, USA. ACM. find
  17. Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé III, and Kate Crawford. 2021. Datasheets for datasets. Communications of the ACM, 64(12):86– 92. find
  18. Sara Gerke. 2022. Digital home health during the COVID-19 pandemic: Challenges to safety, liability, and informed consent, and the way to move forward. In Carmel Shachar, Christopher Robertson, I. Glenn Cohen, Timo Minssen, and W. Nicholson Price II, editors, The Future of Medical Device Regulation:… find
  19. Sara Gerke. 2023. "Nutrition Facts Labels" for Artificial Intelligence/Machine Learning-based medical devices-the urgent need for labeling standards. Geo. Wash. L. Rev., 91:79. find
  20. Sara Gerke. 2024. A comprehensive labeling framework for Artificial Intelligence (AI)/Machine Learning (ML)-based medical devices: From AI facts labels to a front-of-package AI labeling System—Lessons learned from food labeling. Emory LJ, 74:1297. find
  21. Sara Gerke, Ariel D Stern, and Timo Minssen. 2020. Germany’s digital health reforms in the covid-19 era: lessons and opportunities for other countries. NPJ digital medicine, 3(1):94. find
  22. Roxana Girju and Marina Girju. 2022. Design considerations for an nlp-driven empathy and emotion interface for clinician training via telemedicine. In Proceedings of the Second Workshop on Bridging Human–Computer Interaction and Natural Language Processing, pages 21–27. find
  23. Global Burden of Disease Collaborative Network. 2021. Global Burden of Disease Study 2021 (GBD 2021) Incidence, Prevalence, and Years Lived with Disability 1990–2015. https://ghdx.healthdata.org/ record/ihme-data/gbd-2015-incidence-preva lence-and-ylds-1990-2015. Accessed: 2024. ↗
  24. Gordon C. Nagayama Hall, A. Y. Ibaraki, Ellen R. Huang, C. Nathan Marti, and Eric Stice. 2016. A meta-analysis of cultural adaptations of psychological interventions. Behaviour Therapy, 47(6):993– 1014. find
  25. Keith Harrigian, Carlos Aguirre, and Mark Dredze. 2021. On the state of social media data for mental health research. In Proceedings of the Seventh Workshop on Computational Linguistics and Clinical Psychology: Improving Access, pages 15–24. find
  26. Shreya Havaldar, Bhumika Singhal, Sunny Rai, Langchen Liu, Sharath Chandra Guntuku, and Lyle Ungar. 2023. Multilingual language models are not multicultural: A case study in emotion. In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis,…
  27. Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. The weirdest people in the world? Behavioral and brain sciences, 33(2-3):61–83. find
  28. European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 535–574. find
  29. Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6282–6293, Online. Association for Comp…
  30. Anthony J Marsella and Ann Marie Yamada. 2000. Culture and mental health: An introduction and overview of foundations, concepts, and issues. In Handbook of multicultural mental health, pages 3–24. Elsevier. find
  31. Bonnie N Kaiser and Lesley Jo Weaver. 2019. Culture-bound syndromes, idioms of distress, and cultural concepts of distress: New directions for an old concept in psychological anthropology. Transcultural psychiatry, 56(4):589–598. find
  32. Simon Kemp. 2023. Digital 2023 April Global Statshot Report. https://datareportal.com/reports/d igital-2023-april-global-statshot. Twitter advertising audience share data at UN subregion level. Accessed: April 2023. ↗
  33. Heather A Kissel and Bruce H Friedman. 2023. Participant diversity in psychophysiology. Psychophysiology, 60(11):e14369. find
  34. Pang Wei Koh, Shiori Sagawa, Henrik Marklund, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Irena Gao, and 1 others. 2021. WILDS: A benchmark of in-the-wild distribution shifts. In Proceedings of the 38th International Conference on Machi… find
  35. Roberto Lewis-Fernández, Neil Krishan Aggarwal, Sofie Bäärnhielm, Hans Rohlof, Laurence J Kirmayer, Mitchell G Weiss, Sushrut Jadhav, Ladson Hinton, Renato D Alarcón, Dinesh Bhugra, and 1 others. 2014. Culture and psychiatric evaluation: operationalizing cultural formulation for dsm-5. Psychiatry: I… find
  36. Anqi Li, Yu Lu, Nirui Song, Shuai Zhang, Lizhi Ma, and Zhenzhong Lan. 2024. Understanding the therapeutic relationship between counselors and clients in online text-based counseling using llms. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 1280–1303. find
  37. Anqi Li, Lizhi Ma, Yaling Mei, Hongliang He, Shuai Zhang, Huachuan Qiu, and Zhenzhong Lan. 2023. Understanding client reactions in online mental health counseling. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10358– 10376. find
  38. Chen Cecilia Liu, Hiba Arnaout, Nils Kovačić, Dana Atzil-Slonim, and Iryna Gurevych. 2026. Tailored emotional llm-supporter: Enhancing cultural sensitivity. In Proceedings of the 19th Conference of the Anthony J Marsella and Ann Marie Yamada. 2010. Culture and psychopathology: Foundations, issues,…
  39. Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, and Timnit Gebru. 2019. Model cards for model reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency, pages 220–229, New York, NY, US… find
  40. SM Murray, N Kass, T Mendelson, and J Bass. 2016. The ethics of mental health survey research in low-and middle-income countries. Global Mental Health, 3:e12. find
  41. NapoleonCat. 2024. Facebook users by country— global statistics. https://stats.napoleoncat.com. Data sourced from Meta Advertising Tools via NapoleonCat. Licensed under Creative Commons Attribution 4.0 International. Accessed: July 2024. ↗
  42. Yarin Ovadia, Emily Fertig, Jie Ren, Zachary Nado, D. Sculley, Sebastian Nowozin, Joshua V. Dillon, Balaji Lakshminarayanan, and Jasper Snoek. 2019. Can you trust your model’s uncertainty? evaluating predictive uncertainty under dataset shift. In Advances in Neural Information Processing Systems, vo… find
  43. Sachin R Pendse, Kate Niederhoffer, and Amit Sharma. 2019. Cross-cultural differences in the use of online mental health support forums. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW):1– 29. find
  44. Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust speech recognition via large-scale weak supervision. Proceedings of the 40th International Conference on Machine Learning.
  45. Sunny Rai, Khushi Shelat, Devansh Jain, Ashwin Kishen, Young Min Cho, Maitreyi Redkar, Samin-dara Hardikar-Sawant, Lyle Ungar, and Sharath Chandra Guntuku. 2025a. Cross-cultural differences in mental health expressions on social media. In Proceedings of the 3rd Workshop on Cross-Cultural Considerati… find
  46. Sunny Rai, Elizabeth C Stade, Salvatore Giorgi, Ashley Francisco, Lyle H Ungar, Brenda Curtis, and Sharath C Guntuku. 2024. Key language markers of depression on social media depend on race. Proceedings of the National Academy of Sciences, 121:e2319837121. find
  47. Sunny Rai, Khushang Zaveri, Shreya Havaldar, Soumna Nema, Lyle Ungar, and Sharath Chandra Guntuku. 2025b. Social norms in cinema: A cross-cultural analysis of shame, pride and prejudice. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational… find
  48. Semrush. 2023. Reddit.com traffic analytics and market share—country level. https://www.semrush.com/website/reddit.com/overview/. Global traffic share by country for Reddit.com, March 2023. Accessed: March 2023. ↗
  49. Yla R Tausczik and James W Pennebaker. 2010. The psychological meaning of words: Liwc and computerized text analysis methods. Journal of language and social psychology, 29(1):24–54. find
  50. Harry C Triandis. 1996. The psychological measurement of cultural syndromes. American psychologist, 51(4):407. find
  51. World Health Organization. 2024. How AI could help improve access to mental health treatment. Accessed via World Economic Forum. find
  52. Chao Zhao, Pamela Hinds, and Ge Gao. 2012. How and to whom people share: The role of culture in self-disclosure in online communities. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work, pages 67–76, New York, NY, USA. Association for Computing Machinery. find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/rai-2026-culture-design-sociotechnical-framework-culturally/