Teaching Values to Machines: Simulating Human-Like Behavior in LLMs
Paper · 2026 · Asaf Yehudai, Naama Rozen and Ariel Gera
Summary
Large language models can easily adopt personas, but it is unclear whether they can hold a consistent, human-like system of values that shapes their behavior in predictable ways. The authors ground persona prompts in Schwartz's theory of ten basic values, which are arranged on a circular continuum. Their "value-prompting" technique adds a short description of one dominant value, taken from Schwartz and Sagiv (1995), before each task.
They first probe seven instruction-tuned models with persona statements from Perez et al. (2023). They then administer validated psychological instruments and compare the model outputs with published human data. They also simulate whole populations under different assumptions about how values are distributed.
The prompted models reproduce the human value structure. Conflicting values correlate negatively, and LLM–human agreement on value structure reaches roughly 0.8. Links between values and behavior also match human findings, and using human value distributions improves population-level simulation. Value-prompted LLMs could therefore serve as a cheap, theory-grounded testbed for psychological hypotheses. The authors note that this does not show the models have real inner psychology.
Key points
- Scale: The study covers 7 LLMs, 7 psychological tests and more than 5M questions. The models are Flan-T5-XXL, Llama-3-8B-Instruct, Llama-3-70B-Instruct, Mixtral-8×7B-Instruct, Qwen3-235B-A22B-Instruct-2507, GPT-OSS-20B and GPT-OSS-120B. Sampling used temperature 0.7, with each prompt repeated 100 times.
- Instruments:
- Values were measured with the 40-item Portrait Values Questionnaire (PVQ) on a 6-point scale.
- Behavior was measured with Donation Causes, the Paired Charity Game, the Prosocialness Scale, the Big Five Inventory-2 and the Everyday Behavior Questionnaire.
- Coherence check: For each behavior, 50 Yes/No statements were sampled from Perez et al. (2023).
- Openness to Change vs. Conservation and Self-Enhancement vs. Self-Transcendence came out negatively correlated (shown for Qwen3).
- Conservation and Self-Enhancement personas agreed more often with conservative political views, consistent with human research.
- Population simulation: The authors compared four strategies: human-informed, even, no-priming and model-specific. Human-informed distributions often gave better alignment. Stronger models were more robust to prompting technique and population distribution, and made better use of implicit value cues.
- Limitations and risks:
- The study uses only Schwartz's framework.
- Results may be sensitive to prompt wording.
- The human comparison samples may carry cultural bias.
- The method has dual-use potential, for example building manipulative personas.
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 18,614 worksArtificial Intelligence · 17,965 worksArts and Humanities · 17,450 worksLanguage and Linguistics · 17,296 worksSocial Sciences · 1,954 worksSafety Research · 626 worksEducation · 212 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 3,894 works
Cite
Cite as Asaf Yehudai, Naama Rozen and Ariel Gera. 2026. Teaching Values to Machines: Simulating Human-Like Behavior in LLMs. Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM).
@inproceedings{yehudai2026teaching,
title = {{Teaching Values to Machines: Simulating Human-Like Behavior in LLMs}},
author = {Asaf Yehudai, Naama Rozen and Ariel Gera},
booktitle = {Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)},
year = {2026},
doi = {10.18653/v1/2026.gem-main.70},
url = {https://doi.org/10.18653/v1/2026.gem-main.70}
}References
- Gati Aher, Rosa I. Arriaga, and Adam Tauman Kalai. 2023. Using large language models to simulate multiple humans and replicate human subject studies. Preprint, arXiv:2208.10264. find
- Esin Durmus, Karina Nguyen, Thomas I Liao, Nicholas Schiefer, Amanda Askell, Anton Bakhtin, Carol Chen, Zac Hatfield-Dodds, Danny Hernandez, Nicholas Joseph, et al. 2023. Towards measuring the representation of subjective global opinions in language models. arXiv preprint arXiv:2306.16388.
- Lisa P. Argyle, Ethan C. Busby, Nancy Fulda, Joshua R. Gubler, Christopher Rytting, and David Wingate. 2023. Out of one, many: Using language models to simulate human samples. Political Analysis, 31(3):337–351.
- Ronald Fischer, Markus Luczak-Roesch, and Johannes A Karl. 2023. What does chatgpt return about human values? exploring value bias in chatgpt using a descriptive value theory. arXiv preprint arXiv:2304.03612. — [arXiv:2304.03612](https://arxiv.org/abs/2304.03612) find
- Anat Bardi and Shalom H Schwartz. 2003. Values and behavior: Strength and structure of relations. Personality and social psychology bulletin, 29(10):1207– 1220. find
- Tao Ge, Xin Chan, Xiaoyang Wang, Dian Yu, Haitao Mi, and Dong Yu. 2024. Scaling synthetic data creation with 1,000,000,000 personas. arXiv preprint arXiv:2406.20094.
- Daryl J Bem. 1972. Self-perception theory. Advances in experimental social psychology, 6. find
- Marcel Binz and Eric Schulz. 2023. Turning large language models into cognitive models. arXiv preprint arXiv:2306.03917. — [arXiv:2306.03917](https://arxiv.org/abs/2306.03917) find
- Ingwer Borg, Patrick JF Groenen, and Patrick Mair. 2018. Applied multidimensional scaling and unfolding. find
- Gian Vittorio Caprara, Guido Alessandri, and Nancy Eisenberg. 2012. Prosociality: the contribution of traits, values, and self-efficacy beliefs. Journal of personality and social psychology, 102(6):1289. find
- Gian Vittorio Caprara, Patrizia Steca, Arnaldo Zelli, and Cristina Capanna. 2005. A new scale for measuring adults’ prosocialness. European Journal of psychological assessment, 21(2):77–89. find
- Gian Vittorio Caprara, Michele Vecchione, Guido Alessandri, Maria Gerbino, and Claudio Barbaranelli. 2011. The contribution of personality traits and self-efficacy beliefs to academic achievement: A longitudinal study. British journal of educational psychology, 81(1):78–96. find
- Hyung Won Chung, Le Hou, Shayne Longpre, et al. 2022. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416. find
- Ella Daniel and Maya Benish-Weisman. 2019. Value development during adolescence: Dimensions of change and stability. Journal of personality, 87(3):620–632. find
- Francesca Danioni, Daniela Barni, Claudia Russo, Ioana Zagrean, and Camillo Regalia. 2022. Perceived significant others’ values: Are they important in the relationship between personal values and self-reported prosociality? Current Issues in Personality Psychology, 11(2):137. find
- Eldad Davidov, Peter Schmidt, and Shalom H Schwartz. 2008. Bringing values back in: The adequacy of the european social survey to measure values in 20 countries. Public opinion quarterly, 72(3):420–445. find
- Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, et al. 2024. The Llama 3 herd of models. Preprint, arXiv:2407.21783.
- Albert Q. Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, Gianna Lengyel, Guillaume Bour, Guillaume Lample, Lélio Renard Lavaud, Lucile Saulnier, Marie-Anne Lachaux, Pierre Stock,… find
- Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, and Yixin Zhu. 2023. Evaluating and inducing personality in pre-trained language models. Preprint, arXiv:2206.07550.
- Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, and Yixin Zhu. 2024b. Evaluating and inducing personality in pre-trained language models. Advances in Neural Information Processing Systems, 36.
- Dongjun Kang, Joonsuk Park, Yohan Jo, and JinYeong Bak. 2023. From values to opinions: Predicting human behaviors and stances using value-injected large language models. arXiv preprint arXiv:2310.17857. find
- Grgur Kovač, Rémy Portelas, Masataka Sawayama, Peter Ford Dominey, and Pierre-Yves Oudeyer. 2024. Stick to your role! stability of personal values expressed in large language models. Plos one, 19(8):e0309114. find
- Yan Leng and Yuan Yuan. 2023. Do llm agents exhibit social behavior? arXiv preprint arXiv:2312.15198. — [arXiv:2312.15198](https://arxiv.org/abs/2312.15198) find
- Huao Li, Yu Quan Chong, Simon Stepputtis, Joseph Campbell, Dana Hughes, Michael Lewis, and Katia Sycara. 2023. Theory of mind for multi-agent collaboration via large language models. arXiv preprint arXiv:2310.10701.
- Bernadette Paula Luengo Kanacri, Nancy Eisenberg, Carlo Tramontano, Antonio Zuffiano, Maria Giovanna Caprara, Evangelina Regner, Liqi Zhu, Concetta Pastorelli, and Gian Vittorio Caprara. 2021. Measuring prosocial behaviors: Psychometric properties and cross-national validation of the prosociality sc… find
- Lilach Sagiv and Shalom H Schwartz. 2022. Personal values across cultures. Annual review of psychology, 73(1):517–546. find
- Benjamin S Manning, Kehang Zhu, and John J Horton. 2024. Automated social science: Language models as scientist and subjects. Technical report, National Bureau of Economic Research. find
- Leonard Salewski, Stephan Alaniz, Isabel Rio-Torto, Eric Schulz, and Zeynep Akata. 2024. In-context impersonation reveals large language models’ strengths and biases. Advances in Neural Information Processing Systems, 36. find
- Jared Moore, Tanvi Deshpande, and Diyi Yang. 2024. Are large language models consistent over value-laden questions? arXiv preprint arXiv:2407.02996. find
- OpenAI, :, Sandhini Agarwal, Lama Ahmad, Jason Ai, Sam Altman, Andy Applebaum, Edwin Arbus, et al. 2025. gpt-oss-120b & gpt-oss-20b model card. Preprint, arXiv:2508.10925.
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. Advances in neural information processing systems, 35:27730–27744.
- Ethan Perez, Sam Ringer, Kamile Lukosiute, Karina Nguyen, Edwin Chen, Scott Heiner, Craig Pettit, Catherine Olsson, Sandipan Kundu, Saurav Kadavath, et al. 2023. Discovering language model behaviors with model-written evaluations. In Findings of the Association for Computational Linguistics: ACL 202…
- Sonia Roccas and Lilach Sagiv. 2010. Personal values and behavior: Taking the cultural context into account. Social and Personality Psychology Compass, 4(1):30–41. find
- Sonia Roccas, Lilach Sagiv, Shalom H Schwartz, and Ariel Knafo. 2002. The big five personality factors and personal values. Personality and social psychology bulletin, 28(6):789–801. find
- Paul Röttger, Valentin Hofmann, Valentina Pyatkin, Musashi Hinck, Hannah Rose Kirk, Hinrich Schütze, and Dirk Hovy. 2024. Political compass or spinning arrow? towards more meaningful evaluations for values and opinions in large language models. arXiv preprint arXiv:2402.16786.
- Naama Rozen, Liat Bezalel, Gal Elidan, Amir Globerson, and Ella Daniel. 2025. Do LLMs have consistent values? In The Thirteenth International Conference on Learning Representations. find
- Lilach Sagiv and Sonia Roccas. 2021. How do values affect behavior? let me count the ways. Personality and Social Psychology Review, 25(4):295–316. find
- Lilach Sagiv, Sonia Roccas, Jan Cieciuch, and Shalom H Schwartz. 2017. Personal values in human life. Nature human behaviour, 1(9):630–639. find
- Lilach Sagiv, Noga Sverdlik, and Norbert Schwarz. 2011. To compete or to cooperate? values’ impact on perception and action in social dilemma games. European Journal of Social Psychology, 41(1):64–77. find
- Maarten Sap, Ronan Le Bras, Daniel Fried, and Yejin Choi. 2022. Neural theory-of-mind? on the limits of social intelligence in large LMs. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3762–3780, Abu Dhabi, United Arab Emirates. Association for Compu… find
- Maarten Sap, Hannah Rashkin, Derek Chen, Ronan LeBras, and Yejin Choi. 2019. Socialiqa: Commonsense reasoning about social interactions. arXiv preprint arXiv:1904.09728.
- Shalom Schwartz. 2006. A theory of cultural value orientations: Explication and applications. Comparative sociology, 5(2-3):137–182. find
- Shalom H Schwartz. 1992. Universals in the content and structure of values: Theoretical advances and empirical tests in 20 countries. In Advances in experimental social psychology, volume 25, pages 1–65. Elsevier. find
- Shalom H Schwartz. 2012. An overview of the Schwartz theory of basic values. Online readings in Psychology and Culture, 2(1):1–20. find
- Shalom H Schwartz and Tania Butenko. 2014. Values and behavior: Validating the refined value theory in russia. European journal of social psychology, 44(7):799–813. find
- Shalom H Schwartz, Gian Vittorio Caprara, and Michele Vecchione. 2010. Basic personal values, core political values, and voting: A longitudinal analysis. Political psychology, 31(3):421–452. find
- Shalom H Schwartz, Gian Vittorio Caprara, Michele Vecchione, Paul Bain, Gabriel Bianchi, Maria Giovanna Caprara, Jan Cieciuch, Hasan Kirmanoglu, Cem Baslevent, Jan-Erik Lönnqvist, et al. 2014. Basic personal values underlie and give coherence to political values: A cross national study in 15 countri… find
- Shalom H Schwartz and Jan Cieciuch. 2022. Measuring the refined theory of individual values in 49 cultural groups: psychometrics of the revised portrait value questionnaire. Assessment, 29(5):1005–1019. find
- Shalom H Schwartz, Jan Cieciuch, Michele Vecchione, Claudio Torres, Ozlem Dirilen-Gumus, and Tania Butenko. 2017. Value tradeoffs propel and inhibit behavior: Validating the 19 refined values in four countries. European Journal of Social Psychology, 47(3):241–258. find
- Zhaowei Zhang, Ceyao Zhang, Nian Liu, Siyuan Qi, Ziqi Rong, Song-Chun Zhu, Shuguang Cui, and Yaodong Yang. 2023. Heterogeneous value alignment evaluation for large language models. arXiv preprint arXiv:2305.17147. — [arXiv:2305.17147](https://arxiv.org/abs/2305.17147) find
- Shalom H Schwartz, Gila Melech, Arielle Lehmann, Steven Burgess, Mari Harris, and Vicki Owens. 2001. Extending the cross-cultural validity of the theory of basic human values with a different method of measurement. Journal of cross-cultural psychology, 32(5):519–542. find
- Shalom H Schwartz and Lilach Sagiv. 1995. Identifying culture-specifics in the content and structure of values. Journal of cross-cultural psychology, 26(1):92–116. find
- Ewa Skimina, Jan Cieciuch, and William Revelle. 2021. Between-and within-person structures of value traits and value states: Four different structures, four different interpretations. Journal of Personality, 89(5):951– 969. find
- Joanne N Sneddon, Uwana Evers, and Julie A Lee. 2020. Personal values and choice of charitable cause: An exploration of donors’ giving behavior. Nonprofit and Voluntary Sector Quarterly, 49(4):803–826. find
- Christopher J Soto and Oliver P John. 2017. The next big five inventory (bfi-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of personality and social psychology, 113(1):117. find
- James WA Strachan, Dalila Albergo, Giulia Borghini, Oriana Pansardi, Eugenio Scaliti, Saurabh Gupta, Krati Saxena, Alessandro Rufo, Stefano Panzeri, Guido Manzi, et al. 2024. Testing theory of mind in large language models and humans. Nature Human Behaviour, 8(7):1285–1295. find
- Qwen Team. 2025. Qwen3 technical report. Preprint, arXiv:2505.09388.
- Jing Yi Wang, Nicholas Sukiennik, Tong Li, Weikang Su, Qianyue Hao, Jingbo Xu, Zihan Huang, Fengli Xu, and Yong Li. 2024. A survey on human-centric llms. arXiv preprint arXiv:2411.14491. — [arXiv:2411.14491](https://arxiv.org/abs/2411.14491) find
- Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824–24837.
- Erich H Witte, Adrian Stanciu, and Klaus Boehnke. 2020. A new empirical approach to intercultural comparisons of value preferences based on schwartz’s theory. Frontiers in Psychology, 11:1723. find
- Asaf Yehudai, Taelin Karidi, Gabriel Stanovsky, Ariel Goldstein, and Omri Abend. 2024. A nurse is blue and elephant is rugby: Cross domain alignment in large language models reveal human-like patterns. Preprint, arXiv:2405.14863. — [arXiv:2405.14863](https://arxiv.org/abs/2405.14863) find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/yehudai-2026-teaching-values-machines-simulating-human/