Thinking beyond the anthropomorphic paradigm benefits LLM research
Paper · 2026 · Lujain Ibrahim and Myra Cheng
Summary
This position paper examines how the habit of describing LLMs in human terms shapes NLP research, and argues that the field relies on it too heavily. The authors first measure the trend. They adapt AnthroScore, a RoBERTa-based masked-LM metric that compares the probability of human versus non-human pronouns in place of an entity such as "model". They make it a binary, text-level indicator: an abstract counts as anthropomorphic if any sentence scores above zero. Applied to arXiv computer science abstracts and the ACL Anthology, the metric shows a steady rise in human-like framing, which is strongest in LLM papers. The authors then propose a framework that links this terminology to underlying assumptions at five lifecycle stages: training, alignment, evaluation, interpreting model behavior, and user interaction. For each stage, they describe under-explored non-anthropomorphic alternatives. They do not call for dropping anthropomorphism altogether. Instead, they argue for using both lenses, since looking past human analogies can open new research and design directions.
Key points
- The arXiv analysis covers 158,847 CS papers (Jan 2023 – Dec 2024) that mention a "system", "network" or "model". The share of anthropomorphic abstracts rose from 34% to 40%, and for LLM papers from just over 40% to 48%.
- In the ACL Anthology (2007–2022), 41,836 of 55,185 abstracts contained a target entity. The anthropomorphic share among them more than doubled, from 5% to 11%, which the authors summarize as about a 150% increase since 2007.
- The measurement uses roberta-base (125M parameters) and needed under 10 GPU hours on a single GPU.
- The authors pair each challenged assumption with alternatives. Examples include byte-level tokenization and latent-space reasoning instead of subword and natural-language chain-of-thought, control-theory and interpretability-based steering for alignment, and dynamic evaluations instead of tests designed for humans.
- They suggest reading behaviors such as deception as context-bound role-play simulations rather than evidence of intent. They also recommend new metaphors, insights from cognitive science and linguistics, and structured interfaces instead of chat-only interaction.
Institutions
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 worksSocial Sciences · 1,772 worksSafety Research · 543 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 3,320 works
Cite
Cite as Lujain Ibrahim and Myra Cheng. 2026. Thinking beyond the anthropomorphic paradigm benefits LLM research. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).
@inproceedings{ibrahim2026thinking,
title = {{Thinking beyond the anthropomorphic paradigm benefits LLM research}},
author = {Lujain Ibrahim and Myra Cheng},
booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
year = {2026},
doi = {10.18653/v1/2026.acl-long.118},
url = {https://doi.org/10.18653/v1/2026.acl-long.118}
}References
- Orevaoghene Ahia, Sachin Kumar, Hila Gonen, Jungo Kasai, David R Mortensen, Noah A. Smith, and Yulia Tsvetkov. 2023. Do all languages cost the same? tokenization in the era of commercial language models. In The 2023 Conference on Empirical Methods in Natural Language Processing.
- Canfer Akbulut, Laura Weidinger, Arianna Manzini, Iason Gabriel, and Verena Rieser. 2024. All Too Human? Mapping and Mitigating the Risk from Anthropomorphic AI. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, volume 7, pages 13–26. find
- Jacob Andreas. 2022. Language models as agent models. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5769–5779, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
- Anthropic. 2024a. Claude’s character. find
- Anthropic. 2024b. External reviews of “alignment faking in large language models”. arXiv.org submitters. 2024. arxiv dataset. find
- Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, and 1 others. 2022a. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862. find
- Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, and 1 others. 2022b. Constitutional AI: Harmlessness from AI feedback. arXiv preprint arXiv:2212.08073.
- Mark Balas. 1978. Feedback control of flexible systems. IEEE Transactions on Automatic Control, 23(4):673– 679. find
- Emily M Bender. 2024. Resisting dehumanization in the age of “AI”. Curr. Dir. Psychol. Sci., 33(2):114–120. find
- Leonard Bereska and Stratis Gavves. 2024. Mechanistic interpretability for AI safety - a review. Transactions on Machine Learning Research. Survey Certification, Expert Certification. find
- Petter Bae Brandtzaeg, Marita Skjuve, and Asbjørn Følstad. 2022. My AI friend: How users of a social chatbot understand their human–AI friendship. Human Communication Research, 48(3):404–429. find
- Britta C Brugman, Christian Burgers, and Gerard J Steen. 2017. Recategorizing political frames: a systematic review of metaphorical framing in experiments on political communication. Annals of the International Communication Association, 41(2):181– 197. find
- Erik Brynjolfsson. 2023. The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence. In Augmented education in the global age, pages 103– 116. Routledge. find
- Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Rachel Freedman, Tomek Korbak, David Lindner, Pedro Freire, Tony Tong Wang, Samuel Marks, Charbel-Raphael Segerie, Micah Carroll, Andi Peng, Phillip J.K. Christoffersen, Mehul Damani, Stewart Slocum, Us… find
- Serina Chang, Ashton Anderson, and Jake M. Hofman. 2025. ChatBench: From static benchmarks to human-AI evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 26009– 26038, Vienna, Austria. Association for Computational Li…
- Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, and 1 others. 2024. A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Technology, 15(3):1–45.
- Myra Cheng, Kristina Gligoric, Tiziano Piccardi, and Dan Jurafsky. 2024. AnthroScore: A computational linguistic measure of anthropomorphism. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 807–825, St. Jul… find
- Myra Cheng, Robert D Hawkins, and Dan Jurafsky. Accommodation and epistemic vigilance: A pragmatic account of why LLMs fail to challenge harmful beliefs. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), San Diego, USA. Association fo… find
- Myra Cheng, Sunny Yu, Cinoo Lee, Pranav Khadpe, Lujain Ibrahim, and Dan Jurafsky. 2026. ELEPHANT: Measuring and understanding social sycophancy in LLMs. In The Fourteenth International Conference on Learning Representations.
- Michelle Cohn, Mahima Pushkarna, Gbolahan O Olanubi, Joseph M Moran, Daniel Padgett, Zion Mengesha, and Courtney Heldreth. 2024. Believing anthropomorphism: Examining the role of anthropomorphic cues on trust in large language models. In Extended Abstracts of the CHI Conference on Human Factors in C… find
- Mike Dacey. 2017. Anthropomorphism as cognitive bias. Philosophy of Science, 84(5):1152–1164. find
- Jessica Dai. 2024. Position: Beyond personhood: Agency, accountability, and the limits of anthropomorphic ethical analysis. In Forty-first International Conference on Machine Learning. find
- Adam Davies and Ashkan Khakzar. 2024. The cognitive revolution in interpretability: From explaining behavior to interpreting representations and algorithms. arXiv preprint arXiv:2408.05859. — [arXiv:2408.05859](https://arxiv.org/abs/2408.05859) find
- Edsger W Dijkstra. 1985. On anthropomorphism in science. EWD936, Sept. find
- Eamon Duede and Richard Jean So. 2024. The humanistic case for AI optimism. Poetics Today, 45(2):215– 222. find
- Nicholas Epley. 2018. A mind like mine: The exceptionally ordinary underpinnings of anthropomorphism. Journal of the Association for Consumer Research, 3(4):591–598. find
- Oluwole Fagbohun, Rachel M Harrison, and Anton Dereventsov. 2024. An empirical categorization of prompting techniques for large language models: A practitioner’s guide. arXiv preprint arXiv:2402.14837. — [arXiv:2402.14837](https://arxiv.org/abs/2402.14837) find
- K. J. Kevin Feng, Kevin Pu, Matt Latzke, Tal August, Pao Siangliulue, Jonathan Bragg, Daniel S Weld, Amy X. Zhang, and Joseph Chee Chang. 2026. Cocoa: Co-planning and co-execution with ai agents. In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, CHI ’26, New York, NY,… find
- Luciano Floridi and Anna C Nobre. 2024. Anthropomorphising machines and computerising minds: the crosswiring of languages between artificial intelligence and brain & cognitive sciences. Minds and Machines, 34(1):1–9. find
- Kristel M Gallagher and John A Updegraff. 2012. Health message framing effects on attitudes, intentions, and behavior: a meta-analytic review. Annals of behavioral medicine, 43(1):101–116. find
- Ryan Greenblatt, Carson Denison, Benjamin Wright, Fabien Roger, Monte MacDiarmid, Sam Marks, Johannes Treutlein, Tim Belonax, Jack Chen, David Duvenaud, and 1 others. 2024. Alignment faking in large language models. arXiv preprint arXiv:2412.14093. find
- David Gros, Yu Li, and Zhou Yu. 2021. The R-U-a-robot dataset: Helping avoid chatbot deception by detecting user questions about human or non-human identity. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natu… find
- Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, and 1 others. 2025. DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning. Nature, 645(8081):633–638. find
- Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason E Weston, and Yuandong Tian. 2025. Training large language models to reason in a continuous latent space. In Second Conference on Language Modeling. find
- John Hewitt, Nelson F Liu, Percy Liang, and Christopher D Manning. 2024. Instruction following without instruction tuning. arXiv preprint arXiv:2409.14254. find
- Marius Hobbhahn. 2024. We need a science of evals. find
- Lujain Ibrahim, Franziska Sofia Hafner, and Luc Rocher. 2025. Training language models to be warm and empathetic makes them less reliable and more sycophantic. arXiv preprint arXiv:2507.21919. — [arXiv:2507.21919](https://arxiv.org/abs/2507.21919) find
- Theodore Jensen, Mary Theofanos, Kristen Greene, Olivia Williams, Kurtis Goad, and Janet Bih Fofang. 2024. Reflection of its creators: Qualitative analysis of general public and expert perceptions of artificial intelligence. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, volum… find
- Cameron Jones and Ben Bergen. 2024. Does gpt-4 pass the turing test? In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 5183–5210. find
- Cameron Jones and Benjamin Bergen. 2026. Lies, damned lies, and language statistics: a comprehensive review of risks from manipulation, persuasion, and deception with large language models. Artificial Intelligence Review. find
- Julie Kallini, Shikhar Murty, Christopher D Manning, Christopher Potts, and Róbert Csordás. 2025. MrT5: Dynamic token merging for efficient byte-level language models. In The Thirteenth International Conference on Learning Representations. find
- Atoosa Kasirzadeh and Iason Gabriel. 2023. In conversation with artificial intelligence: aligning language models with human values. Philosophy & Technology, 36(2):27. find
- Ayush Kaushal and Kyle Mahowald. 2022. What do tokens know about their characters and how do they know it? In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2487–2507, Seattle, United States. Assoc… find
- Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T Hancock, and Michael S Bernstein. 2020. Conceptual metaphors impact perceptions of human-ai collaboration. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2):1–26. find
- Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan A, Saiful Haq, Ashutosh Sharma, Thomas T. Joshi, Hanna Moazam, Heather Miller, Matei Zaharia, and Christopher Potts. 2024. DSPy: Compiling declarative language model calls into state-of-the-art pipeline… find
- Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, and Adina Williams. 2021. Dyna… find
- Taku Kudo and John Richardson. 2018. SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66–71, Brussels, Belgium. Associ…
- George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago Press. find
- Belinda Z. Li, Alex Tamkin, Noah Goodman, and Jacob Andreas. 2025. Eliciting human preferences with language models. In The Thirteenth International Conference on Learning Representations. find
- Yugang Li, Baizhou Wu, Yuqi Huang, Jun Liu, Junhui Wu, and Shenghua Luan. 2024. Warmth, competence, and the determinants of trust in artificial intelligence: A cross-sectional survey from China. International Journal of Human–Computer Interaction, pages 1–15. find
- Kristian Lum, Jacy Reese Anthis, Kevin Robinson, Chirag Nagpal, and Alexander Nicholas D’Amour. 2025. Bias in language models: Beyond trick tests and towards RUTEd evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13… find
- John McCarthy, Marvin L Minsky, Nathaniel Rochester, and Claude E Shannon. 2006. A proposal for the dartmouth summer research project on artificial intelligence, august 31, 1955. AI magazine, 27(4):12–12. find
- John McCarthy, Nathaniel Rochester, and Claude Shannon. 1956. Dartmouth workshop. find
- R. Thomas McCoy, Shunyu Yao, Dan Friedman, Mathew D. Hardy, and Thomas L. Griffiths. 2024a. Embers of autoregression show how large language models are shaped by the problem they are trained to solve. Proceedings of the National Academy of Sciences, 121(41):e2322420121. find
- R Thomas McCoy, Shunyu Yao, Dan Friedman, Mathew D Hardy, and Thomas L Griffiths. 2024b. When a language model is optimized for reasoning, does it still show embers of autoregression? an analysis of openai o1. arXiv preprint arXiv:2410.01792. find
- Douglas L Medin. 1989. Concepts and conceptual structure. American psychologist, 44(12):1469. find
- Moran Mizrahi, Guy Kaplan, Dan Malkin, Rotem Dror, Dafna Shahaf, and Gabriel Stanovsky. 2024. State of what art? a call for multi-prompt LLM evaluation. Transactions of the Association for Computational Linguistics, 12:933–949. find
- Ethan Mollick. 2024. Sometimes our anthropocentric assumptions about how intelligence "should" work (like using language for reasoning) may be holding AI work back. find
- Burt L Monroe, Michael P Colaresi, and Kevin M Quinn. 2008. Fightin’words: Lexical feature selection and evaluation for identifying the content of political conflict. Political Analysis, 16(4):372–403. find
- Meredith Ringel Morris. 2024. Prompting considered harmful. Communications of the ACM, 67(12):28– 30. find
- Rajiv Movva, Sidhika Balachandar, Kenny Peng, Gabriel Agostini, Nikhil Garg, and Emma Pierson. 2024. Topics, authors, and institutions in large language model research: Trends from 17k arxiv papers. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computatio… find
- Nika Mozafari, Welf H Weiger, and Maik Hammerschmidt. 2020. The chatbot disclosure dilemma: Desirable and undesirable effects of disclosing the non-human identity of chatbots. In ICIS, pages 1–18. find
- Gregory L. Murphy. 2002. The Big Book of Concepts. The MIT Press. find
- Clifford Nass, Youngme Moon, and Paul Carney. 1999. Are people polite to computers? responses to computer-based interviewing systems. Journal of Applied Social Psychology, 29(5):1093–1109. find
- Simon Ott, Adriano Barbosa-Silva, Kathrin Blagec, Jan Brauner, and Matthias Samwald. 2022. Mapping global dynamics of benchmark creation and saturation in artificial intelligence. Nature Communications, 13(1):6793.
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, and 1 others. 2022. Training language models to follow instructions with human feedback. Advances in neural information processing systems, 35:27730–27744.
- Alexander Pan, Erik Jones, Meena Jagadeesan, and Jacob Steinhardt. 2024. Feedback loops with language models drive in-context reward hacking. In Proceedings of the 41st International Conference on Machine Learning, ICML’24. JMLR.org. find
- Diane Proudfoot. 2011. Anthropomorphism and AI: Turing’s much misunderstood imitation game. Artificial Intelligence, 175(5-6):950–957. find
- Deborah Raji, Emily Denton, Emily M. Bender, Alex Hanna, and Amandalynne Paullada. 2021. Ai and the everything in the whole wide world benchmark. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, volume 1. find
- Murray Shanahan. 2024. Talking about large language models. Communications of the ACM, 67(2):68–79. find
- Murray Shanahan, Kyle McDonell, and Laria Reynolds. 2023. Role play with large language models. Nature, 623(7987):493–498.
- Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R. Bowman, Esin DURMUS, Zac Hatfield-Dodds, Scott R Johnston, Shauna M Kravec, Timothy Maxwell, Sam Mc-Candlish, Kamal Ndousse, Oliver Rausch, Nicholas Schiefer, Da Yan, Miranda Zhang, and Ethan Perez. 2024. Towards under…
- Jianna So, Connie Cheng, and Sonia Krishna Murthy. 2026. Beyond anthropomorphism: a spectrum of interface metaphors for LLMs. In Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems, pages 1–7. find
- Yao Song and Yan Luximon. 2020. Trust in AI agent: A systematic review of facial anthropomorphic trustworthiness for social robot design. Sensors, 20(18):5087. find
- Hari Subramonyam, Roy Pea, Christopher Pondoc, Maneesh Agrawala, and Colleen Seifert. 2024. Bridging the gulf of envisioning: Cognitive challenges in prompt based interactions with LLMs. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 1–19. find
- Peiqi Sui, Eamon Duede, Sophie Wu, and Richard So. 2024. Confabulation: The surprising value of large language model hallucinations. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14274–14284, Bangkok, Thailand. Association f… find
- Jason Wei. 2024. There is a nuanced but important difference between chain-of-thought before and after o1. ... find
- Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824– 24837.
- Xumeng Wen, Zihan Liu, Shun Zheng, Shengyu Ye, Zhirong Wu, Yang Wang, Zhijian Xu, Xiao Liang, Junjie Li, Ziming Miao, Jiang Bian, and Mao Yang. 2026. Reinforcement learning with verifiable rewards implicitly incentivizes correct reasoning in base LLMs. In The Fourteenth International Conference on L… find
- Jia-Yu Yao, Kun-Peng Ning, Zhen-Hui Liu, Mu-Nan Ning, Yu-Yang Liu, and Li Yuan. 2023. LLM lies: Hallucinations are not bugs, but features as adversarial examples. arXiv preprint arXiv:2310.01469. — [arXiv:2310.01469](https://arxiv.org/abs/2310.01469) find
- Hongxin Zhang, Yanzhe Zhang, Ruiyi Zhang, and Diyi Yang. 2022. Robustness of demonstration-based learning under limited data scenario. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 1769–1782, Abu Dhabi, United Arab Emirates. Association for Computat… find
- Tan Zhi-Xuan, Micah Carroll, Matija Franklin, and Hal Ashton. 2024. Beyond preferences in AI alignment. Philosophical Studies, pages 1–51. find
- Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc V Le, and Ed H. Chi. 2023. Least-to-most prompting enables complex reasoning in large language models. In The Eleventh International Conference on Learning Representation…
- Kaitlyn Zhou, Jena D. Hwang, Xiang Ren, Nouha Dziri, Dan Jurafsky, and Maarten Sap. 2025. REL-A.I.: An interaction-centered approach to measuring human-LM reliance. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human La… find
- Jingming Zhuo, Songyang Zhang, Xinyu Fang, Haodong Duan, Dahua Lin, and Kai Chen. 2024. Prosa: Assessing and understanding the prompt sensitivity of LLMs. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 1950–1976. find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/ibrahim-2026-thinking-beyond-anthropomorphic-paradigm-benefits/