Elamur Research⌕
☰
home / papers / 2026 / Thinking beyond the anthropomorphic paradigm benefits LLM research

Thinking beyond the anthropomorphic paradigm benefits LLM research

Paper · 2026 · Lujain Ibrahim and Myra Cheng

Summary

This position paper examines how the habit of describing LLMs in human terms shapes NLP research, and argues that the field relies on it too heavily. The authors first measure the trend. They adapt AnthroScore, a RoBERTa-based masked-LM metric that compares the probability of human versus non-human pronouns in place of an entity such as "model". They make it a binary, text-level indicator: an abstract counts as anthropomorphic if any sentence scores above zero. Applied to arXiv computer science abstracts and the ACL Anthology, the metric shows a steady rise in human-like framing, which is strongest in LLM papers. The authors then propose a framework that links this terminology to underlying assumptions at five lifecycle stages: training, alignment, evaluation, interpreting model behavior, and user interaction. For each stage, they describe under-explored non-anthropomorphic alternatives. They do not call for dropping anthropomorphism altogether. Instead, they argue for using both lenses, since looking past human analogies can open new research and design directions.

Key points

  • The arXiv analysis covers 158,847 CS papers (Jan 2023 – Dec 2024) that mention a "system", "network" or "model". The share of anthropomorphic abstracts rose from 34% to 40%, and for LLM papers from just over 40% to 48%.
  • In the ACL Anthology (2007–2022), 41,836 of 55,185 abstracts contained a target entity. The anthropomorphic share among them more than doubled, from 5% to 11%, which the authors summarize as about a 150% increase since 2007.
  • The measurement uses roberta-base (125M parameters) and needed under 10 GPU hours on a single GPU.
  • The authors pair each challenged assumption with alternatives. Examples include byte-level tokenization and latent-space reasoning instead of subword and natural-language chain-of-thought, control-theory and interpretability-based steering for alignment, and dynamic evaluations instead of tests designed for humans.
  • They suggest reading behaviors such as deception as context-bound role-play simulations rather than evidence of intent. They also recommend new metaphors, insights from cognitive science and linguistics, and structured interfaces instead of chat-only interaction.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

 Fields, topics and concepts

Cite

Cite as Lujain Ibrahim and Myra Cheng. 2026. Thinking beyond the anthropomorphic paradigm benefits LLM research. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.18653/v1/2026.acl-long.118

@inproceedings{ibrahim2026thinking,
  title = {{Thinking beyond the anthropomorphic paradigm benefits LLM research}},
  author = {Lujain Ibrahim and Myra Cheng},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.118},
  url = {https://doi.org/10.18653/v1/2026.acl-long.118}
}

References

85 references, 13 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Orevaoghene Ahia, Sachin Kumar, Hila Gonen, Jungo Kasai, David R Mortensen, Noah A. Smith, and Yulia Tsvetkov. 2023. Do all languages cost the same? tokenization in the era of commercial language models. In The 2023 Conference on Empirical Methods in Natural Language Processing.
  2. Canfer Akbulut, Laura Weidinger, Arianna Manzini, Iason Gabriel, and Verena Rieser. 2024. All Too Human? Mapping and Mitigating the Risk from Anthropomorphic AI. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, volume 7, pages 13–26. find
  3. Jacob Andreas. 2022. Language models as agent models. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 5769–5779, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
  4. Anthropic. 2024a. Claude’s character. find
  5. Anthropic. 2024b. External reviews of “alignment faking in large language models”. arXiv.org submitters. 2024. arxiv dataset. find
  6. Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, and 1 others. 2022a. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862. find
  7. Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, and 1 others. 2022b. Constitutional AI: Harmlessness from AI feedback. arXiv preprint arXiv:2212.08073.
  8. Mark Balas. 1978. Feedback control of flexible systems. IEEE Transactions on Automatic Control, 23(4):673– 679. find
  9. Emily M Bender. 2024. Resisting dehumanization in the age of “AI”. Curr. Dir. Psychol. Sci., 33(2):114–120. find
  10. Leonard Bereska and Stratis Gavves. 2024. Mechanistic interpretability for AI safety - a review. Transactions on Machine Learning Research. Survey Certification, Expert Certification. find
  11. Petter Bae Brandtzaeg, Marita Skjuve, and Asbjørn Følstad. 2022. My AI friend: How users of a social chatbot understand their human–AI friendship. Human Communication Research, 48(3):404–429. find
  12. Britta C Brugman, Christian Burgers, and Gerard J Steen. 2017. Recategorizing political frames: a systematic review of metaphorical framing in experiments on political communication. Annals of the International Communication Association, 41(2):181– 197. find
  13. Erik Brynjolfsson. 2023. The Turing Trap: The Promise & Peril of Human-Like Artificial Intelligence. In Augmented education in the global age, pages 103– 116. Routledge. find
  14. Stephen Casper, Xander Davies, Claudia Shi, Thomas Krendl Gilbert, Jérémy Scheurer, Javier Rando, Rachel Freedman, Tomek Korbak, David Lindner, Pedro Freire, Tony Tong Wang, Samuel Marks, Charbel-Raphael Segerie, Micah Carroll, Andi Peng, Phillip J.K. Christoffersen, Mehul Damani, Stewart Slocum, Us… find
  15. Serina Chang, Ashton Anderson, and Jake M. Hofman. 2025. ChatBench: From static benchmarks to human-AI evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 26009– 26038, Vienna, Austria. Association for Computational Li…
  16. Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi, Cunxiang Wang, Yidong Wang, and 1 others. 2024. A survey on evaluation of large language models. ACM Transactions on Intelligent Systems and Technology, 15(3):1–45.
  17. Myra Cheng, Kristina Gligoric, Tiziano Piccardi, and Dan Jurafsky. 2024. AnthroScore: A computational linguistic measure of anthropomorphism. In Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 807–825, St. Jul… find
  18. Myra Cheng, Robert D Hawkins, and Dan Jurafsky. Accommodation and epistemic vigilance: A pragmatic account of why LLMs fail to challenge harmful beliefs. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), San Diego, USA. Association fo… find
  19. Myra Cheng, Sunny Yu, Cinoo Lee, Pranav Khadpe, Lujain Ibrahim, and Dan Jurafsky. 2026. ELEPHANT: Measuring and understanding social sycophancy in LLMs. In The Fourteenth International Conference on Learning Representations.
  20. Michelle Cohn, Mahima Pushkarna, Gbolahan O Olanubi, Joseph M Moran, Daniel Padgett, Zion Mengesha, and Courtney Heldreth. 2024. Believing anthropomorphism: Examining the role of anthropomorphic cues on trust in large language models. In Extended Abstracts of the CHI Conference on Human Factors in C… find
  21. Mike Dacey. 2017. Anthropomorphism as cognitive bias. Philosophy of Science, 84(5):1152–1164. find
  22. Jessica Dai. 2024. Position: Beyond personhood: Agency, accountability, and the limits of anthropomorphic ethical analysis. In Forty-first International Conference on Machine Learning. find
  23. Adam Davies and Ashkan Khakzar. 2024. The cognitive revolution in interpretability: From explaining behavior to interpreting representations and algorithms. arXiv preprint arXiv:2408.05859. — [arXiv:2408.05859](https://arxiv.org/abs/2408.05859) find
  24. Edsger W Dijkstra. 1985. On anthropomorphism in science. EWD936, Sept. find
  25. Eamon Duede and Richard Jean So. 2024. The humanistic case for AI optimism. Poetics Today, 45(2):215– 222. find
  26. Nicholas Epley. 2018. A mind like mine: The exceptionally ordinary underpinnings of anthropomorphism. Journal of the Association for Consumer Research, 3(4):591–598. find
  27. Oluwole Fagbohun, Rachel M Harrison, and Anton Dereventsov. 2024. An empirical categorization of prompting techniques for large language models: A practitioner’s guide. arXiv preprint arXiv:2402.14837. — [arXiv:2402.14837](https://arxiv.org/abs/2402.14837) find
  28. K. J. Kevin Feng, Kevin Pu, Matt Latzke, Tal August, Pao Siangliulue, Jonathan Bragg, Daniel S Weld, Amy X. Zhang, and Joseph Chee Chang. 2026. Cocoa: Co-planning and co-execution with ai agents. In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, CHI ’26, New York, NY,… find
  29. Luciano Floridi and Anna C Nobre. 2024. Anthropomorphising machines and computerising minds: the crosswiring of languages between artificial intelligence and brain & cognitive sciences. Minds and Machines, 34(1):1–9. find
  30. Kristel M Gallagher and John A Updegraff. 2012. Health message framing effects on attitudes, intentions, and behavior: a meta-analytic review. Annals of behavioral medicine, 43(1):101–116. find
  31. Ryan Greenblatt, Carson Denison, Benjamin Wright, Fabien Roger, Monte MacDiarmid, Sam Marks, Johannes Treutlein, Tim Belonax, Jack Chen, David Duvenaud, and 1 others. 2024. Alignment faking in large language models. arXiv preprint arXiv:2412.14093. find
  32. David Gros, Yu Li, and Zhou Yu. 2021. The R-U-a-robot dataset: Helping avoid chatbot deception by detecting user questions about human or non-human identity. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natu… find
  33. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, and 1 others. 2025. DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning. Nature, 645(8081):633–638. find
  34. Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason E Weston, and Yuandong Tian. 2025. Training large language models to reason in a continuous latent space. In Second Conference on Language Modeling. find
  35. John Hewitt, Nelson F Liu, Percy Liang, and Christopher D Manning. 2024. Instruction following without instruction tuning. arXiv preprint arXiv:2409.14254. find
  36. Marius Hobbhahn. 2024. We need a science of evals. find
  37. Lujain Ibrahim, Franziska Sofia Hafner, and Luc Rocher. 2025. Training language models to be warm and empathetic makes them less reliable and more sycophantic. arXiv preprint arXiv:2507.21919. — [arXiv:2507.21919](https://arxiv.org/abs/2507.21919) find
  38. Theodore Jensen, Mary Theofanos, Kristen Greene, Olivia Williams, Kurtis Goad, and Janet Bih Fofang. 2024. Reflection of its creators: Qualitative analysis of general public and expert perceptions of artificial intelligence. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, volum… find
  39. Cameron Jones and Ben Bergen. 2024. Does gpt-4 pass the turing test? In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 5183–5210. find
  40. Cameron Jones and Benjamin Bergen. 2026. Lies, damned lies, and language statistics: a comprehensive review of risks from manipulation, persuasion, and deception with large language models. Artificial Intelligence Review. find
  41. Julie Kallini, Shikhar Murty, Christopher D Manning, Christopher Potts, and Róbert Csordás. 2025. MrT5: Dynamic token merging for efficient byte-level language models. In The Thirteenth International Conference on Learning Representations. find
  42. Atoosa Kasirzadeh and Iason Gabriel. 2023. In conversation with artificial intelligence: aligning language models with human values. Philosophy & Technology, 36(2):27. find
  43. Ayush Kaushal and Kyle Mahowald. 2022. What do tokens know about their characters and how do they know it? In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2487–2507, Seattle, United States. Assoc… find
  44. Pranav Khadpe, Ranjay Krishna, Li Fei-Fei, Jeffrey T Hancock, and Michael S Bernstein. 2020. Conceptual metaphors impact perceptions of human-ai collaboration. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2):1–26. find
  45. Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan A, Saiful Haq, Ashutosh Sharma, Thomas T. Joshi, Hanna Moazam, Heather Miller, Matei Zaharia, and Christopher Potts. 2024. DSPy: Compiling declarative language model calls into state-of-the-art pipeline… find
  46. Douwe Kiela, Max Bartolo, Yixin Nie, Divyansh Kaushik, Atticus Geiger, Zhengxuan Wu, Bertie Vidgen, Grusha Prasad, Amanpreet Singh, Pratik Ringshia, Zhiyi Ma, Tristan Thrush, Sebastian Riedel, Zeerak Waseem, Pontus Stenetorp, Robin Jia, Mohit Bansal, Christopher Potts, and Adina Williams. 2021. Dyna… find
  47. Taku Kudo and John Richardson. 2018. SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 66–71, Brussels, Belgium. Associ…
  48. George Lakoff and Mark Johnson. 2008. Metaphors we live by. University of Chicago Press. find
  49. Belinda Z. Li, Alex Tamkin, Noah Goodman, and Jacob Andreas. 2025. Eliciting human preferences with language models. In The Thirteenth International Conference on Learning Representations. find
  50. Yugang Li, Baizhou Wu, Yuqi Huang, Jun Liu, Junhui Wu, and Shenghua Luan. 2024. Warmth, competence, and the determinants of trust in artificial intelligence: A cross-sectional survey from China. International Journal of Human–Computer Interaction, pages 1–15. find
  51. Kristian Lum, Jacy Reese Anthis, Kevin Robinson, Chirag Nagpal, and Alexander Nicholas D’Amour. 2025. Bias in language models: Beyond trick tests and towards RUTEd evaluation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13… find
  52. John McCarthy, Marvin L Minsky, Nathaniel Rochester, and Claude E Shannon. 2006. A proposal for the dartmouth summer research project on artificial intelligence, august 31, 1955. AI magazine, 27(4):12–12. find
  53. John McCarthy, Nathaniel Rochester, and Claude Shannon. 1956. Dartmouth workshop. find
  54. R. Thomas McCoy, Shunyu Yao, Dan Friedman, Mathew D. Hardy, and Thomas L. Griffiths. 2024a. Embers of autoregression show how large language models are shaped by the problem they are trained to solve. Proceedings of the National Academy of Sciences, 121(41):e2322420121. find
  55. R Thomas McCoy, Shunyu Yao, Dan Friedman, Mathew D Hardy, and Thomas L Griffiths. 2024b. When a language model is optimized for reasoning, does it still show embers of autoregression? an analysis of openai o1. arXiv preprint arXiv:2410.01792. find
  56. Douglas L Medin. 1989. Concepts and conceptual structure. American psychologist, 44(12):1469. find
  57. Moran Mizrahi, Guy Kaplan, Dan Malkin, Rotem Dror, Dafna Shahaf, and Gabriel Stanovsky. 2024. State of what art? a call for multi-prompt LLM evaluation. Transactions of the Association for Computational Linguistics, 12:933–949. find
  58. Ethan Mollick. 2024. Sometimes our anthropocentric assumptions about how intelligence "should" work (like using language for reasoning) may be holding AI work back. find
  59. Burt L Monroe, Michael P Colaresi, and Kevin M Quinn. 2008. Fightin’words: Lexical feature selection and evaluation for identifying the content of political conflict. Political Analysis, 16(4):372–403. find
  60. Meredith Ringel Morris. 2024. Prompting considered harmful. Communications of the ACM, 67(12):28– 30. find
  61. Rajiv Movva, Sidhika Balachandar, Kenny Peng, Gabriel Agostini, Nikhil Garg, and Emma Pierson. 2024. Topics, authors, and institutions in large language model research: Trends from 17k arxiv papers. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computatio… find
  62. Nika Mozafari, Welf H Weiger, and Maik Hammerschmidt. 2020. The chatbot disclosure dilemma: Desirable and undesirable effects of disclosing the non-human identity of chatbots. In ICIS, pages 1–18. find
  63. Gregory L. Murphy. 2002. The Big Book of Concepts. The MIT Press. find
  64. Clifford Nass, Youngme Moon, and Paul Carney. 1999. Are people polite to computers? responses to computer-based interviewing systems. Journal of Applied Social Psychology, 29(5):1093–1109. find
  65. Simon Ott, Adriano Barbosa-Silva, Kathrin Blagec, Jan Brauner, and Matthias Samwald. 2022. Mapping global dynamics of benchmark creation and saturation in artificial intelligence. Nature Communications, 13(1):6793.
  66. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, and 1 others. 2022. Training language models to follow instructions with human feedback. Advances in neural information processing systems, 35:27730–27744.
  67. Alexander Pan, Erik Jones, Meena Jagadeesan, and Jacob Steinhardt. 2024. Feedback loops with language models drive in-context reward hacking. In Proceedings of the 41st International Conference on Machine Learning, ICML’24. JMLR.org. find
  68. Diane Proudfoot. 2011. Anthropomorphism and AI: Turing’s much misunderstood imitation game. Artificial Intelligence, 175(5-6):950–957. find
  69. Deborah Raji, Emily Denton, Emily M. Bender, Alex Hanna, and Amandalynne Paullada. 2021. Ai and the everything in the whole wide world benchmark. In Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks, volume 1. find
  70. Murray Shanahan. 2024. Talking about large language models. Communications of the ACM, 67(2):68–79. find
  71. Murray Shanahan, Kyle McDonell, and Laria Reynolds. 2023. Role play with large language models. Nature, 623(7987):493–498.
  72. Mrinank Sharma, Meg Tong, Tomasz Korbak, David Duvenaud, Amanda Askell, Samuel R. Bowman, Esin DURMUS, Zac Hatfield-Dodds, Scott R Johnston, Shauna M Kravec, Timothy Maxwell, Sam Mc-Candlish, Kamal Ndousse, Oliver Rausch, Nicholas Schiefer, Da Yan, Miranda Zhang, and Ethan Perez. 2024. Towards under…
  73. Jianna So, Connie Cheng, and Sonia Krishna Murthy. 2026. Beyond anthropomorphism: a spectrum of interface metaphors for LLMs. In Proceedings of the Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems, pages 1–7. find
  74. Yao Song and Yan Luximon. 2020. Trust in AI agent: A systematic review of facial anthropomorphic trustworthiness for social robot design. Sensors, 20(18):5087. find
  75. Hari Subramonyam, Roy Pea, Christopher Pondoc, Maneesh Agrawala, and Colleen Seifert. 2024. Bridging the gulf of envisioning: Cognitive challenges in prompt based interactions with LLMs. In Proceedings of the CHI Conference on Human Factors in Computing Systems, pages 1–19. find
  76. Peiqi Sui, Eamon Duede, Sophie Wu, and Richard So. 2024. Confabulation: The surprising value of large language model hallucinations. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14274–14284, Bangkok, Thailand. Association f… find
  77. Jason Wei. 2024. There is a nuanced but important difference between chain-of-thought before and after o1. ... find
  78. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824– 24837.
  79. Xumeng Wen, Zihan Liu, Shun Zheng, Shengyu Ye, Zhirong Wu, Yang Wang, Zhijian Xu, Xiao Liang, Junjie Li, Ziming Miao, Jiang Bian, and Mao Yang. 2026. Reinforcement learning with verifiable rewards implicitly incentivizes correct reasoning in base LLMs. In The Fourteenth International Conference on L… find
  80. Jia-Yu Yao, Kun-Peng Ning, Zhen-Hui Liu, Mu-Nan Ning, Yu-Yang Liu, and Li Yuan. 2023. LLM lies: Hallucinations are not bugs, but features as adversarial examples. arXiv preprint arXiv:2310.01469. — [arXiv:2310.01469](https://arxiv.org/abs/2310.01469) find
  81. Hongxin Zhang, Yanzhe Zhang, Ruiyi Zhang, and Diyi Yang. 2022. Robustness of demonstration-based learning under limited data scenario. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 1769–1782, Abu Dhabi, United Arab Emirates. Association for Computat… find
  82. Tan Zhi-Xuan, Micah Carroll, Matija Franklin, and Hal Ashton. 2024. Beyond preferences in AI alignment. Philosophical Studies, pages 1–51. find
  83. Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc V Le, and Ed H. Chi. 2023. Least-to-most prompting enables complex reasoning in large language models. In The Eleventh International Conference on Learning Representation…
  84. Kaitlyn Zhou, Jena D. Hwang, Xiang Ren, Nouha Dziri, Dan Jurafsky, and Maarten Sap. 2025. REL-A.I.: An interaction-centered approach to measuring human-LM reliance. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human La… find
  85. Jingming Zhuo, Songyang Zhang, Xinyu Fang, Haodong Duan, Dahua Lin, and Kai Chen. 2024. Prosa: Assessing and understanding the prompt sensitivity of LLMs. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 1950–1976. find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/ibrahim-2026-thinking-beyond-anthropomorphic-paradigm-benefits/