Benjamin Bergen
Benjamin Bergen has 4 papers in our library, in 2022–2024, most of them on Language models & pretraining, Multilingual & cross-lingual NLP, Low-resource languages; often with Tyler A. Chang, Zhuowen Tu.
OpenAlex · ORCID · h-index 36 · 165 works · 5,150 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 235 citations in our library · 4 more in our library without a page yet · ⭐ Paper Star rank #4110
Affiliations
Concepts, shelves and topics
📚 Shelves 4 Arts and Humanities · 4 works Language and Linguistics · 4 works Artificial Intelligence · 3 works Computer Science · 3 works
🧭 Topics 4 Language models & pretraining · 3 works Multilingual & cross-lingual NLP · 2 works Low-resource languages · 1 work English · 1 work
Works by year
2020s
Papers
- Language Model Behavior: A Comprehensive Survey (2024 · 148 citations)
Transformer language models are now deployed widely, often with little or no task-specific tuning, but their outputs remain hard to predict, and the research on their behavior is scattered across hundreds of papers. - When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages (2024 · 85 citations)
Multilingual language models are often used to support low-resource languages, but there is little direct evidence about how sharing a model with other languages affects modeling quality in any single language. - The Geometry of Multilingual Language Model Representations (2022 · 82 citations)
Multilingual language models are often described as mapping all languages into one common space. They also keep language-specific signals, and it has been unclear how both coexist geometrically. Chang, Tu and Bergen study this in XLM-R. They feed it OSCAR web text in 88 languages and use SVD to build a mean-shifted… - Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context (2022 · 2 citations)
Sensorimotor resources such as the Lancaster Sensorimotor Norms assign each word one profile, rated without context.
All works
- Language Model Behavior: A Comprehensive SurveyTyler A. Chang, Benjamin K. BergenComputational Linguistics · 148 citations
- When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource LanguagesTyler A. Chang, Catherine Arnett, Zhuowen Tu, et al.Conference on Empirical Methods in Natural… · 85 citations
- The Geometry of Multilingual Language Model RepresentationsTyler A. Chang, Zhuowen Tu, Benjamin K. BergenConference on Empirical Methods in Natural… · 82 citations
- Why do language models perform worse for morphologically complex languages? (original ↗)Catherine Arnett, Benjamin Bergen2025 · Proceedings of the 31st International… · 52 citations · no summary yet
- RAW-C: Relatedness of Ambiguous Words in Context (A New Lexical Resource for English) (original ↗)Sean Trott, Benjamin Bergen2021 · Proceedings of the 59th Annual Meeting of the… · 30 citations · no summary yet
- Comparing Humans and Large Language Models on an Experimental Protocol Inventory for Theory of Mind Evaluation (EPITOME) (original ↗)Cameron R. Jones, Sean Trott, Benjamin Bergen2024 · Transactions of the Association for… · 16 citations · no summary yet
- Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in contextSean Trott, Benjamin BergenarXiv:2203.05648 · 2 citations
- When Do Large Language Models Exhibit Unsolicited Deception? (original ↗)Samuel M. Taylor, Benjamin K. Bergen2026 · Transactions of the Association for… · 1 citation · no summary yet
Co-authors here
- Tyler A. Chang ×3
- Zhuowen Tu ×2
Venues
- Conference on Empirical Methods in Natural Language… ×2: 2024, 2022
- Transactions of the Association for Computational… ×2
- Computational Linguistics: 2024
- Proceedings of the 31st International Conference on…
- Proceedings of the 59th Annual Meeting of the Association…
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/benjamin-bergen/