Catherine Arnett
Catherine Arnett has 4 papers in our library, in 2024–2026, most of them on Language models & pretraining, Multilingual & cross-lingual NLP, Low-resource languages; often with Benjamin Bergen, Akshat Gupta, Atnafu Lambebo Tonja.
OpenAlex · h-index 3 · 41 works · 46 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 119 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6267
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 4 worksArts and Humanities · 4 worksComputer Science · 4 worksLanguage and Linguistics · 4 works
🧭 Topics 4Research subjects and languages the work is about.Language models & pretraining · 2 worksMultilingual & cross-lingual NLP · 2 worksLow-resource languages · 1 workMorphology · 1 work
Works by year
2020s
Papers
- When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages (2024 · 87 citations)
Multilingual language models are often used to support low-resource languages, but there is little direct evidence about how sharing a model with other languages affects modeling quality in any single language. - Why do language models perform worse for morphologically complex languages? (2025 · 53 citations)
Language models tend to perform better on fusional languages such as English than on agglutinative ones such as Turkish. - CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data (2026 · 3 citations)
Language identification (LID) is often treated as a solved task. In practice, it remains unreliable for many languages on noisy, mixed web text, which is the main source of multilingual pre-training corpora. Most existing benchmarks, such as FLORES, UDHR and Bible data, are clean, translated or religious, so they… - Weight Tying Biases Token Embeddings Towards the Output Space (2026)
Many language models share one matrix between the input embedding and the output (unembedding) layer, but it has been unclear what this sharing does to the learned representations.
All works
- When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP)Tyler A. Chang, Catherine Arnett, Zhuowen Tu, et al.2024 · 87 citations
- Why do language models perform worse for morphologically complex languages?International Conference on Computational Linguistics (COLING)Catherine Arnett, Benjamin Bergen2025 · 53 citations
- CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web DataAnnual Meeting of the Association for Computational Linguistics (ACL)Pedro Ortiz Suarez, Laurie Burchell, Catherine Arnett, et al.2026 · 3 citations
- Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs ↗arXiv:2605.09063 · no summary yetGuijin Son et al.2026 · 1 citation
- Weight Tying Biases Token Embeddings Towards the Output SpaceFindings of the Association for Computational LinguisticsAntonio Lopardo, Avyukth Harish, Catherine Arnett, et al.2026
Co-authors here
- Benjamin Bergen ×2
- Akshat Gupta
- Atnafu Lambebo Tonja
- Idris Abdulmumin
- Laurie Burchell
- Malte Ostendorff
- Pedro Ortiz Suarez
- Shamsuddeen Hassan Muhammad
- Tyler A. Chang
- Vukosi Marivate
- Zhuowen Tu
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- International Conference on Computational Linguistics (COLING): COLING 2025
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2024
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/catherine-arnett/