Orevaoghene Ahia
Orevaoghene Ahia has 4 papers in our library, in 2023–2026, most of them on Language models & pretraining, Tokenization & segmentation, Multilingual & cross-lingual NLP; often with Hila Gonen, Sachin Kumar, Noah A. Smith.
OpenAlex · h-index 10 · 53 works · 889 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 890 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #5463
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 4 worksArts and Humanities · 4 worksComputer Science · 4 worksLanguage and Linguistics · 4 worksSafety Research · 2 worksSocial Sciences · 2 works
🧭 Topics 5Research subjects and languages the work is about.Language models & pretraining · 4 worksTokenization & segmentation · 3 worksMultilingual & cross-lingual NLP · 2 worksMorphology · 1 workBias, fairness & safety · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Subword tokenization · 1 workTokenization · 1 work
Works by year
2020s
Papers
- Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models (2023 · 174 citations)
Commercial LM APIs bill per token, but how many tokens a text needs depends on the tokenizer and its training data. - MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language Modeling (2024 · 30 citations)
Byte-level multilingual language models avoid the coverage gaps of subword vocabularies, but they inherit a bias built into UTF-8. - MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based Tokenization (2024 · 19 citations)
Byte-level and subword language models usually split non-Latin-script text into many more pieces than English. - FLEXITOKENS: Flexible Tokenization for Evolving Language Models (2026 · 3 citations)
Subword tokenizers stay fixed when a language model is finetuned. As a result, text from new domains, unseen languages or unfamiliar scripts gets split into too many pieces, which hurts accuracy and inflates compute costs. Byte-level models with a learned segmentation module are meant to fix this. In practice…
All works
- Do All Languages Cost the Same? Tokenization in the Era of Commercial Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Orevaoghene Ahia, Sachin Kumar, Hila Gonen, et al.2023 · 174 citations
- MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Tomasz Limisiewicz, Terra Blevins, Hila Gonen, et al.2024 · 30 citations
- MAGNET: Improving the Multilingual Fairness of Language Models with Adaptive Gradient-Based TokenizationConference on Neural Information Processing Systems (NeurIPS)Orevaoghene Ahia, Sachin Kumar, Hila Gonen, et al.2024 · 19 citations
- Extracting Lexical Features from Dialects via Interpretable Dialect Classifiers ↗Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers) · no summary yetRoy Xie et al.2024 · 7 citations
- FLEXITOKENS: Flexible Tokenization for Evolving Language ModelsFindings of the Association for Computational LinguisticsAbraham Toluwase Owodunni, Orevaoghene Ahia, Sachin Kumar2026 · 3 citations
- IDIOLEX: Unified and Continuous Representations for Idiolectal and Stylistic Variation ↗arXiv (Cornell University) · no summary yetAnjali Kantharuban et al.2026
Co-authors here
- Hila Gonen ×3
- Sachin Kumar ×3
- Noah A. Smith ×2
- Tomasz Limisiewicz ×2
- Yulia Tsvetkov ×2
- Abraham Toluwase Owodunni
- David R. Mortensen
- Jungo Kasai
- Luke Zettlemoyer
- Terra Blevins
- Valentin Hofmann
Venues
- Conference on Empirical Methods in Natural Language Processing (EMNLP) ×2: EMNLP 2023
- Findings of the Association for Computational Linguistics ×2: Findings of the Association for Computational Linguistics 2026
- Transactions of the Association for Computational Linguistics (TACL) ×2
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2024
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
- Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/orevaoghene-ahia/