Phillip Rust
Phillip Rust has 2 papers in our library, in 2021–2026, most of them on Language models & pretraining, Multilingual & cross-lingual NLP, Tokenization & segmentation; often with Angelo Ortiz Tandazo, Iryna Gurevych, Ivan Vulić.
OpenAlex · ORCID · h-index 7 · 22 works · 365 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 458 times in our library · ⭐ Paper Stars ranking: #4066
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 worksSignal Processing · 1 work
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 1 workMultilingual & cross-lingual NLP · 1 workTokenization & segmentation · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Subword tokenization · 1 workTokenization · 1 work
Works by year
2020s
Papers
- How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models (2021 · 449 citations)
New monolingual BERT models keep being released for languages that multilingual models already cover. The usual reason given is that multilingual models underperform on single-language tasks, but this claim has rarely been tested rigorously. Rust et al. test it with a controlled comparison of mBERT and existing… - SpidR-Adapt: A Universal Speech Representation Model for Few-Shot Adaptation (2026)
Self-supervised speech models such as HuBERT and WavLM need thousands of hours of audio to learn useful linguistic units. Infants manage this with a few hundred hours. SpidR-Adapt aims to narrow that gap, so that speech units can be learned for a new language from very little unlabeled audio.
Co-authors here
- Angelo Ortiz Tandazo
- Iryna Gurevych
- Ivan Vulić
- Jonas Pfeiffer
- Martin Gleize
- Sebastian Ruder
- Youssef Benchekroun
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/phillip-rust/