Malte Ostendorff
Malte Ostendorff has 2 papers in our library, in 2023–2026, most of them on Language models & pretraining, Multilingual & cross-lingual NLP; often with Atnafu Lambebo Tonja, Catherine Arnett, Georg Rehm.
OpenAlex · ORCID · Wikidata · h-index 13 · 62 works · 400 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 263 times in our library · 5 more in our library without a page yet · ⭐ Paper Stars ranking: #8135
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workMultilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning (2023 · 36 citations)
Large Transformer language models are mostly pretrained on English. Training equally large models for other languages from scratch requires data and compute that are often unavailable. Ostendorff and Rehm propose CLP-Transfer, which transfers both across languages and across model sizes. To build a large… - CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web Data (2026 · 3 citations)
Language identification (LID) is often treated as a solved task. In practice, it remains unreliable for many languages on noisy, mixed web text, which is the main source of multilingual pre-training corpora. Most existing benchmarks, such as FLORES, UDHR and Bible data, are clean, translated or religious, so they…
All works
- Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddings ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetMalte Ostendorff et al.2022 · 116 citations
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer LearningarXiv:2301.09626Malte Ostendorff, Georg Rehm2023 · 36 citations
- Evaluating Document Representations for Content-based Legal Literature Recommendations ↗arXiv:2104.13841 · no summary yetMalte Ostendorff et al.2021 · 34 citations
- Fine-grained Classification of Political Bias in German News: A Data Set and Initial Experiments ↗Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021) · no summary yetDmitrii Aksenov et al.2021 · 33 citations
- Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation ↗Proceedings of the Ninth Conference on Machine Translation · no summary yetEleftherios Avramidis et al.2024 · 6 citations
- CommonLID: Re-evaluating State-of-the-Art Language Identification Performance on Web DataAnnual Meeting of the Association for Computational Linguistics (ACL)Pedro Ortiz Suarez, Laurie Burchell, Catherine Arnett, et al.2026 · 3 citations
- Claim Extraction and Law Matching for COVID-19-related Legislation ↗Proceedings of the Thirteenth Language Resources and Evaluation Conference · no summary yetNiklas Dehio, Malte Ostendorff, Georg Rehm2022 · 1 citation
Co-authors here
- Atnafu Lambebo Tonja
- Catherine Arnett
- Georg Rehm
- Idris Abdulmumin
- Laurie Burchell
- Pedro Ortiz Suarez
- Shamsuddeen Hassan Muhammad
- Vukosi Marivate
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Findings of the Association for Computational Linguistics
- Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
- Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)
- Proceedings of the Ninth Conference on Machine Translation
- Proceedings of the Thirteenth Language Resources and Evaluation Conference
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/malte-ostendorff/