Natalia Vassilieva
Natalia Vassilieva has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Joel Hestness, Biswajit Mishra, Bokang Jia.
OpenAlex · ORCID · h-index 8 · 26 works · 329 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 58 times in our library · ⭐ Paper Stars ranking: #7957
Affiliations
🏢Cerebras SystemsSunnyvale ·
United States2019–2026 · 6 papers🏢Hewlett-PackardPalo Alto ·
United States2011–2013 · 5 papers🎓Moscow State Institute of International RelationsMoscow ·
Russia1999–2021 · 1 paperEducationEmployment since 1999 · an associate professor, Department of International Relations and Foreign Policy of Russia
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- SlimPajama-DC: Understanding Data Combinations for LLM Training (2023 · 38 citations)
Pretraining corpora for LLMs are usually built from several sources, such as web crawls, code, books, and Wikipedia. - Bilingual Adaptation of Monolingual Foundation Models (2024 · 7 citations)
English-dominant open LLMs such as Llama 2 handle other languages poorly. Training a bilingual model from scratch is costly and tends to give weaker English. Adapting an existing model brings its own problems: it can forget English, and its English-centric tokenizer splits foreign text into many pieces. The authors…
Co-authors here
- Joel Hestness ×2
- Biswajit Mishra
- Bokang Jia
- Bowen Tan
- Eric P. Xing
- Gokul Ramakrishnan
- Gurpreet Gosal
- Liqun Ma
- Neha Sengupta
- Rituraj Joshi
- Sunil Kumar Sahu
- Zhengzhong Liu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/natalia-vassilieva/