Zewen Chi
Zewen Chi has 2 papers in our library, in 2020–2022, most of them on Language models & pretraining, Multilingual & cross-lingual NLP; often with Furu Wei, Heyan Huang, Li Dong.
OpenAlex · ORCID · h-index 17 · 68 works · 1,285 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 394 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #3758
Affiliations
Concepts, shelves and topics
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksMultilingual & cross-lingual NLP · 2 works
Works by year
2020s
Papers
- InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training (2020 · 271 citations)
The paper addresses why multilingual encoders transfer across languages and how to strengthen that ability. - XLM-E: Cross-lingual Language Model Pre-training via ELECTRA (2022 · 126 citations)
Cross-lingual encoders such as XLM-R are typically trained with masked language modeling, sometimes extended with parallel-data objectives like TLM, and this demands very large compute budgets.
All works
- InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingarXiv:2007.07834Zewen Chi, Li Dong, Furu Wei, et al.2020 · 271 citations
- XLM-E: Cross-lingual Language Model Pre-training via ELECTRAAnnual Meeting of the Association for Computational Linguistics (ACL)Zewen Chi, Shaohan Huang, Li Dong, et al.2022 · 126 citations
- Towards Stable and Effective Reinforcement Learning for Mixture-of-Experts ↗Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDi Zhang et al.2026 · 1 citation
Co-authors here
- Furu Wei ×2
- Heyan Huang ×2
- Li Dong ×2
- Saksham Singhal ×2
- Xia Song ×2
- Xian-Ling Mao ×2
- Bo Zheng
- Ming Zhou
- Nan Yang
- Payal Bajaj
- Shaohan Huang
- Shuming Ma
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2022
- Conference on Neural Information Processing Systems (NeurIPS)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zewen-chi/