Chao Pang
Chao Pang has 2 papers in our library, in 2020–2021, most of them on Language models & pretraining, Multilingual & cross-lingual NLP; often with Shuohuan Wang, Yu Sun, Haifeng Wang.
OpenAlex · ORCID · h-index 9 · 37 works · 418 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 246 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #3535
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workMultilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation (2021 · 328 citations)
Most very large language models, such as GPT-3, learn only from raw text and are trained auto-regressively. - ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora (2020 · 127 citations)
Cross-lingual pre-trained encoders gain a lot from parallel data, but bilingual corpora are scarce, particularly for low-resource languages, which limits how well such models align meaning across languages.
All works
- ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2107.02137Yu Sun, Shuohuan Wang, Shikun Feng, et al.2021 · 328 citations
- ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual CorporaConference on Empirical Methods in Natural Language Processing (EMNLP)Xuan Ouyang, Shuohuan Wang, Chao Pang, et al.2020 · 127 citations
- ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731 · original ↗ · no summary yetShuohuan Wang et al.2021 · 63 citations
- ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming LanguagesarXiv:2212.06742 · original ↗ · no summary yetYekun Chai et al.2022 · 32 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/chao-pang/