Wangchunshu Zhou
Wangchunshu Zhou has 3 papers in our library, in 2020–2024, most of them on Language models & pretraining, Efficient models & compression; often with Canwen Xu, Furu Wei, Fuzhao Xue.
OpenAlex · ORCID · h-index 19 · 127 works · 1,505 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 683 citations in our library · 12 more in our library without a page yet · ⭐ Paper Star rank #3404
Affiliations
Concepts, shelves and topics
📚 Shelves 5 Arts and Humanities · 3 works Computer Science · 3 works Artificial Intelligence · 3 works Language and Linguistics · 3 works Computer Vision and Pattern Recognition · 2 works
🧭 Topics 2 Efficient models & compression · 1 work Language models & pretraining · 1 work
Works by year
2020s
Papers
- BERT-of-Theseus: Compressing BERT by Progressive Module Replacing (2020 · 239 citations)
Large pretrained Transformers such as BERT are expensive to deploy because they use a lot of memory and run slowly. - RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models (2023 · 186 citations)
Open-source LLMs are trained for general use and are weak at imitating specific fictional characters. Strong closed models such as GPT-4 can do this, but they are costly, cannot be fine-tuned, and need all character details placed in the prompt. RoleLLM addresses this with a four-stage pipeline. First, the authors… - OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models (2024 · 61 citations)
Before this work, few open Mixture-of-Experts (MoE) language models had been trained on trillion-scale, diverse data, and little was known about how their routers actually behave.
Also in our library
Co-authors here
- Canwen Xu
- Furu Wei
- Fuzhao Xue
- Haoran Que
- Jiaheng Liu
- Jian Yang
- Ming Zhou
- Tao Ge
- Yang You
- Yao Fu
- Zekun Moore Wang
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/wangchunshu-zhou/