Weiwei Lü
Weiwei L\"u has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Biye Li, Bo Zhu, Cheng Cheng.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 98 times in our library · ⭐ Paper Stars ranking: #6669
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- Skywork: A More Open Bilingual Foundation Model (2023 · 91 citations)
Many organizations release LLM weights but withhold the data and training details needed to reproduce them. - Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models (2024 · 21 citations)
Training sparse Mixture-of-Experts (MoE) LLMs involves several practical choices whose effects are poorly understood.
Co-authors here
- Biye Li ×2
- Bo Zhu ×2
- Cheng Cheng ×2
- Liang Zhao ×2
- Tianwen Wei ×2
- Haihua Yang
- Jianhao Zhang
- Liang Zeng
- Lijie Wang
- Liu Yang
- Peng Cheng
- Rui Hu
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/weiwei-l-u/