Pingyi Zhou
Pingyi Zhou has 2 papers in our library, in 2022–2023, most of them on Language models & pretraining, Code & programming languages; often with Fei Mi, Hao Wu, Irina Piontkovskaya.
OpenAlex · ORCID · Wikidata · h-index 10 · 22 works · 402 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 75 times in our library · ⭐ Paper Stars ranking: #8333
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 workComputer Science Applications · 1 workInformation Systems · 1 work
🧭 Topics 2Research subjects and languages the work is about.Code & programming languages · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Compilable Neural Code Generation with Compiler Feedback (2022 · 63 citations)
Neural code generators, including pre-trained models such as CodeGPT, PLBART and CodeT5, treat programs as ordinary text and rarely check whether the output compiles. - PanGu-{\Sigma}: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing (2023 · 40 citations)
PanGu-Σ is a Huawei technical report on training a trillion-parameter language model on limited hardware. Sparse Mixture-of-Experts models usually suffer from unbalanced expert load and costly all-to-all communication, and offloading work to the host CPU tends to reduce throughput. The authors start from PanGu-α…
Co-authors here
- Fei Mi
- Hao Wu
- Irina Piontkovskaya
- Jin Liu
- Pengfei Li
- Qun Liu
- Xiaoda Zhang
- Xiaozhe Ren
- Xin Jiang
- Xin Wang
- Yao Wan
- Yasheng Wang
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2022
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/pingyi-zhou/