Elamur Research⌕
☰
home / authors / Zheyuan Bai

Zheyuan Bai

Zheyuan Bai has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Fangcheng Liu, Kai Han, Yehui Tang.

2 papers in our library · 2023–2024

OpenAlex · h-index 2 · 5 works · 93 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 17 times in our library · ⭐ Paper Stars ranking: #9245

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🏢Huawei TechnologiesShenzhen · China2023 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksArts and Humanities · 1 workComputer Vision and Pattern Recognition · 1 workLanguage and Linguistics · 1 work

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works

 Works by year

2020s

20241 paper20231 paper

 Papers

The most cited first (OpenAlex and our library).

  1. PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation (2023 · 10 citations)
    Progress in large language models has mostly come from adding parameters and data. The design of the Transformer block itself gets little attention, even though large models are costly to run. The authors study LLaMA-style decoders and identify feature collapse: a rank metric shows token representations growing more…
  2. PanGu-π Pro:Rethinking Optimization and Architecture for Tiny Language Models (2024 · 8 citations)
    On-device deployment needs small language models that still perform well. Most tiny models, however, simply reuse recipes designed for much larger LLMs, and few studies test which of those choices actually suit a ~1B-parameter model. The authors run a systematic set of ablations on a 1B LLaMA-style baseline, trained…

 Co-authors here

8 co-authors with a page, the most papers together first.

 Cited by

Papers of our library cite their works 17 times (of the 149,439 papers whose bibliographies we read); 3 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/zheyuan-bai/