Xiaozhe Ren

Xiaozhe Ren has 2 papers in our library, in 2021–2023, most of them on Language models & pretraining; often with Xiaoda Zhang, Chen Li, Hui Wang.

2 papers in our library · 2021–2023

The profile is the library's match of the name; two people with one name are not always told apart.

Affiliations

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine.

Of its works in our library, with the number of works on each.

The most cited first (OpenAlex and our library).

PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation (2021 · 161 citations)
GPT-3 showed that huge autoregressive models can solve many tasks from only a few examples, or none. However, it was trained mainly on English and is reachable only through a restricted API. This technical report presents PanGu-α, a family of Chinese autoregressive language models scaling up to 200 billion…
PanGu-{\Sigma}: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing (2023 · 40 citations)
PanGu-Σ is a Huawei technical report on training a trillion-parameter language model on limited hardware. Sparse Mixture-of-Experts models usually suffer from unbalanced expert load and costly all-to-all communication, and offloading work to the host CPU tends to reduce throughput. The authors start from PanGu-α…

7 co-authors with a page, the most papers together first.

Papers of our library cite their works 105 times (of the 149,439 papers whose bibliographies we read); 33 citing papers with a page here →.

Updated 1 November 2026