Elamur Research⌕
☰
home / authors / Siyu Ding

Siyu Ding

Siyu Ding has 3 papers in our library, in 2020–2021, most of them on Language models & pretraining; often with Junyuan Shang, Shuohuan Wang, Yu Sun.

3 papers in our library · 2020–2021

OpenAlex · ORCID · h-index 15 · 65 works · 979 citations OpenAlex, 2026-10-14

📄 3 works in our library · 🔗 Cited 189 times in our library · ⭐ Paper Stars ranking: #4224

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓Tsinghua UniversityBeijing · China2020–2026 · 24 paperscurrent🎓Wuhan Polytechnic UniversityWuhan · China2023–2026 · 14 paperscurrent🎓Keyi College of Zhejiang Sci-Tech UniversityShaoxing · China2026 · 1 papercurrent🎓Kyushu UniversityFukuoka · Japan2020–2022 · 6 papers🏢BaiduBeijing · China2020–2022 · 4 papers🎓Zhejiang University of TechnologyHangzhou · China2021–2022 · 3 papers🔬State Key Laboratory of Advanced Technology For Materials Synthesis and ProcessingWuhan2018 · 2 papers🎓Wuhan University of TechnologyWuhan · China2018 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 5 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksComputer Vision and Pattern Recognition · 3 worksLanguage and Linguistics · 3 works

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works

 Works by year

2020s

20212 papers20201 paper

 Papers

The most cited first (OpenAlex and our library).

  1. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation (2021 · 332 citations)
    Most very large language models, such as GPT-3, learn only from raw text and are trained auto-regressively.
  2. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation (2021 · 63 citations)
    Very large language models such as GPT-3 show that scale pays off. However, most are trained on plain text only, and their outputs are hard to steer or verify against real-world facts. This work scales up the knowledge-enhanced ERNIE 3.0 framework, which combines auto-encoding and auto-regressive networks and learns…
  3. ERNIE-Doc: A Retrospective Long-Document Modeling Transformer (2020 · 27 citations)
    Standard Transformers struggle with long documents because self-attention cost grows quadratically with input length.

 Co-authors here

12 of 15 co-authors with a page, the most papers together first.

 Cited by

Papers of our library cite their works 189 times (of the 149,439 papers whose bibliographies we read); 30 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/siyu-ding/