Elamur Research⌕
☰
home / authors / Yutao Sun

Yutao Sun

Yutao Sun has 2 papers in our library, in 2023, most of them on Language models & pretraining; often with Furu Wei, Li Dong, Shuming Ma.

2 papers in our library · 2023

OpenAlex · h-index 6 · 28 works · 251 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 173 times in our library · ⭐ Paper Stars ranking: #3867

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🏢MicrosoftRedmond · United States2022–2024 · 5 papers🎓Beijing University of Posts and TelecommunicationsBeijing · China2024–2025 · 3 papers🔬Changzhou Vocational Institute of EngineeringChangzhou · China2022–2025 · 2 papers🎓Fudan UniversityShanghai · China2022–2023 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 4 more institutions on single bylines are not listed.

 Concepts, shelves and topics

Of its works in our library: the number of works on each and its rating among them.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work

 Works by year

2020s

20232 papersYutao Sun's papers of 2023

 Papers

The most cited first (OpenAlex and our library).

  1. Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers (2023 · 253 citations)
    This paper asks why large GPT-style models can solve new tasks from a few demonstrations without any weight updates.
  2. A Length-Extrapolatable Transformer (2023 · 117 citations)
    Transformers trained on sequences of a fixed maximum length usually degrade sharply when evaluated on longer inputs, and retraining large pre-trained models for longer contexts is costly.

 Co-authors here

11 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 173 times (of the 141,840 papers whose bibliographies we read); 29 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/yutao-sun/