Elamur Research⌕
☰
home / authors / Kwangjun Ahn

Kwangjun Ahn

Kwangjun Ahn has 2 papers in our library, in 2023, most of them on Language models & pretraining; often with Suvrit Sra, Xiang Cheng, Chulhee Yun.

2 papers in our library · 2023

OpenAlex · ORCID · h-index 12 · 49 works · 938 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 38 times in our library · ⭐ Paper Stars ranking: #9804

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🏢MicrosoftRedmond · United States2024–2025 · 6 paperscurrent🎓Massachusetts Institute of TechnologyCambridge · United States2020–2024 · 16 papers🎓Korea Advanced Institute of Science and TechnologyDaejeon · South Korea2016–2018 · 4 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work

 Works by year

2020s

20232 papers

 Papers

The most cited first (OpenAlex and our library).

  1. Transformers learn to implement preconditioned gradient descent for in-context learning (2023 · 37 citations)
    The paper asks whether transformers merely can represent optimization algorithms or whether ordinary training actually drives them to do so.
  2. Linear attention is (maybe) all you need (to understand transformer optimization) (2023 · 10 citations)
    Training Transformers is notoriously hard. Plain SGD lags well behind adaptive optimizers such as Adam, and the loss landscape shows unusual properties that classical optimization theory does not account for. Full Transformers are too complex to analyze directly, so the authors look for the simplest model that still…

 Co-authors here

3 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 38 times (of the 149,439 papers whose bibliographies we read); 12 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/kwangjun-ahn/