Elamur Research⌕
☰
home / authors / Kangwook Lee

Kangwook Lee

Kangwook Lee has 2 papers in our library, in 2023–2025, most of them on Language models & pretraining, Efficient models & compression; often with Jason D. Lee, Jinwoo Ahn.

2 papers in our library · 2023–2025

OpenAlex · ORCID · h-index 16 · 91 works · 1,411 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 55 times in our library · ⭐ Paper Stars ranking: #8698

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 3 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

 Works by year

2020s

 Papers

The most cited first (OpenAlex and our library).

  1. Teaching Arithmetic to Small Transformers (2023 · 57 citations)
    The paper asks which factors let a next-token predictor acquire arithmetic. It uses a controlled setting: small decoder-only transformers (NanoGPT and GPT-2, from 10.6M up to 124M parameters) trained from random initialization with character-level tokens. Tasks include addition, subtraction, multiplication, square…
  2. Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMs (2025 · 6 citations)
    Offline knowledge distillation for LLM pre-training means running the teacher once, caching its outputs, and reusing them to train many students.

 Co-authors here

2 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 55 times (of the 149,439 papers whose bibliographies we read); 7 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/kangwook-lee/