Elamur Research⌕
☰
home / authors / Niklas Nolte

Niklas Nolte

Niklas Nolte has 2 papers in our library, in 2022–2024, most of them on Language models & pretraining; often with Beidi Chen, Eric J. Michaud, Leon Bottou.

2 papers in our library · 2022–2024

OpenAlex · ORCID · h-index 52 · 1,197 works · 11,979 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 101 times in our library · ⭐ Paper Stars ranking: #7748

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓Massachusetts Institute of TechnologyCambridge · United States2021–2026 · 177 paperscurrent🔬The NSF AI Institute for Artificial Intelligence and Fundamental InteractionsCambridge · United States2022–2026 · 4 paperscurrent🔬European Organization for Nuclear ResearchGeneva · Switzerland2018–2021 · 104 papers🔬Laboratoire d’Annecy de Physique des ParticulesAnnecy · France2019–2024 · 13 papers🎓TU Dortmund UniversityDortmund · Germany2019–2023 · 11 papers🔬Centre National de la Recherche ScientifiqueParis · France2021–2024 · 8 papers🔬Institut National de Physique Nucléaire et de Physique des ParticulesParis · France2021–2024 · 8 papers🎓Université Savoie Mont BlancChambéry · France2021–2024 · 8 papers🔬Istituto Nazionale di Fisica Nucleare, Sezione di CagliariMonserrato · Italy2023–2024 · 5 papers🎓RWTH Aachen UniversityAachen · Germany2020–2023 · 5 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 22 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksArts and Humanities · 1 workComputer Vision and Pattern Recognition · 1 workLanguage and Linguistics · 1 work

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work

 Works by year

2020s

20241 paper20221 paper

 Papers

The most cited first (OpenAlex and our library).

  1. MagicPIG: LSH Sampling for Efficient LLM Generation (2024 · 68 citations)
    Serving long-context LLMs is constrained by the KV cache. It consumes GPU memory and makes decoding memory-bound. Many speedups keep only the highest-scoring keys (TopK attention). The authors show this is a biased estimator that breaks down when attention is spread out, as in aggregation tasks like common- or…
  2. Towards Understanding Grokking: An Effective Theory of Representation Learning (2022 · 65 citations)
    Grokking is the behavior where a neural network fits its training data early but only begins to generalize much later.

 Co-authors here

11 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 101 times (of the 149,439 papers whose bibliographies we read); 23 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/niklas-nolte/