Elamur Research⌕
☰
home / authors / Torsten Hoefler

Torsten Hoefler

Torsten Hoefler has 2 papers in our library, in 2018–2024, most of them on Language models & pretraining; often with Amirkeivan Mohtashami, Bo Li, Dan Alistarh.

2 papers in our library · 2018–2024

OpenAlex · ORCID · h-index 59 · 606 works · 13,606 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 829 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #4124

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓ETH ZurichZurich · Switzerland2012–2026 · 490 paperscurrent🏢MicrosoftRedmond · United States2022–2026 · 13 paperscurrent🔬CSCS - Swiss National Supercomputing CentreLugano2024–2026 · 5 paperscurrent🎓Institute of Science and Technology AustriaKlosterneuburg · Austria2020–2026 · 2 paperscurrent🎓University of Illinois Urbana-ChampaignUrbana · United States2010–2017 · 44 papers🎓Indiana UniversityBloomington · United States2006–2010 · 34 papers🎓Indiana University BloomingtonBloomington · United States2006–2010 · 32 papers🎓Chemnitz University of TechnologyChemnitz · Germany2005–2008 · 21 papers🔬National Center for Supercomputing ApplicationsUrbana · United States2010–2012 · 9 papers🔬Lawrence Livermore National LaboratoryLivermore · United States2012–2016 · 3 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 10 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksHardware and Architecture · 1 workArts and Humanities · 1 workEngineering · 1 workElectrical and Electronic Engineering · 1 workLanguage and Linguistics · 1 work

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work

 Works by year

2020s

20241 paper

2010s

20181 paper

 Papers

The most cited first (OpenAlex and our library).

  1. Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis (2018 · 275 citations)
    Training modern deep neural networks has become so computationally heavy that it effectively requires high-performance clusters.
  2. QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs (2024 · 254 citations)
    Quantizing large language models to 4 bits is hard because activations contain outliers: individual channels whose values are many times larger than the rest.

All works

4 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

  1. Graph of Thoughts: Solving Elaborate Problems with Large Language Models ↗arXiv:2308.09687 · Proceedings of the AAAI Conference on Artificial Intelligence 2024 (AAAI'24) · no summary yetMaciej Besta et al.2023 · 1,025 citations
  2. Demystifying Parallel and Distributed Deep Learning ↗ACM Computing Surveys · no summary yetTal Ben‐Nun, Torsten Hoefler2019 · 589 citations
  3. Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency AnalysisACM Computing Surveys 2019Tal Ben-Nun, Torsten Hoefler2018 · 275 citations
  4. QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMsConference on Neural Information Processing Systems (NeurIPS)Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, et al.2024 · 254 citations

 Co-authors here

4 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 829 times (of the 149,439 papers whose bibliographies we read); 186 citing papers with a page here →.

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/torsten-hoefler/