Elamur Research⌕
☰
home / authors / Igor Molybog

Igor Molybog

Igor Molybog has 2 papers in our library, in 2023, most of them on Language models & pretraining; often with Andrew Poulton, Barlas Oguz, Diana Liskovich.

2 papers in our library · 2023

OpenAlex · ORCID · Wikidata · h-index 6 · 26 works · 2,663 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 7,262 times in our library · ⭐ Paper Stars ranking: #6751

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓University of Hawaiʻi at MānoaHonolulu · United States2024–2026 · 7 paperscurrent🎓University of California, BerkeleyBerkeley · United States2018–2021 · 7 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work

 Works by year

2020s

20232 papers

 Papers

The most cited first (OpenAlex and our library).

  1. Effective Long-Context Scaling of Foundation Models (2023 · 184 citations)
    In 2023, strong long-input handling was mostly available through proprietary APIs. Earlier open attempts to extend context were usually judged only by perplexity or synthetic probes, and they often lost quality on short tasks. This Meta paper introduces Llama 2 Long, a family of 7B–70B models built by continuing to…
  2. A Theory on Adam Instability in Large-Scale Machine Learning (2023 · 15 citations)
    Very large language models sometimes show sudden loss spikes during training, and the cause has not been explained.

 Co-authors here

12 of 18 co-authors with a page, the most papers together first.

 Cited by

Papers of our library cite their works 7,262 times (of the 149,439 papers whose bibliographies we read); 1,540 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/igor-molybog/