Elamur Research⌕
☰
home / authors / Punit Singh Koura

Punit Singh Koura

Punit Singh Koura has 2 papers in our library, in 2022–2023, most of them on Language models & pretraining; often with Andrew Poulton, Daniel Simig, Diana Liskovich.

2 papers in our library · 2022–2023

OpenAlex · h-index 7 · 12 works · 3,819 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 7,794 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6119

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work

 Works by year

2020s

20231 paper20221 paper

 Papers

The most cited first (OpenAlex and our library).

  1. OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization (2022 · 244 citations)
    Instruction-tuning means fine-tuning a large language model on many tasks phrased as instructions. It is known to help zero- and few-shot transfer, but it was unclear how individual design choices affect results. The authors examine these choices at scale. They merged 8 existing task collections into OPT-IML Bench…
  2. A Theory on Adam Instability in Large-Scale Machine Learning (2023 · 15 citations)
    Very large language models sometimes show sudden loss spikes during training, and the cause has not been explained.

All works

3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

  1. OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of GeneralizationarXiv:2212.12017Srinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, et al.2022 · 244 citations
  2. Few-shot Learning with Multilingual Generative Language Models ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetXi Victoria Lin et al.2022 · 133 citations
  3. A Theory on Adam Instability in Large-Scale Machine LearningarXiv:2304.09871Igor Molybog, Peter Albert, Moya Chen, et al.2023 · 15 citations

 Co-authors here

12 of 18 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 7,794 times (of the 149,439 papers whose bibliographies we read); 1,639 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/punit-singh-koura/