Elamur Research⌕
☰
home / authors / Jacob Mitchell Springer

Jacob Mitchell Springer

Jacob Mitchell Springer has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Aditi Raghunathan, Suhas Kotha, Daniel Fried.

2 papers in our library · 2023–2024

OpenAlex · h-index 4 · 20 works · 56 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 118 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #7599

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓Carnegie Mellon UniversityPittsburgh · United States2023–2026 · 5 paperscurrent🏢AppleCupertino · United States2026 · 1 papercurrent🎓Swarthmore CollegeSwarthmore · United States2020–2021 · 4 papers🔬Los Alamos National LaboratoryLos Alamos · United States2021 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works

 Works by year

2020s

20241 paper20231 paper

 Papers

The most cited first (OpenAlex and our library).

  1. Repetition Improves Language Model Embeddings (2024 · 73 citations)
    Strong text embeddings are usually built on encoders with bidirectional attention. Recent work adapting autoregressive LMs for embeddings typically switches them to bidirectional attention and often adds extra training. This paper asks whether that change is really needed. The authors propose echo embeddings . The…
  2. Understanding Catastrophic Forgetting in Language Models via Implicit Inference (2023 · 45 citations)
    Fine-tuning large language models, such as instruction-tuning or RLHF, often reduces abilities the pretrained model had.

All works

3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

  1. Repetition Improves Language Model EmbeddingsarXiv:2402.15449Jacob Mitchell Springer, Suhas Kotha, Daniel Fried, et al.2024 · 73 citations
  2. Understanding Catastrophic Forgetting in Language Models via Implicit InferencearXiv:2309.10105Suhas Kotha, Jacob Mitchell Springer, Aditi Raghunathan2023 · 45 citations
  3. Overtrained Language Models Are Harder to Fine-Tune ↗arXiv (Cornell University) · no summary yetJacob M. Springer et al.2025 · 8 citations

 Co-authors here

4 co-authors with a page, the most papers together first.

 Cited by

Papers of our library cite their works 118 times (of the 149,439 papers whose bibliographies we read); 24 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/jacob-mitchell-springer/