Samy Jelassi
Samy Jelassi has 3 papers in our library, in 2023–2025, most of them on Language models & pretraining; often with Eran Malach, Sham M. Kakade, David Brandfonbrener.
OpenAlex · h-index 7 · 34 works · 154 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 148 times in our library · 7 more in our library without a page yet · ⭐ Paper Stars ranking: #7967
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Repeat After Me: Transformers are Better than State Space Models at Copying (2024 · 57 citations)
The paper asks what models with a constant-size memory give up in exchange for cheap inference. The authors call this family "generalized state space models" (GSSMs). It includes S4, Mamba, LSTMs and linear-attention variants. The authors find that the main loss is the ability to reproduce or retrieve arbitrary parts… - Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining (2025 · 34 citations)
The paper asks why reinforcement-learning fine-tuning improves mathematical reasoning in language models. Pretraining data for popular base models such as Qwen is usually undisclosed, which makes it hard to separate the effect of RL from the effect of pretraining. To get around this, the authors train decoder-only… - Length Generalization in Arithmetic Transformers (2023 · 29 citations)
The paper asks whether transformers can learn integer arithmetic on short operands and still be correct on much longer ones.
All works
- Repeat After Me: Transformers are Better than State Space Models at CopyingarXiv:2402.01032Samy Jelassi, David Brandfonbrener, Sham M. Kakade, et al.2024 · 57 citations
- Echo Chamber: RL Post-training Amplifies Behaviors Learned in PretrainingarXiv:2504.07912Rosie Zhao, Alexandru Meterez, Sham Kakade, et al.2025 · 34 citations
- Length Generalization in Arithmetic TransformersarXiv:2306.15400Samy Jelassi, Stéphane d'Ascoli, Carles Domingo-Enrich, et al.2023 · 29 citations
- Vision Transformers Provably Learn Spatial Structure ↗neural information processing systems · no summary yetSamy Jelassi, Michael Sander, Yuanzhi Li2022 · 23 citations
- LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks ↗Proceedings of the 31st International Conference on Computational Linguistics: Industry Track · no summary yetAkshara Prabhakar et al.2025 · 14 citations
- Towards understanding how momentum improves generalization in deep learning ↗arXiv (Cornell University) · no summary yetSamy Jelassi, Yuanzhi Li2022 · 11 citations
- Mixture of Parrots: Experts improve memorization more than reasoning ↗arXiv (Cornell University) · no summary yetSamy Jelassi et al.2024 · 4 citations
- Matching Features, Not Tokens: Energy-Based Fine-Tuning of Language Models ↗arXiv (Cornell University) · no summary yetSamy Jelassi et al.2026 · 1 citation
- How Does Overparameterization Affect Features? ↗arXiv (Cornell University) · no summary yetAhmet Cagri Duzgun, Samy Jelassi, Yuanzhi Li2024
- Dissecting adaptive methods in GANs ↗arXiv (Cornell University) · no summary yetSamy Jelassi et al.2022
Co-authors here
- Eran Malach ×2
- Sham M. Kakade ×2
- David Brandfonbrener
- François Charton
- Stéphane d'Ascoli
- Yuanzhi Li
- Yuhuai Wu
Venues
- Proceedings of the 31st International Conference on Computational Linguistics: Industry Track
- neural information processing systems
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/samy-jelassi/