Imanol Schlag
Imanol Schlag has 2 papers in our library, in 2021–2022, most of them on Language models & pretraining, Reasoning; often with Aitor Lewkowycz, Ambrose Slone, Anders Andreassen.
OpenAlex · h-index 10 · 43 works · 572 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 888 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #2531
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 worksApplied Mathematics · 1 workMathematics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workReasoning · 1 work
Works by year
2020s
Papers
- Solving Quantitative Reasoning Problems with Language Models (2022 · 992 citations)
Large language models handle many language tasks well but have struggled with quantitative problems in mathematics, science and engineering, where a solver must understand a word problem, recall relevant knowledge and carry out exact symbolic and numerical steps. - Linear Transformers Are Secretly Fast Weight Programmers (2021 · 111 citations)
The paper shows that linear Transformers, which replace softmax attention with a kernel-based approximation, are mathematically the same as the outer-product Fast Weight Programmers (FWPs) Schmidhuber proposed in the early 1990s, apart from a normalisation term.
All works
- Solving Quantitative Reasoning Problems with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Aitor Lewkowycz, Anders Andreassen, David Dohan, et al.2022 · 992 citations
- Linear Transformers Are Secretly Fast Weight ProgrammersarXiv:2102.11174Imanol Schlag, Kazuki Irie, Jurgen Schmidhuber2021 · 111 citations
- Large Language Model Programs ↗arXiv:2305.05364 · no summary yetImanol Schlag et al.2023 · 18 citations
Co-authors here
- Aitor Lewkowycz
- Ambrose Slone
- Anders Andreassen
- Behnam Neyshabur
- Cem Anil
- David Dohan
- Ethan Dyer
- Henryk Michalewski
- Jurgen Schmidhuber
- Vinay Ramasesh
- Yuhuai Wu
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL)
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2022
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/imanol-schlag/