Roger Grosse
Roger Grosse has 3 papers in our library, in 2020–2023, most of them on Reasoning, Language models & pretraining, Evaluation & benchmarks; often with Jimmy Lei Ba, Yuhuai Wu, Albert Q. Jiang.
OpenAlex · h-index 31 · 99 works · 7,450 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 964 times in our library · 22 more in our library without a page yet · ⭐ Paper Stars ranking: #6931
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArtificial Intelligence · 3 worksArts and Humanities · 2 worksLanguage and Linguistics · 2 worksComputational Theory and Mathematics · 1 work
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 1 workReasoning · 2 worksEvaluation & benchmarks · 1 work
Works by year
2020s
Papers
- Studying Large Language Model Generalization with Influence Functions (2023 · 105 citations)
Knowing which training examples drive a given behavior in a large language model could help researchers anticipate and reduce its risks. - INT: An Inequality Benchmark for Evaluating Generalization in Theorem Proving (2020 · 41 citations)
Learning-based theorem provers struggle with two issues: formal proof corpora are small, and useful target theorems often differ substantially from those seen in training. - LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning (2021 · 39 citations)
The paper asks whether the inductive bias needed for mathematical reasoning can be taught to a generic transformer through data rather than through specialized architectures.
All works
- Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations ↗International Conference on Machine Learning · no summary yetHonglak Lee et al.2009 · 2,412 citations
- Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation ↗arXiv (Cornell University) · no summary yetYuhuai Wu et al.2017 · 450 citations
- Importance Weighted Autoencoders ↗arXiv (Cornell University) · no summary yetYuri Burda, Roger Grosse, Ruslan Salakhutdinov2015 · 316 citations
- Toy Models of Superposition ↗arXiv:2209.10652 · no summary yetNelson Elhage et al.2022 · 277 citations
- Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches ↗arXiv:1803.04386 · no summary yetYeming Wen et al.2018 · 189 citations
- Studying Large Language Model Generalization with Influence FunctionsarXiv:2308.03296Roger Grosse, Juhan Bae, Cem Anil, et al.2023 · 105 citations
- Distributed Second-Order Optimization using Kronecker-Factored Approximations ↗International Conference on Learning Representations · no summary yetJimmy Lei Ba, Roger Grosse, James Martens2017 · 73 citations
- Accurate and Conservative Estimates of MRF Log-likelihood using Reverse Annealing ↗arXiv (Cornell University) · no summary yetYuri Burda, Roger Grosse, Ruslan Salakhutdinov2014 · 43 citations
- INT: An Inequality Benchmark for Evaluating Generalization in Theorem ProvingarXiv:2007.02924Yuhuai Wu, Albert Qiaochu Jiang, Jimmy Ba, et al.2020 · 41 citations
- On the Quantitative Analysis of Decoder-Based Generative Models ↗arXiv (Cornell University) · no summary yetYuhuai Wu et al.2016 · 41 citations
- LIME: Learning Inductive Bias for Primitives of Mathematical ReasoningarXiv:2101.06223Yuhuai Wu, Markus Rabe, Wenda Li, et al.2021 · 39 citations
- Exploiting compositionality to explore a large space of model structures ↗arXiv (Cornell University) · no summary yetRoger Grosse et al.2012 · 33 citations
- Reversible Recurrent Neural Networks ↗arXiv (Cornell University) · no summary yetMatthew Mackay et al.2018 · 30 citations
- Adversarial Distillation of Bayesian Neural Network Posteriors ↗arXiv (Cornell University) · no summary yetKuan-Chieh Wang et al.2018 · 29 citations
- Learning Wake-Sleep Recurrent Attention Models ↗arXiv (Cornell University) · no summary yetJimmy Lei Ba et al.2015 · 29 citations
- The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoning ↗arXiv (Cornell University) · no summary yetYuhuai Wu et al.2020 · 27 citations
- Analyzing Monotonic Linear Interpolation in Neural Network Loss Landscapes ↗arXiv (Cornell University) · no summary yetJames Lucas et al.2021 · 13 citations
- When Does Preconditioning Help or Hurt Generalization? ↗arXiv (Cornell University) · no summary yetШун-ичи Амари et al.2020 · 11 citations
- Aggregated Momentum: Stability Through Passive Damping ↗arXiv (Cornell University) · no summary yetJames Lucas et al.2018 · 10 citations
- Sabotage Evaluations for Frontier Models ↗arXiv (Cornell University) · no summary yetJoe Benton et al.2024 · 7 citations
- Second-order Optimization for Deep Reinforcement Learning using Kronecker-factored Approximation ↗neural information processing systems · no summary yetYuhuai Wu et al.2017 · 7 citations
- Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curve ↗arXiv (Cornell University) · no summary yetJuhan Bae et al.2022 · 4 citations
- Forecasting Rare Language Model Behaviors ↗arXiv (Cornell University) · no summary yetErik Jones et al.2025 · 3 citations
- On Monotonic Linear Interpolation of Neural Network Parameters ↗International Conference on Machine Learning · no summary yetJames Lucas et al.2021 · 1 citation
- Accurate and Conservative Estimates of MRF Log-likelihood using Reverse Annealing. arXiv:1412.8566 ↗no summary yetYuri Burda, Roger Grosse, Ruslan Salakhutdinov2014
Co-authors here
- Jimmy Lei Ba ×2
- Yuhuai Wu ×2
- Albert Q. Jiang
- Alex Tamkin
- Benoit Steiner
- Cem Anil
- Christian Szegedy
- Dustin Li
- Esin Durmus
- Ethan Perez
- Evan Hubinger
- Kamile Lukošiute
Venues
- International Conference on Machine Learning ×2
- International Conference on Learning Representations
- neural information processing systems
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/roger-grosse/