Anirudh Goyal
Anirudh Goyal has 5 papers in our library, in 2016–2025, most of them on Language models & pretraining, Reasoning; often with Yoshua Bengio, Michael C. Mozer, Nan Rosemary Ke.
OpenAlex · ORCID · h-index 21 · 132 works · 3,950 citations OpenAlex, 2026-10-14
📄 5 works in our library · 🔗 Cited 10,174 times in our library · 7 more in our library without a page yet · ⭐ Paper Stars ranking: #4782
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 5 worksArtificial Intelligence · 5 worksArts and Humanities · 3 worksLanguage and Linguistics · 3 worksInformation Systems · 2 worksApplied Mathematics · 1 workMathematics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workReasoning · 1 work
Works by year
2020s
2010s
Papers
- An Actor-Critic Algorithm for Sequence Prediction (2016 · 335 citations)
RNN sequence generators are usually trained with teacher forcing. They learn to predict each token from the gold prefix, but at test time they must continue from their own, possibly wrong, outputs. They also optimize log-likelihood rather than the evaluation metric, such as BLEU. The authors adapt… - Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving (2024 · 45 citations)
The authors ask whether large language models have something like metacognitive knowledge, meaning an awareness of which skills a task calls for, and whether that awareness can be used to improve their performance. - AI-Assisted Generation of Difficult Math Questions (2024 · 23 citations)
LLM training now treats mathematical reasoning as a core capability, but public sources of hard problems are largely used up. - SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative Refinement (2024 · 22 citations)
Most LLM-based coding agents move through a task in a single forward pass. They cannot easily abandon a poor line of attack and try a different one. SWE-Search tackles this for repository-level bug fixing by combining Monte Carlo Tree Search (MCTS) with LLM self-evaluation. It builds on the moatless-tools framework… - Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided Discovery (2025 · 6 citations)
Agents meant to help with scientific discovery must keep a structured picture of a hidden system accurate across many rounds of experiments and feedback.
All works
- An Actor-Critic Algorithm for Sequence PredictionarXiv:1607.07086Dzmitry Bahdanau, Philemon Brakel, Kelvin Xu, et al.2016 · 335 citations
- Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem SolvingarXiv:2405.12205Aniket Didolkar, Anirudh Goyal, Nan Rosemary Ke, et al.2024 · 45 citations
- AI-Assisted Generation of Difficult Math QuestionsarXiv:2407.21009Vedant Shah, Dingli Yu, Kaifeng Lyu, et al.2024 · 23 citations
- SWE-Search: Enhancing Software Agents with Monte Carlo Tree Search and Iterative RefinementarXiv:2410.20285Antonis Antoniades, Albert Orwall, Kexun Zhang, et al.2024 · 22 citations
- Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future ↗arXiv (Cornell University) · no summary yetNan Rosemary Ke et al.2019 · 15 citations
- Modeling the Long Term Future in Model-Based Reinforcement Learning ↗International Conference on Learning Representations · no summary yetNan Rosemary Ke et al.2018 · 14 citations
- Top-k Training of GANs: Improving GAN Performance by Throwing Away Bad Samples ↗arXiv (Cornell University) · no summary yetSamarth Sinha et al.2020 · 13 citations
- Rethinking Thinking Tokens: LLMs as Improvement Operators ↗arXiv (Cornell University) · no summary yetLovish Madaan et al.2025 · 8 citations
- Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided DiscoveryarXiv:2502.15224Tingting Chen, Beibei Lin, Srinivas Anumasa, et al.2025 · 6 citations
- Scaling Test-Time Compute for Agentic Coding ↗arXiv (Cornell University) · no summary yetJoongwon Kim et al.2026 · 3 citations
- Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning ↗arXiv (Cornell University) · no summary yetParas Dahal et al.2026
- GitSwarm: Decentralized Compounding Inference ↗arXiv (Cornell University) · no summary yetVedant Shah et al.2026
Co-authors here
- Yoshua Bengio ×3
- Michael C. Mozer ×2
- Nan Rosemary Ke ×2
- Sanjeev Arora ×2
- Vedant Shah ×2
- Aaron Courville
- Aniket Didolkar
- Danilo Jimenez Rezende
- Dianbo Liu
- Dzmitry Bahdanau
- Jiatong Yu
- Joelle Pineau
Venues
- International Conference on Learning Representations
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/anirudh-goyal/