🧑‍🔬 Jimmy Lei Ba — all works

75 works · ← Jimmy Lei Ba

1. Adam: A Method for Stochastic OptimizationarXiv:1412.6980Diederik P. Kingma, Jimmy Ba2014 · 90,277 citations
2. Show, Attend and Tell: Neural Image Caption Generation with Visual AttentionarXiv:1502.03044Kelvin Xu, Jimmy Ba, Ryan Kiros, et al.2015 · 7,670 citations
3. Layer NormalizationarXiv:1607.06450Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton2016 · 1,819 citations
4. Do Deep Nets Really Need to be Deep? ↗arXiv (Cornell University) · no summary yetJimmy Lei Ba, Rich Caruana2013 · 1,496 citations
5. Large Language Models Are Human-Level Prompt EngineersarXiv:2211.01910Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.2022 · 701 citations
6. Multiple Object Recognition with Visual Attention ↗arXiv (Cornell University) · no summary yetJimmy Lei Ba, Volodymyr Mnih, Koray Kavukcuoglu2014 · 698 citations
7. AlpacaFarm: A Simulation Framework for Methods that Learn from Human FeedbackConference on Neural Information Processing Systems (NeurIPS)Yann Dubois, Xuechen Li, Rohan Taori, et al.2023 · 456 citations
8. Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation ↗arXiv (Cornell University) · no summary yetYuhuai Wu et al.2017 · 450 citations
9. Classifying and segmenting microscopy images with deep multiple instance learning ↗Bioinformatics · no summary yetOren Z. Kraus, Jimmy Lei Ba, Brendan J. Frey2016 · 416 citations
10. Lookahead Optimizer: k steps forward, 1 step back ↗arXiv (Cornell University) · no summary yetMichael R. Zhang et al.2019 · 380 citations
11. Predicting Deep Zero-Shot Convolutional Neural Networks Using Textual Descriptions ↗IEEE International Conference on Computer Vision (ICCV) · no summary yetJimmy Lei Ba et al.2015 · 361 citations
12. Adaptive dropout for training deep neural networks ↗neural information processing systems · no summary yetJimmy Lei Ba, Brendan J. Frey2013 · 272 citations
13. Dream to Control: Learning Behaviors by Latent Imagination ↗arXiv:1912.01603 · no summary yetDanijar Hafner et al.2019 · 228 citations
14. Benchmarking Model-Based Reinforcement Learning ↗arXiv (Cornell University) · no summary yetTingwu Wang et al.2019 · 223 citations
15. Actor-Mimic: Deep Multitask and Transfer Reinforcement Learning ↗arXiv (Cornell University) · no summary yetEmilio Parisotto, Jimmy Lei Ba, Ruslan Salakhutdinov2015 · 217 citations
16. Mastering diverse control tasks through world models ↗Nature · no summary yetDanijar Hafner et al.2025 · 200 citations
17. Flipout: Efficient Pseudo-Independent Weight Perturbations on Mini-Batches ↗arXiv:1803.04386 · no summary yetYeming Wen et al.2018 · 189 citations
18. Mastering Diverse Domains through World Models ↗arXiv:2301.04104 · no summary yetDanijar Hafner et al.2023 · 182 citations
19. Using Fast Weights to Attend to the Recent Past ↗arXiv (Cornell University) · no summary yetJimmy Lei Ba et al.2016 · 168 citations
20. NerveNet: Learning Structured Policy with Graph Neural Networks ↗International Conference on Learning Representations · no summary yetTingwu Wang et al.2018 · 148 citations
21. OpenWebMath: An Open Dataset of High-Quality Mathematical Web TextarXiv:2310.06786Keiran Paster, Marco Dos Santos, Zhangir Azerbayev, et al.2023 · 132 citations
22. BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learning ↗arXiv (Cornell University) · no summary yetYeming Wen, Dustin Tran, Jimmy Lei Ba2020 · 108 citations
23. Identifying the Risks of LM Agents with an LM-Emulated SandboxarXiv:2309.15817Yangjun Ruan, Honghua Dong, Andrew Wang, et al.2023 · 96 citations
24. Mastering Atari with Discrete World Models ↗arXiv:2010.02193 · no summary yetDanijar Hafner et al.2020 · 92 citations
25. Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding ↗arXiv:2305.12031 · no summary yetAugustin Toma et al.2023 · 91 citations
26. Exploring Model-based Planning with Policy Networks ↗arXiv (Cornell University) · no summary yetTingwu Wang, Jimmy Lei Ba2019 · 88 citations
27. Generating Images from Captions with Attention ↗arXiv (Cornell University) · no summary yetElman Mansimov et al.2015 · 88 citations
28. Distributed Second-Order Optimization using Kronecker-Factored Approximations ↗International Conference on Learning Representations · no summary yetJimmy Lei Ba, Roger Grosse, James Martens2017 · 73 citations
29. Improving Transformer Optimization Through Better Initialization ↗International Conference on Machine Learning · no summary yetXiao Shi Huang et al.2020 · 67 citations
30. Graph Normalizing Flows ↗arXiv (Cornell University) · no summary yetLiu, Jenny et al.2019 · 64 citations
31. On the Convergence and Robustness of Training GANs with Regularized Optimal Transport ↗arXiv (Cornell University) · no summary yetMaziar Sanjabi et al.2018 · 57 citations
32. On Solving Minimax Optimization Locally: A Follow-the-Ridge Approach ↗arXiv (Cornell University) · no summary yetYuanhao Wang, Guodong Zhang, Jimmy Lei Ba2019 · 54 citations
33. Kronecker-factored Curvature Approximations for Recurrent Neural Networks ↗International Conference on Learning Representations · no summary yetJames Martens, Jimmy Lei Ba, Matt R. Johnson2018 · 51 citations
34. Maximum Entropy Gain Exploration for Long Horizon Multi-goal Reinforcement Learning ↗arXiv (Cornell University) · no summary yetSilviu Pitis et al.2020 · 45 citations
35. Residual Prompt Tuning: improving prompt tuning with residual reparameterization ↗Findings of the Association for Computational Linguistics: ACL 2023 · no summary yetAnastasiia Razdaibiedina et al.2023 · 42 citations
36. INT: An Inequality Benchmark for Evaluating Generalization in Theorem Proving ↗arXiv:2007.02924 · no summary yetYuhuai Wu et al.2020 · 41 citations
37. LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning ↗arXiv:2101.06223 · no summary yetYuhuai Wu et al.2021 · 39 citations
38. Boosted Prompt Ensembles for Large Language Models ↗arXiv (Cornell University) · no summary yetSilviu Pitis et al.2023 · 38 citations
39. Neural Graph Evolution: Towards Efficient Automatic Robot Design ↗arXiv (Cornell University) · no summary yetTingwu Wang et al.2019 · 32 citations
40. Generalization of Two-layer Neural Networks: An Asymptotic Viewpoint ↗International Conference on Learning Representations · no summary yetJimmy Lei Ba et al.2020 · 30 citations
41. Reversible Recurrent Neural Networks ↗arXiv (Cornell University) · no summary yetMatthew Mackay et al.2018 · 30 citations
42. Learning Wake-Sleep Recurrent Attention Models ↗arXiv (Cornell University) · no summary yetJimmy Lei Ba et al.2015 · 29 citations
43. The Scattering Compositional Learner: Discovering Objects, Attributes, Relationships in Analogical Reasoning ↗arXiv (Cornell University) · no summary yetYuhuai Wu et al.2020 · 27 citations
44. Action and Perception as Divergence Minimization ↗arXiv (Cornell University) · no summary yetDanijar Hafner et al.2020 · 25 citations
45. ACTRCE: Augmenting Experience via Teacher's Advice For Multi-Goal Reinforcement Learning ↗arXiv (Cornell University) · no summary yetHarris Chan et al.2019 · 25 citations
46. DOM-Q-NET: Grounded RL on Structured Language ↗arXiv (Cornell University) · no summary yetSheng Jia, Jamie Kiros, Jimmy Lei Ba2019 · 19 citations
47. Using Large Language Models for Hyperparameter Optimization ↗arXiv (Cornell University) · no summary yetMichael R. Zhang et al.2023 · 18 citations
48. Exploring Low Rank Training of Deep Neural Networks ↗arXiv (Cornell University) · no summary yetSiddhartha Rao Kamalakara et al.2022 · 18 citations
49. You Can’t Count on Luck: Why Decision Transformers and RvS Fail in Stochastic Environments ↗neural information processing systems · no summary yetKeiran Paster, Sheila A. McIlraith, Jimmy Lei Ba2022 · 15 citations
50. Clockwork Variational Autoencoders ↗arXiv (Cornell University) · no summary yetVaibhav Saxena, Jimmy Lei Ba, Danijar Hafner2021 · 13 citations
51. Interplay Between Optimization and Generalization of Stochastic Gradient Descent with Covariance Noise. ↗arXiv (Cornell University) · no summary yetYeming Wen et al.2019 · 13 citations
52. High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation ↗arXiv (Cornell University) · no summary yetJimmy Lei Ba et al.2022 · 12 citations
53. A Study of Gradient Variance in Deep Learning ↗arXiv (Cornell University) · no summary yetFartash Faghri et al.2020 · 12 citations
54. When Does Preconditioning Help or Hurt Generalization? ↗arXiv (Cornell University) · no summary yetШун-ичи Амари et al.2020 · 11 citations
55. Training on Thin Air: Improve Image Classification with Generated Data ↗arXiv (Cornell University) · no summary yetYongchao Zhou, Hshmat Sahak, Jimmy Lei Ba2023 · 10 citations
56. Evaluating Agents without Rewards ↗arXiv (Cornell University) · no summary yetBrendon Matusch, Jimmy Lei Ba, Danijar Hafner2020 · 8 citations
57. Planning from Pixels using Inverse Dynamics Models ↗arXiv (Cornell University) · no summary yetKeiran Paster, Sheila A. McIlraith, Jimmy Lei Ba2020 · 7 citations
58. Learning Intrinsic Rewards as a Bi-Level Optimization Problem ↗Uncertainty in Artificial Intelligence · no summary yetBradly C. Stadie, Lunjun Zhang, Jimmy Lei Ba2020 · 7 citations
59. An Empirical Study of Stochastic Gradient Descent with Structured Covariance Noise ↗International Conference on Artificial Intelligence and Statistics · no summary yetYeming Wen et al.2020 · 7 citations
60. Second-order Optimization for Deep Reinforcement Learning using Kronecker-factored Approximation ↗neural information processing systems · no summary yetYuhuai Wu et al.2017 · 7 citations
61. Efficient Statistical Tests: A Neural Tangent Kernel Approach ↗no summary yetSheng Jia et al.2021 · 6 citations
62. Towards Characterizing the High-dimensional Bias of Kernel-based Particle Inference Algorithms ↗no summary yetJimmy Lei Ba et al.2019 · 5 citations
63. Multi-Rate VAE: Train Once, Get the Full Rate-Distortion Curve ↗arXiv (Cornell University) · no summary yetJuhan Bae et al.2022 · 4 citations
64. An Inductive Bias for Distances: Neural Nets that Respect the Triangle Inequality ↗arXiv (Cornell University) · no summary yetSilviu Pitis et al.2020 · 4 citations
65. Decomposed Prompting to Answer Questions on a Course Discussion Board ↗Communications in computer and information science · no summary yetBrandon Jaipersaud et al.2023 · 3 citations
66. Learning Domain Invariant Representations in Goal-conditioned Block MDPs ↗arXiv (Cornell University) · no summary yetBeining Han et al.2021 · 3 citations
67. EMA Policy Gradient: Taming Reinforcement Learning for LLMs with EMA Anchor and Top-k KL ↗arXiv (Cornell University) · no summary yetLunjun Zhang, Jimmy Lei Ba2026 · 1 citation
68. Report Cards: Qualitative Evaluation of Language Models Using Natural Language Summaries ↗arXiv (Cornell University) · no summary yetBlair Yang et al.2024 · 1 citation
69. Learning in the Presence of Low-dimensional Structure: A Spiked Random Matrix Perspective ↗neural information processing systems · no summary yetJimmy Lei Ba et al.2023 · 1 citation
70. Noisy Labels Can Induce Good Representations. ↗arXiv (Cornell University) · no summary yetJingling Li et al.2020 · 1 citation
71. TR0N: Translator Networks for 0-Shot Plug-and-Play Conditional Generation ↗arXiv (Cornell University) · no summary yetZhaoyan Liu et al.2023
72. Video Prediction with Variational Temporal Hierarchies ↗no summary yetVaibhav Saxena, Jimmy Lei Ba, Danijar Hafner2021
73. A Non-asymptotic comparison of SVRG and SGD: tradeoffs between compute and speed ↗no summary yetQingru Zhang et al.2019
74. Exploring Curvature Noise in Large-Batch Stochastic Optimization ↗no summary yetYeming Wen et al.2018
75. ACTRCE: Augmenting Experience via Teacher’s Advice ↗no summary yetYuhuai Wu et al.2018

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/jimmy-lei-ba/works/