🧑‍🔬 John Schulman — all works

52 works · ← John Schulman

1. Training language models to follow instructions with human feedbackarXiv:2203.02155Long Ouyang, Jeff Wu, Xu Jiang, et al.2022 · 10,224 citations
2. Training Verifiers to Solve Math Word ProblemsarXiv:2110.14168Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.2021 · 3,796 citations
3. Trust Region Policy Optimization ↗arXiv:1502.05477 · no summary yetJohn Schulman et al.2015 · 3,015 citations
4. High-Dimensional Continuous Control Using Generalized Advantage Estimation ↗arXiv:1506.02438 · no summary yetJohn Schulman et al.2015 · 1,867 citations
5. Let's Verify Step by SteparXiv:2305.20050Hunter Lightman, Vineet Kosaraju, Yura Burda, et al.2023 · 1,412 citations
6. InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Nets ↗arXiv (Cornell University) · no summary yetChen, Xi et al.2016 · 1,285 citations
7. Benchmarking Deep Reinforcement Learning for Continuous Control ↗arXiv:1604.06778 · no summary yetYan Duan et al.2016 · 967 citations
8. Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrations ↗arXiv:1709.10087 · no summary yetAravind Rajeswaran et al.2017 · 838 citations
9. OpenAI Gym ↗arXiv:1606.01540 · no summary yetGreg Brockman et al.2016 · 829 citations
10. On First-Order Meta-Learning Algorithms ↗arXiv:1803.02999 · no summary yetAlex Nichol, Joshua Achiam, John Schulman2018 · 606 citations
11. RL²: Fast Reinforcement Learning via Slow Reinforcement LearningarXiv:1611.02779Yan Duan, John Schulman, Xi Chen, et al.2016 · 524 citations
12. VIME: Variational Information Maximizing Exploration ↗arXiv:1605.09674 · no summary yetRein Houthooft et al.2016 · 518 citations
13. Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization ↗no summary yetJohn Schulman et al.2013 · 437 citations
14. Teacher-Student Curriculum Learning ↗arXiv:1707.00183 · no summary yetTambet Matiisen et al.2017 · 350 citations
15. #Exploration: A Study of Count-Based Exploration for Deep Reinforcement Learning ↗arXiv (Cornell University) · no summary yetHaoran Tang et al.2016 · 327 citations
16. Scaling Laws for Reward Model OveroptimizationarXiv:2210.10760Leo Gao, John Schulman, Jacob Hilton2022 · 323 citations
17. Variational Lossy Autoencoder ↗arXiv (Cornell University) · no summary yetXi Chen et al.2016 · 285 citations
18. Concrete Problems in AI SafetyarXiv:1606.06565Dario Amodei, Chris Olah, Jacob Steinhardt, et al.2016 · 232 citations
19. Quantifying Generalization in Reinforcement Learning ↗arXiv (Cornell University) · no summary yetKarl Cobbe et al.2018 · 222 citations
20. Gradient Estimation Using Stochastic Computation Graphs ↗arXiv (Cornell University) · no summary yetJohn Schulman et al.2015 · 216 citations
21. Leveraging Procedural Generation to Benchmark Reinforcement Learning ↗arXiv (Cornell University) · no summary yetKarl Cobbe et al.2019 · 214 citations
22. Equivalence Between Policy Gradients and Soft Q-Learning ↗arXiv (Cornell University) · no summary yetJohn Schulman, Chen, Xi, Pieter Abbeel2017 · 196 citations
23. Tracking deformable objects with point clouds ↗Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · no summary yetJohn Schulman et al.2013 · 170 citations
24. Measuring short-form factuality in large language modelsarXiv:2411.04368Jason Wei, Nguyen Karina, Hyung Won Chung, et al.2024 · 160 citations
25. Unsolved Problems in ML Safety ↗arXiv:2109.13916 · no summary yetDan Hendrycks et al.2021 · 151 citations
26. Efficient Training of Language Models to Fill in the MiddlearXiv:2207.14255Mohammad Bavarian, Heewoo Jun, Nikolas Tezak, et al.2022 · 144 citations
27. Learning from Demonstrations Through the Use of Non-rigid Registration ↗Springer tracts in advanced robotics · no summary yetJohn Schulman et al.2016 · 130 citations
28. Meta Learning Shared Hierarchies ↗arXiv (Cornell University) · no summary yetKevin Frans et al.2017 · 116 citations
29. Model-Based Reinforcement Learning via Meta-Policy Optimization ↗arXiv (Cornell University) · no summary yetIgnasi Clavera et al.2018 · 112 citations
30. Reasoning Models Don't Always Say What They Think ↗arXiv:2505.05410 · no summary yetYanda Chen et al.2025 · 106 citations
31. Gotta Learn Fast: A New Benchmark for Generalization in RL ↗arXiv (Cornell University) · no summary yetAlex Nichol et al.2018 · 93 citations
32. A case study of trajectory transfer through non-rigid registration for a simplified suturing scenario ↗IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · no summary yetJohn Schulman et al.2013 · 85 citations
33. UCB Exploration via Q-Ensembles ↗arXiv (Cornell University) · no summary yetRichard Y. Chen et al.2017 · 75 citations
34. Scaling up Gaussian Belief Space Planning Through Covariance-Free Trajectory Optimization and Automatic Differentiation ↗Springer tracts in advanced robotics · no summary yetSachin Patil et al.2015 · 74 citations
35. Phasic Policy Gradient ↗arXiv (Cornell University) · no summary yetKarl Cobbe et al.2020 · 56 citations
36. Rule Based Rewards for Language Model Safety ↗neural information processing systems · no summary yetTong Mu et al.2024 · 49 citations
37. Sigma hulls for Gaussian belief space planning for imprecise articulated robots amid obstacles ↗IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · no summary yetAlex Lee et al.2013 · 42 citations
38. Distribution Augmentation for Generative Modeling ↗International Conference on Machine Learning · no summary yetHeewoo Jun et al.2020 · 30 citations
39. Gaussian belief space planning with discontinuities in sensing domains ↗Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · no summary yetSachin Patil et al.2014 · 23 citations
40. Grasping and Fixturing as Submodular Coverage Problems ↗Springer tracts in advanced robotics · no summary yetJohn Schulman, Ken Y. Goldberg, Pieter Abbeel2016 · 21 citations
41. Scaling laws for single-agent reinforcement learning ↗arXiv (Cornell University) · no summary yetJacob K. Hilton, Jie Tang, John Schulman2023 · 19 citations
42. Planning locally optimal, curvature-constrained trajectories in 3D using sequential convex optimization ↗Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · no summary yetYan Duan et al.2014 · 19 citations
43. Semi-Supervised Learning by Label Gradient Alignment ↗arXiv (Cornell University) · no summary yetJackson, Jacob, John Schulman2019 · 16 citations
44. Policy Gradient Search: Online Planning and Expert Iteration without Search Trees ↗arXiv (Cornell University) · no summary yetAnthony, Thomas et al.2019 · 15 citations
45. Batch Size-Invariance for Policy Optimization ↗neural information processing systems · no summary yetJacob Hilton, Karl Cobbe, John Schulman2022 · 9 citations
46. Measuring Sample Efficiency and Generalization in Reinforcement Learning Benchmarks: NeurIPS 2020 Procgen Benchmark ↗arXiv (Cornell University) · no summary yetSharada P. Mohanty et al.2021 · 8 citations
47. Stress-Testing Model Specs Reveals Character Differences among Language Models ↗arXiv (Cornell University) · no summary yetZhang, Jifan et al.2025 · 4 citations
48. Quantifying Elicitation of Latent Capabilities in Language Models ↗neural information processing systems · no summary yetElizabeth Donoway et al.2025 · 1 citation
49. Detecting Adversarial Fine-tuning with Auditing Agents ↗arXiv (Cornell University) · no summary yetSarah Egler, John Schulman, Nicholas Carlini2025 · 1 citation
50. Spike sorting for large dense arrays ↗Frontiers in Neuroinformatics · no summary yetShabnam Kadir et al.2013 · 1 citation
51. Chunky Post-Training: Data Driven Failures of Generalization ↗arXiv (Cornell University) · no summary yetSeoirse Murray et al.2026
52. Conditional Augmentation for Generative Modeling ↗International Conference on Machine Learning · no summary yetHeewoo Jun et al.2020

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/john-schulman/works/