Rulin Shao
Rulin Shao has 4 papers in our library, in 2024–2025, most of them on Language models & pretraining, Information retrieval & search; often with Akari Asai, Rui Xin, Sewon Min.
OpenAlex · ORCID · Wikidata · h-index 9 · 47 works · 276 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 590 times in our library · 10 more in our library without a page yet · ⭐ Paper Stars ranking: #6591
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 4 worksComputer Science · 4 worksArtificial Intelligence · 4 worksLanguage and Linguistics · 4 worksInformation Systems · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Information retrieval & search · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs (2024 · 62 citations)
Large language models often fail researchers who need to digest scientific literature. They invent references, rely on outdated pre-training knowledge, and seldom show the sources behind their claims. OpenScholar addresses this with a fully open retrieval-augmented system built on OpenScholar-DataStore (OSDS), an… - Spurious Rewards: Rethinking Training Signals in RLVR (2025 · 53 citations)
Reinforcement learning with verifiable rewards (RLVR) is credited with improving math reasoning in language models, but it is unclear what in the training signal actually causes the gains. - Language models scale reliably with over-training and on downstream tasks (2024 · 46 citations)
Scaling laws let teams forecast large language model behaviour from cheap small runs. Most published laws, however, assume Chinchilla-style compute-optimal training and predict only next-token loss. In practice, smaller models are often over-trained on far more tokens to cut inference cost, and they are compared on… - DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Research (2025 · 28 citations)
Open deep research (DR) agents are usually trained with reinforcement learning on short questions whose answers can be checked automatically. That kind of reward does not transfer to open-ended, long-form reports, where quality is loosely defined and checking claims requires current external evidence.
All works
- OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMsarXiv:2411.14199Akari Asai, Jacqueline He, Rulin Shao, et al.2024 · 62 citations
- Spurious Rewards: Rethinking Training Signals in RLVRarXiv:2506.10947Rulin Shao, Shuyue Stella Li, Rui Xin, et al.2025 · 53 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- Synthesizing scientific literature with retrieval-augmented language models ↗Nature · no summary yetAkari Asai et al.2026 · 42 citations
- ReasonIR: Training Retrievers for Reasoning Tasks ↗arXiv (Cornell University) · no summary yetRulin Shao et al.2025 · 41 citations
- DISTFLASHATTN: Distributed Memory-efficient Attention for Long-context LLMs Training ↗arXiv:2310.03294 · no summary yetDacheng Li et al.2023 · 36 citations
- Scaling Retrieval-Based Language Models with a Trillion-Token Datastore ↗neural information processing systems · no summary yetRulin Shao et al.2024 · 30 citations
- DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep ResearcharXiv:2511.19399Rulin Shao, Akari Asai, Shannon Zejiang Shen, et al.2025 · 28 citations
- Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetRohan Pandey et al.2023 · 11 citations
- Improving Factuality with Explicit Working Memory ↗Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetMingda Chen et al.2025 · 4 citations
- JobBench: Aligning Agent Work With Human Will ↗arXiv (Cornell University) · no summary yetYuetai Li et al.2026 · 1 citation
- ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research ↗arXiv (Cornell University) · no summary yetSohyeon Kim et al.2026
- Context Language Models ↗arXiv (Cornell University) · no summary yetRulin Shao et al.2026
- Efficient Test-Time Adaptation through Human-AI Interaction ↗arXiv (Cornell University) · no summary yetZora Zhiruo Wang et al.2026
Co-authors here
- Akari Asai ×2
- Rui Xin ×2
- Sewon Min ×2
- Alex Fang
- Amanpreet Singh
- David Sontag
- David Wadden
- Georgios Smyrnis
- Hamish Ivison
- Hannaneh Hajishirzi
- Jean Mercat
- Jeffrey Li
Venues
- Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) ×2
- Conference on Neural Information Processing Systems (NeurIPS)
- Nature
- neural information processing systems
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/rulin-shao/