Yuntao Li
Yuntao Li has 2 papers in our library, in 2026; often with Guorui Zhou, Kun Gai, Leiyu Pan.
OpenAlex · ORCID · h-index 5 · 13 works · 86 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 8 times in our library · ⭐ Paper Stars ranking: #10212
Affiliations
🎓Harbin Institute of TechnologyHarbin ·
China2017–2025 · 10 papers🔬State Key Laboratory of Robotics and SystemsHarbin ·
China2017–2025 · 10 papers
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksDecision Sciences · 1 workInformation Systems · 1 workManagement Science and Operations Research · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
Works by year
2020s
Papers
- CE-GPPO: Coordinating Entropy via Gradient-Preserving Clipping Policy Optimization in Reinforcement Learning (2026 · 7 citations)
The paper tackles unstable policy entropy when large language models are trained with RL for reasoning. PPO-style methods, including GRPO and DAPO, clip the importance sampling ratio, and this silently drops gradients from low-probability tokens. The authors split tokens by advantage sign and probability. They argue… - Entropy Ratio Clipping as a Soft Global Constraint for Stable Reinforcement Learning (2026 · 1 citation)
LLM post-training with reinforcement learning is usually off-policy, so updates use samples from older policies.
Co-authors here
- Guorui Zhou ×2
- Kun Gai ×2
- Leiyu Pan ×2
- Minxuan Lv ×2
- Wenping Hu ×2
- Zhenpeng Su ×2
- Fuzheng Zhang
- Ruiming Tang
- Tiehua Mei
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yuntao-li/