Mengshu Sun
Mengshu Sun has 2 papers in our library, in 2025–2026, most of them on Language models & pretraining, Efficient models & compression; often with Bohan Zhang, Da Zheng, Huajun Chen.
OpenAlex · ORCID · h-index 10 · 44 works · 231 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 49 times in our library · ⭐ Paper Stars ranking: #7710
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- LightThinker: Thinking Step-by-Step Compression (2025 · 50 citations)
Slow, o1-style reasoning makes LLMs produce very long token sequences. Because attention cost grows quadratically and the KV Cache grows linearly with context, these outputs are expensive in memory and time. LightThinker addresses this by teaching a model to condense each intermediate reasoning step as it goes. After… - Sparse-RL: Breaking the Memory Wall in LLM Reinforcement Learning via Stable Sparse Rollouts (2026 · 4 citations)
Long reasoning rollouts in LLM reinforcement learning store large KV caches. This memory cost limits batch sizes and GPU utilization, especially since rollout generation takes most of the training time. The authors ask whether training-free KV compression, built for inference, can be used during rollouts. They find…
Co-authors here
- Bohan Zhang
- Da Zheng
- Huajun Chen
- Jing Zhang
- Jintian Zhang
- Ke Wang
- Lei Liang
- Lun Du
- Ningyu Zhang
- Shuofei Qiao
- Sijia Luo
- Xiaokang Zhang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/mengshu-sun/