Limao Xiong
Limao Xiong has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Shihan Dou, Wei Shen, Binghai Wang.
OpenAlex · h-index 6 · 19 works · 1,042 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 553 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #5246
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- Secrets of RLHF in Large Language Models Part I: PPO (2023 · 135 citations)
RLHF is the main way to make LLMs helpful, honest and harmless. Its PPO stage, though, is unstable, sensitive to hyperparameters and costly to debug, and few open implementations existed. This report from the Fudan NLP Group and ByteDance breaks the RLHF pipeline into its stages: SFT, reward model training, and PPO… - LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style Plugin (2024 · 93 citations)
The paper examines a trade-off in supervised fine-tuning (SFT) of LLMs. Adding much more instruction data keeps improving downstream tasks, but it also erodes the factual knowledge the model gained in pre-training. The authors build a 5-million-sample instruction set covering seven task categories and fine-tune… - RMB: Comprehensively Benchmarking Reward Models in LLM Alignment (2024 · 30 citations)
Reward models (RMs) steer LLM alignment, but existing evaluations such as RewardBench often fail to predict how well an RM actually guides alignment.
All works
- Secrets of RLHF in Large Language Models Part I: PPOarXiv:2307.04964Rui Zheng, Shihan Dou, Songyang Gao, et al.2023 · 135 citations
- LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style PluginAnnual Meeting of the Association for Computational Linguistics (ACL)Shihan Dou, Enyu Zhou, Yan Liu, et al.2024 · 93 citations
- StepCoder: Improving Code Generation with Reinforcement Learning from Compiler Feedback ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetShihan Dou et al.2024 · 32 citations
- RMB: Comprehensively Benchmarking Reward Models in LLM AlignmentarXiv:2410.09893Enyu Zhou, Guodong Zheng, Binghai Wang, et al.2024 · 30 citations
Co-authors here
- Shihan Dou ×3
- Wei Shen ×3
- Binghai Wang ×2
- Enyu Zhou ×2
- Rui Zheng ×2
- Songyang Gao ×2
- Yan Liu ×2
- Yuhao Zhou ×2
- Zhiheng Xi ×2
- Lu Chen
- Qin Liu
- Senjie Jin
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2024
- Science China Information Sciences
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/limao-xiong/