Daixuan Cheng
Daixuan Cheng has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining, Reasoning; often with Furu Wei, Shaohan Huang, Bo Dai.
OpenAlex · ORCID · h-index 5 · 16 works · 110 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 126 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #7538
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Reasoning · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Reasoning with Exploration: An Entropy Perspective (2025 · 63 citations)
RL training of LLMs with verifiable rewards tends to over-exploit. Models settle into narrow strategies, and reasoning gains level off. The authors ask whether token-level entropy, a classic exploration signal in RL, can identify exploratory reasoning. They analyse Qwen2.5-Base-7B on math problems and find that… - Instruction Pre-Training: Language Models are Supervised Multitask Learners (2024 · 59 citations)
Modern language models are usually pre-trained on raw text with next-token prediction, while supervised multitask learning is saved for post-training.
All works
- Reasoning with Exploration: An Entropy PerspectivearXiv:2506.14758Daixuan Cheng, Shaohan Huang, Xuekai Zhu, et al.2025 · 63 citations
- Instruction Pre-Training: Language Models are Supervised Multitask LearnersConference on Empirical Methods in Natural Language Processing (EMNLP)Daixuan Cheng, Yuxian Gu, Shaohan Huang, et al.2024 · 59 citations
- Adapting Large Language Models to Domains via Reading Comprehension ↗arXiv:2309.09530 · no summary yetDaixuan Cheng, Shaohan Huang, Furu Wei2023 · 33 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/daixuan-cheng/