Longxu Dou
Longxu Dou has 5 papers in our library, in 2023–2026, most of them on Language models & pretraining, Reasoning; often with Min Lin, Qian Liu, Guangtao Zeng.
OpenAlex · h-index 8 · 41 works · 193 citations OpenAlex, 2026-10-14
📄 5 works in our library · 🔗 Cited 141 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6134
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 5 worksComputer Science · 5 worksArtificial Intelligence · 5 worksLanguage and Linguistics · 5 worksComputer Vision and Pattern Recognition · 3 works
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 4 worksReasoning · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Scaling laws · 1 work
Works by year
2020s
Papers
- RegMix: Data Mixture as Regression for Language Model Pre-training (2024 · 57 citations)
The share of each data domain in a pre-training corpus strongly affects how well a large language model performs. - Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies (2024 · 46 citations)
Standard scaling laws for LLMs predict loss from parameter count and training data but treat vocabulary size as fixed. - Sailor: Open Language Models for South-East Asia (2024 · 27 citations)
Most large language models are trained mainly on English text and underperform on South-East Asian languages. - From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning (2023 · 24 citations)
Instruction tuning helps language models handle tasks they never saw during training. Its training data, however, usually comes from human crowdsourcing, which is costly and limited in size, or from LLM generation, which is noisy because outputs may not match inputs. The authors propose adding symbolic tasks. These… - Format-Adapter: Improving Reasoning Capability of LLMs by Adapting Suitable Format (2026)
Parallel test-time scaling (TTS) usually samples many answers using a single reasoning format chosen by a human.
All works
- RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492Qian Liu, Xiaosen Zheng, Niklas Muennighoff, et al.2024 · 57 citations
- Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
- Sailor: Open Language Models for South-East AsiaarXiv:2404.03608Longxu Dou, Qian Liu, Guangtao Zeng, et al.2024 · 27 citations
- From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction TuningarXiv:2304.07995Qian Liu, Fan Zhou, Zhengbao Jiang, et al.2023 · 24 citations
- Format-Adapter: Improving Reasoning Capability of LLMs by Adapting Suitable FormatFindings of the Association for Computational LinguisticsDingzirui Wang, Xuanliang Zhang, Rongyu Cao, et al.2026
- How Can Synthetic Data Improve Multilingual Language Model Pretraining? A Data Quality Perspective ↗Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetTongyao Zhu et al.2026
Co-authors here
- Min Lin ×4
- Qian Liu ×4
- Guangtao Zeng ×2
- Niklas Muennighoff ×2
- Binhua Li
- Chaofan Tao
- Dingzirui Wang
- Fan Zhou
- Fei Huang
- Jia Guo
- Jing Jiang
- Ngai Wong
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/longxu-dou/