Lei Ji
Lei Ji has 3 papers in our library, in 2025–2026, most of them on Language models & pretraining, Reasoning, Efficient models & compression; often with Xiao Liu, Yeyun Gong, Xiao Liang.
OpenAlex · ORCID · h-index 11 · 37 works · 788 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 16 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #10004
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 workDecision Sciences · 1 workManagement Science and Operations Research · 1 work
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 2 worksEfficient models & compression · 1 workReasoning · 1 work
Works by year
2020s
Papers
- TL;DR: Too Long, Do Re-weighting for Efficient LLM Reasoning Compression (2025 · 8 citations)
Reasoning-focused LLMs that generate long Chain-of-Thought (CoT) often overthink, spending many tokens even on easy questions. Existing compression approaches usually need laborious data labeling, model interpolation (as in CoT-Valve), or costly RL with length penalties. - Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-training (2026 · 1 citation)
Continual pre-training of an LLM on a narrow target field, such as math, often causes catastrophic forgetting of general skills. - DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning Collections (2026)
Instruction-tuning collections such as TÜLU combine many heterogeneous datasets, yet their mixing ratios are usually fixed by hand or need extra proxy models and validation sets to adjust.
All works
- A Benchmark for Structured Procedural Knowledge Extraction from Cooking Videos ↗Proceedings of the First International Workshop on Natural Language Processing Beyond Text · no summary yetFrank F. Xu et al.2020 · 27 citations
- TL;DR: Too Long, Do Re-weighting for Efficient LLM Reasoning CompressionarXiv:2506.02678Zhong-Zhi Li, Xiao Liang, Zihao Tang, et al.2025 · 8 citations
- Data Mixing Agent: Learning to Re-weight Domains for Continual Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Kailai Yang, Xiao Liu, Lei Ji, et al.2026 · 1 citation
- DynamixSFT: Dynamic Mixture Optimization of Instruction Tuning CollectionsFindings of the Association for Computational LinguisticsHaebin Shin, Lei Ji, Xiao Liu, et al.2026
Co-authors here
- Xiao Liu ×3
- Yeyun Gong ×3
- Xiao Liang ×2
- Haizhen Huang
- Hao Li
- Haotian Xu
- Kailai Yang
- Mao Yang
- Peijie Wang
- Peng Cheng
- Qi Chen
- Weiwei Deng
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
- Proceedings of the First International Workshop on Natural Language Processing Beyond Text
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/lei-ji/