Zhiqi Bai
Zhiqi Bai has 2 papers in our library, in 2024–2025, most of them on Language models & pretraining; often with Chenchen Zhang, Ge Zhang, Haoran Que.
OpenAlex · ORCID · h-index 3 · 14 works · 178 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 74 times in our library · ⭐ Paper Stars ranking: #7038
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- A Comprehensive Survey on Long Context Language Modeling (2025 · 64 citations)
Language models that can read very long inputs, such as whole books, extended dialogues or large codebases, are now common. - DDK: Distilling Domain Knowledge for Efficient Large Language Models (2024 · 23 citations)
Smaller LLMs are cheaper to deploy, and knowledge distillation from a stronger model can improve them. However, existing LLM distillation methods train on a fixed data mix. They overlook that the gap between student and teacher differs widely by domain. For example, a Qwen-1.5 1.8B student trails its 14B teacher far…
Co-authors here
- Chenchen Zhang ×2
- Ge Zhang ×2
- Haoran Que ×2
- Jiaheng Liu ×2
- Yuanxing Zhang ×2
- Congnan Liu
- Dawei Zhu
- Huanxuan Liao
- Jie Liu
- Jinyang Guo
- Ken Deng
- Yanan Wu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhiqi-bai/