Boyan Gao
Boyan Gao has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining, Efficient models & compression; often with Bo-Wen Zhang, Guang Liu, Haokun Lin.
OpenAlex · h-index 0 · 7 works · 0 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1 time in our library · ⭐ Paper Stars ranking: #12866
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Aquila2 Technical Report (2024 · 1 citation)
Most LLMs are pretrained on a fixed dataset over a long run, so it is hard to change the data mix or add new sources partway through. BAAI's Aquila2 is a family of Chinese–English bilingual models at 7B, 34B and an experimental 70B size. They were trained with HeuriMentor (HM), a framework with three parts: - EfficientLLM: Unified Pruning-Aware Pretraining for Auto-Designed Compact Language Models (2026)
Small language models meant for phones and other edge devices are usually trained from scratch. Their quality is then limited by parameter scaling laws, while standard compression of a large model loses a lot of accuracy because pruning uses only a small calibration set. The authors present EfficientLLM, a framework…
Co-authors here
- Bo-Wen Zhang
- Guang Liu
- Haokun Lin
- Jiajun Zhang
- Liangdong Wang
- Shitao Xiao
- Shuhao Gu
- Yiming Liang
- Yulong Ao
- Zheng Liu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/boyan-gao/