Mengzhao Chen
Mengzhao Chen has 2 papers in our library, in 2023–2025, most of them on Language models & pretraining, Efficient models & compression; often with Kaipeng Zhang, Peng Gao, Peng Xu.
OpenAlex · h-index 11 · 24 works · 356 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 225 times in our library · ⭐ Paper Stars ranking: #4312
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 2 worksLanguage models & pretraining · 2 works
Works by year
2020s
Papers
- OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models (2023 · 193 citations)
Compressing large language models to very low bit-widths usually forces a trade-off. Post-training quantization (PTQ) is cheap, but it relies on hand-tuned parameters and degrades badly at settings such as W2A16 or W4A4. Quantization-aware training (QAT) keeps accuracy but needs heavy compute and data. OmniQuant aims… - EfficientQAT: Efficient Quantization-Aware Training for Large Language Models (2025 · 82 citations)
Quantization-aware training (QAT) can compress large language models to very low bit-widths with little accuracy loss.
Co-authors here
- Kaipeng Zhang ×2
- Peng Gao ×2
- Peng Xu ×2
- Ping Luo ×2
- Wenqi Shao ×2
- Yu Qiao
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/mengzhao-chen/