Zhaoyang Zhang
Zhaoyang Zhang has 2 papers in our library, in 2023–2026, most of them on Language models & pretraining, Efficient models & compression, Reasoning; often with Dhananjay Ram, Kaipeng Zhang, Mengzhao Chen.
OpenAlex · ORCID · h-index 13 · 23 works · 434 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 193 times in our library · ⭐ Paper Stars ranking: #6648
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 3Research subjects and languages the work is about.Efficient models & compression · 2 worksLanguage models & pretraining · 2 worksReasoning · 1 work
Works by year
2020s
Papers
- OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models (2023 · 195 citations)
Compressing large language models to very low bit-widths usually forces a trade-off. Post-training quantization (PTQ) is cheap, but it relies on hand-tuned parameters and degrades badly at settings such as W2A16 or W4A4. Quantization-aware training (QAT) keeps accuracy but needs heavy compute and data. OmniQuant aims… - Reinforcement-aware Knowledge Distillation for LLM Reasoning (2026 · 13 citations)
Long chain-of-thought reasoning models trained with RL are expensive to run, so practitioners distill them into smaller students.
Co-authors here
- Dhananjay Ram
- Kaipeng Zhang
- Mengzhao Chen
- Peng Gao
- Peng Xu
- Ping Luo
- Shuo Yang
- Stefano Soatto
- Wei Xia
- Wenqi Shao
- Yantao Shen
- Yu Qiao
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhaoyang-zhang/