Zhekai Zhang
Zhekai Zhang has 3 papers in our library, in 2019–2024, most of them on Efficient models & compression, Language models & pretraining; often with Song Han, Chuang Gan, Guangxuan Xiao.
OpenAlex · ORCID · h-index 12 · 58 works · 1,159 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 392 times in our library · ⭐ Paper Stars ranking: #2897
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksComputer Vision and Pattern Recognition · 3 worksArtificial Intelligence · 2 worksArts and Humanities · 1 workHardware and Architecture · 2 worksLanguage and Linguistics · 1 workEngineering · 1 workElectrical and Electronic Engineering · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 2 worksLanguage models & pretraining · 1 work
Works by year
2020s
2010s
Papers
- SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning (2020 · 534 citations)
Attention-based NLP models such as BERT and GPT-2 run slowly on CPUs and GPUs. The cost grows quadratically with input length, much of the time goes to moving data rather than arithmetic, and existing accelerators were built for CNNs and RNNs. SpAtten (HPCA 2021) is an algorithm-hardware co-design that cuts both… - Once-for-All: Train One Network and Specialize it for Efficient Deployment (2019 · 252 citations)
Deploying neural networks across many devices (phones, CPUs, GPUs, FPGAs, microcontrollers) and latency budgets usually means designing or searching a new architecture and training it from scratch for each target, so the cost grows with every new scenario. - QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving (2024 · 120 citations)
Low-bit integer quantization promises faster LLM inference, but INT4 approaches have mostly helped small-batch edge scenarios.
Co-authors here
Venues
- Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings: Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings 2020
- MLSys 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhekai-zhang/