Hanrui Wang
Hanrui Wang has 2 papers in our library, in 2020, most of them on GPU & parallel computing, Efficient models & compression; often with Song Han, Chuang Gan, Han Cai.
OpenAlex · ORCID · h-index 22 · 87 works · 4,644 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 192 times in our library · ⭐ Paper Stars ranking: #3072
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 worksHardware and Architecture · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workGPU & parallel computing · 1 work
Works by year
2020s
Papers
- SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning (2020 · 534 citations)
Attention-based NLP models such as BERT and GPT-2 run slowly on CPUs and GPUs. The cost grows quadratically with input length, much of the time goes to moving data rather than arithmetic, and existing accelerators were built for CNNs and RNNs. SpAtten (HPCA 2021) is an algorithm-hardware co-design that cuts both… - HAT: Hardware-Aware Transformers for Efficient Natural Language Processing (2020 · 294 citations)
Transformer models for machine translation are too slow on constrained devices. For example, Transformer-Big needs about 13G FLOPs and roughly 20 seconds on a Raspberry Pi to translate a 30-word sentence. The authors make two observations: FLOPs poorly predict real latency, and the architecture that runs fastest…
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2020
- Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings: Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings 2020
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/hanrui-wang/