Zhijian Liu
Zhijian Liu has 2 papers in our library, in 2020–2023, most of them on Language models & pretraining, GPU & parallel computing; often with Song Han, Chuang Gan, Haotian Tang.
OpenAlex · ORCID · Wikidata · h-index 24 · 73 works · 6,163 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 292 times in our library · ⭐ Paper Stars ranking: #3190
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.GPU & parallel computing · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- HAT: Hardware-Aware Transformers for Efficient Natural Language Processing (2020 · 290 citations)
Transformer models for machine translation are too slow on constrained devices. For example, Transformer-Big needs about 13G FLOPs and roughly 20 seconds on a Raspberry Pi to translate a 30-word sentence. The authors make two observations: FLOPs poorly predict real latency, and the architecture that runs fastest… - LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models (2023 · 265 citations)
Extending the context window of a pre-trained LLM is usually very costly, because self-attention cost grows quadratically with sequence length.
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhijian-liu/