Hai Li
Hai Li has 2 papers in our library, in 2016–2026, most of them on Language models & pretraining, Efficient models & compression; often with Wei Wen, Yifan Yang, Yiran Chen.
OpenAlex · ORCID · Wikidata · h-index 63 · 621 works · 15,885 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 129 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #4108
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksHardware and Architecture · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Latent semantic indexing · 1 work
Works by year
2020s
2010s
Papers
- Learning Structured Sparsity in Deep Neural Networks (2016 · 530 citations)
Sparsifying a deep network weight by weight shrinks its parameter count, but the zeros end up scattered across memory. - FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model Compression (2026 · 2 citations)
Large language models are costly to run on limited hardware. Low-rank compression helps, but SVD-based variants often lose accuracy, need recovery fine-tuning, and split layers into two smaller matrix multiplications that run poorly on GPUs. SliceGPT avoids SVD but adds adapters on residual paths, which costs memory.…
All works
- Learning Structured Sparsity in Deep Neural NetworksarXiv:1608.03665Wei Wen, Chunpeng Wu, Yandan Wang, et al.2016 · 530 citations
- Feature Space Perturbations Yield More Transferable Adversarial Examples ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetNathan Inkawhich et al.2019 · 176 citations
- FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model CompressionFindings of the Association for Computational LinguisticsJiayi Tian, Ryan Solgi, Jinming Lu, et al.2026 · 2 citations
Co-authors here
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/hai-li/