Qingyu Zhang
Qingyu Zhang has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Bingning Wang, Hongyu Lin, Mingyu Xu.
OpenAlex · ORCID · h-index 2 · 11 works · 61 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 130 times in our library · ⭐ Paper Stars ranking: #6680
Affiliations
🔬Institute of SoftwareBeijing ·
China2025–2026 · 3 papers🎓University of Chinese Academy of SciencesBeijing ·
China2025–2026 · 2 papers🎓University of Hong KongPok Fu Lam ·
China2025 · 6 papers🏛️Chinese Academy of SciencesBeijing ·
China2025 · 2 papers
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- ShortGPT: Layers in Large Language Models are More Redundant Than You Expect (2024 · 169 citations)
Modern LLMs are expensive to deploy, and many existing pruning techniques are complicated, for example those that require gradients. - Base of RoPE Bounds Context Length (2024 · 12 citations)
RoPE is the standard position encoding in many LLMs, and context windows are usually extended by changing its single hyperparameter, the base.
Co-authors here
- Bingning Wang ×2
- Hongyu Lin ×2
- Mingyu Xu ×2
- Weipeng Chen ×2
- Xianpei Han ×2
- Xin Men ×2
- Yaojie Lu
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/qingyu-zhang/