Tianyang Wang
Tianyang Wang has 2 papers in our library, in 2026, most of them on Efficient models & compression; often with Hao Xu, Xi Xiao, Chen Liu.
OpenAlex · ORCID · h-index 11 · 42 works · 527 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 7 times in our library · ⭐ Paper Stars ranking: #10192
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Latent semantic indexing · 1 work
Works by year
2020s
Papers
- HyperAdaLoRA: Accelerating LoRA Rank Allocation During Training via Hypernetworks without Sacrificing Performance (2026 · 5 citations)
AdaLoRA improves on LoRA by giving different weight matrices different ranks. It does this by expressing each update in SVD form (P, Λ, Q) and pruning unimportant singular values. The cost is slow convergence and heavy computation during training. HyperAdaLoRA addresses this. Instead of updating P, Λ and Q directly… - Not All Directions Matter: Towards Structured and Task-Aware Low-Rank Model Adaptation (2026 · 3 citations)
The paper argues that LoRA has two weaknesses. First, it spends its small rank budget equally on every low-rank direction, even though many directions carry noise; the authors call this semantic drift. Second, it tunes each layer in isolation, so updates in neighbouring layers can point in unrelated directions; they…
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tianyang-wang/