Yihong Huang
Yihong Huang has 2 papers in our library, in 2026, most of them on Language models & pretraining, Efficient models & compression; often with Hongbo Zhao, Kai Zhang, Xianming Hu.
OpenAlex · h-index 0 · 3 works · 0 citations OpenAlex, 2026-10-14
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Adaptive Zooming via Relevance-Informed Positional Resource Allocation for Training-free LLM Context Extension (2026)
LLMs that use RoPE lose quality when inputs run past their pre-training context length. Existing training-free fixes, such as position reuse (Self-Extend, ChunkLlama, AdaGroPE) or frequency interpolation (NTK, YaRN, GALI), remap positions using distance alone and ignore content. As a result, important and unimportant… - G-LoRA: Global-Local Decoupled Low-Rank Adaptation (2026)
LoRA and adaptive variants such as AdaLoRA give a single rank to an entire weight update matrix ∆W. This ignores the fact that parameter importance varies inside one matrix. Sparse fine-tuning does capture that variation, but it needs a memory-heavy gradient warm-up. G-LoRA addresses the gap by splitting each update…
Co-authors here
Venues
- Findings of the Association for Computational Linguistics ×2: Findings of the Association for Computational Linguistics 2026 ×2
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yihong-huang/