Jingyang Yuan
Jingyang Yuan has 2 papers in our library, in 2025, most of them on Language models & pretraining, GPU & parallel computing, Efficient models & compression; often with Junyu Luo, Zhiping Xiao, Bohan Wu.
OpenAlex · h-index 8 · 33 works · 2,774 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 4,153 times in our library · ⭐ Paper Stars ranking: #6114
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 3Research subjects and languages the work is about.Efficient models & compression · 1 workGPU & parallel computing · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention (2025 · 142 citations)
Standard softmax attention becomes the main cost in long-context language models. The authors estimate it takes 70–80% of decoding latency at 64k tokens. Earlier sparse attention methods often save compute on paper but not in wall-clock time. Many speed up only prefilling or only decoding, clash with GQA/MQA memory… - A Survey on Efficient Large Language Model Training: From Data-centric Perspectives (2025 · 14 citations)
Post-training is the stage where LLMs acquire instruction following, alignment, reasoning and domain skills.
Co-authors here
- Junyu Luo ×2
- Zhiping Xiao ×2
- Bohan Wu
- Chong Ruan
- Damai Dai
- Huazuo Gao
- Lean Wang
- Liang Zhao
- Ming Zhang
- Nan Yin
- Wei Ju
- Xiao Luo
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jingyang-yuan/