Chao Yang
Chao Yang has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining; often with Dianhai Yu, Haifeng Wang, Jie Liu.
OpenAlex · ORCID · h-index 12 · 36 works · 776 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 45 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #9281
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models (2024 · 17 citations)
Aligning very large language models with human preferences through fine-tuning is costly and hard to engineer. - RRAtention: Dynamic Block Sparse Attention via Per-Head Round-Robin Shifts for Long-Context Inference (2026)
Attention cost grows quadratically with sequence length, which makes long-context prefill expensive. Dynamic sparse attention computes only the query–key blocks that matter for a given input, but each existing method gives something up. SeerAttention and MInference need offline training or pattern search. MInference…
All works
- WeNet: Production Oriented Streaming and Non-Streaming End-to-End Speech Recognition Toolkit ↗Interspeech (USB) · no summary yetZhuoyuan Yao et al.2021 · 262 citations
- Weak-to-Strong Search: Align Large Language Models via Searching over Small Language ModelsConference on Neural Information Processing Systems (NeurIPS)Zhanhui Zhou, Zhixuan Liu, Jie Liu, et al.2024 · 17 citations
- RRAtention: Dynamic Block Sparse Attention via Per-Head Round-Robin Shifts for Long-Context InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Siran Liu, Guoxia Wang, Sa Wang, et al.2026
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
- Interspeech (USB)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/chao-yang/