Xingcheng Yao
Xingcheng Yao has 2 papers in our library, in 2021–2025, most of them on Efficient models & compression; often with Danqi Chen, Enzhe Lu, Jiaxi Hu.
OpenAlex · ORCID · Wikidata · h-index 5 · 13 works · 2,749 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,809 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #863
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
💡 Concepts 2Key ideas and methods explained on our concept pages.Natural language processing · 1 workSemantic similarity · 1 work
Works by year
2020s
Papers
- SimCSE: Simple Contrastive Learning of Sentence Embeddings (2021 · 3,942 citations)
Pre-trained encoders such as BERT and RoBERTa produce poor general-purpose sentence vectors without further training. Their raw embedding space is anisotropic, and text is hard to augment because words are discrete. The authors introduce SimCSE, a contrastive framework with two variants. - Kimi Linear: An Expressive, Efficient Attention Architecture (2025 · 51 citations)
Softmax attention becomes a bottleneck for agentic and RL-heavy LLM workloads. Its cost grows quadratically with sequence length, and its KV cache keeps expanding during long decoding. Earlier linear-attention and hybrid designs saved compute but usually lost quality or were only tested at small scale. The Kimi Team…
All works
- SimCSE: Simple Contrastive Learning of Sentence EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,942 citations
- Muon is Scalable for LLM Training ↗arXiv:2502.16982 · no summary yetJingyuan Liu et al.2025 · 83 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework ↗arXiv (Cornell University) · no summary yetXingcheng Yao et al.2021 · 34 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/xingcheng-yao/