Yiran Ding
Yiran Ding has 2 papers in our library, in 2024–2026, most of them on Language models & pretraining; often with Changze Lv, Chengruidong Zhang, Fan Yang.
OpenAlex · ORCID · h-index 25 · 108 works · 2,218 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 127 times in our library · ⭐ Paper Stars ranking: #6291
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens (2024 · 142 citations)
Most large language models can only work with a fixed span of text. LLaMA2, for example, is limited to 4096 tokens, and earlier extension methods stopped around 128k. Going further is hard for three reasons: unseen position indices destabilize training, very long training texts are scarce and expensive to use, and… - Mitigating Position Bias in Transformers via Layer-Specific Positional Embedding Scaling (2026)
Long-context LLMs that use RoPE tend to concentrate attention on the start and end of the input. As a result, they underuse content in the middle, a problem known as "lost-in-the-middle." Earlier fixes such as Attention Buckets, MoICE and Ms-PoE mix several RoPE bases or scales. However, they need repeated forward…
Co-authors here
- Changze Lv
- Chengruidong Zhang
- Fan Yang
- Li Lyna Zhang
- Mao Yang
- Muling Wu
- Ning Shang
- Qi Qian
- Shizheng Li
- Tianlong Li
- Tianyuan Shi
- Xiaoqing Zheng
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yiran-ding/