Jiahang Xu
Jiahang Xu has 2 papers in our library, in 2024, most of them on Language models & pretraining, Reasoning; often with Fan Yang, Li Lyna Zhang, Mao Yang.
OpenAlex · ORCID · h-index 7 · 19 works · 480 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 198 times in our library · ⭐ Paper Stars ranking: #6293
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksReasoning · 1 work
Works by year
2020s
Papers
- LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens (2024 · 142 citations)
Most large language models can only work with a fixed span of text. LLaMA2, for example, is limited to 4096 tokens, and earlier extension methods stopped around 128k. Going further is hard for three reasons: unseen position indices destabilize training, very long training texts are scarce and expensive to use, and… - Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers (2024 · 74 citations)
Small language models (SLMs) are often weak at multi-step reasoning. The usual fix is fine-tuning on data produced by a stronger model such as GPT-4. Self-improvement methods that avoid a teacher, such as RAP, tend to fail on small models for two reasons: they explore the solution space poorly, and they cannot…
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jiahang-xu/