Xinyao Niu
Xinyao Niu has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Xiang Yue, Hannaneh Hajishirzi, Hao Peng.
OpenAlex · h-index 3 · 11 works · 87 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 518 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #4697
Affiliations
Concepts, shelves and topics
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksArts and Humanities · 1 workLanguage and Linguistics · 1 workSafety Research · 1 workSocial Sciences · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- Data Engineering for Scaling Language Models to 128K Context (2024 · 107 citations)
Open-source LLMs that claim support for 100K+ tokens often fail the Needle-in-a-Haystack test, which checks whether a model can recall a fact hidden anywhere in a very long document. - Machine Unlearning of Pre-trained Large Language Models (2024 · 84 citations)
The paper addresses how to make a pre-trained large language model behave as if certain training documents had never been included, for example in response to copyright or privacy removal requests.
All works
- Data Engineering for Scaling Language Models to 128K ContextarXiv:2402.10171Yao Fu, Rameswar Panda, Xinyao Niu, et al.2024 · 107 citations
- Machine Unlearning of Pre-trained Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jin Yao, Eli Chien, Minxin Du, et al.2024 · 84 citations
- Yi-Lightning Technical Report ↗arXiv:2412.01253 · no summary yetAlan Wake et al.2024 · 11 citations
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/xinyao-niu/