Fei Jia
Fei Jia has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Boris Ginsburg, Cheng-Ping Hsieh, Igor Gitman.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 476 times in our library · ⭐ Paper Stars ranking: #4260
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArts and Humanities · 1 workArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 1 workLanguage and Linguistics · 1 workSocial Sciences · 1 workComputational Theory and Mathematics · 1 workEducation · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- RULER: What's the Real Context Size of Your Long-Context Language Models? (2024 · 400 citations)
Long-context language models are usually checked with the needle-in-a-haystack (NIAH) test. That test only shows whether a model can find one planted fact, so it says little about deeper use of long inputs. The NVIDIA authors built RULER, a fully synthetic benchmark whose input length and difficulty can be set… - OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset (2024 · 98 citations)
The strongest open math models have mostly been trained on solutions distilled from GPT-3.5/4. That approach has three drawbacks: restrictive terms of use, higher generation cost, and poor reproducibility because closed models change over time. The authors test whether a permissively licensed open model can take…
Co-authors here
- Boris Ginsburg
- Cheng-Ping Hsieh
- Igor Gitman
- Ivan Moshkov
- Samuel Kriman
- Sean Narenthiran
- Shubham Toshniwal
- Simeng Sun
- Yang Zhang
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/fei-jia/