Kezhi Kong
Kezhi Kong has 3 papers in our library, in 2023–2025, most of them on Language models & pretraining; often with Bryan Catanzaro, Dan Su, Mohammad Shoeybi.
OpenAlex · h-index 8 · 27 works · 262 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 232 times in our library · ⭐ Paper Stars ranking: #6690
Affiliations
🎓University of Maryland, College ParkCollege Park ·
United States2021–2024 · 7 papers🎓Zhejiang UniversityHangzhou ·
China2018–2019 · 2 papers
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 3 works
Works by year
2020s
Papers
- On the Reliability of Watermarks for Large Language Models (2023 · 103 citations)
Spotting machine-generated text helps limit spam, bot activity and contamination of future training data. Earlier watermark evaluations, however, mostly assumed the detector receives unmodified model output. This paper tests whether the green-list watermark of Kirchenbauer et al. (2023) survives realistic handling… - Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining Dataset (2025 · 65 citations)
Leading English web corpora built from Common Crawl, such as FineWeb-Edu and DCLM, raise benchmark scores by discarding roughly nine tenths of the crawl with model-based filters. - Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase Pretraining (2024 · 12 citations)
Organizations that build large language models rarely disclose how they mix and order pretraining data, so there is little public guidance on how a data blend should be designed and whether it holds up at larger scale.
Co-authors here
- Bryan Catanzaro ×2
- Dan Su ×2
- Mohammad Shoeybi ×2
- Mostofa Patwary ×2
- Aniruddha Saha
- Brandon Norick
- John Kirchenbauer
- Jonas Geiping
- Joseph Jennings
- Micah Goldblum
- Shrimai Prabhumoye
- Steven Y. Feng
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/kezhi-kong/