Jian Jiao
Jian Jiao has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Chen Lin, Nan Duan, Weizhu Chen.
OpenAlex · ORCID · h-index 27 · 325 works · 3,069 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 224 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6342
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators (2023 · 152 citations)
Manually labelling data for NLP is slow and expensive. This paper asks whether GPT-3.5 models can replace crowd workers. The authors build AnnoLLM, which gives the model the same materials a human annotator would get: a task description, label definitions and labelled examples. It then adds a two-stage… - Rho-1: Not All Tokens Are What You Need (2024 · 59 citations)
Standard LLM pre-training applies the next-token loss uniformly, even though filtered corpora still contain noisy, irrelevant, or already-mastered tokens.
All works
- PromptBERT: Improving BERT Sentence Embeddings with Prompts ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetTing Jiang et al.2022 · 198 citations
- AnnoLLM: Making Large Language Models to Be Better Crowdsourced AnnotatorsarXiv:2303.16854Xingwei He, Zhenghao Lin, Yeyun Gong, et al.2023 · 152 citations
- Rho-1: Not All Tokens Are What You NeedarXiv:2404.07965Zhenghao Lin, Zhibin Gou, Yeyun Gong, et al.2024 · 59 citations
Co-authors here
- Chen Lin ×2
- Nan Duan ×2
- Weizhu Chen ×2
- Yeyun Gong ×2
- Zhenghao Lin ×2
- Hang Zhang
- Ruochen Xu
- Xiao Liu
- Yelong Shen
- Yujiu Yang
- Zhibin Gou
Venues
- Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jian-jiao/