Guangtao Zeng
Guangtao Zeng has 2 papers in our library, in 2020–2024, most of them on Language models & pretraining, Dialogue systems; often with Jiaqi Zeng, Peiyuan Zhang, Ruoyu Zhang.
OpenAlex · h-index 7 · 25 works · 328 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 524 times in our library · 6 more in our library without a page yet · ⭐ Paper Stars ranking: #3067
Affiliations
Concepts, shelves and topics
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 workMathematics · 1 workHealth Informatics · 1 workMedicine · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workDialogue systems · 1 work
Works by year
2020s
Papers
- TinyLlama: An Open-Source Small Language Model (2024 · 351 citations)
Scaling laws such as Chinchilla's say parameters and data should grow together. For deployment, though, inference cost matters more, and it was unclear how well a small model does when trained on far more data than those laws recommend. The authors test this with TinyLlama, a 1.1B-parameter decoder-only Transformer… - MedDialog: Large-scale Medical Dialogue Datasets (2020 · 247 citations)
Building medical dialogue systems that could act as "virtual doctors" in telemedicine requires many real patient–doctor conversations.
All works
- TinyLlama: An Open-Source Small Language ModelarXiv:2401.02385Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 351 citations
- MedDialog: Large-scale Medical Dialogue DatasetsConference on Empirical Methods in Natural Language Processing (EMNLP)Guangtao Zeng, Wenmian Yang, Zeqian Ju, et al.2020 · 247 citations
- Long Context Transfer from Language to VisionarXiv:2406.16852 · original ↗ · no summary yetPeiyuan Zhang et al.2024 · 67 citations
- RegMix: Data Mixture as Regression for Language Model Pre-trainingarXiv:2407.01492 · original ↗ · no summary yetQian Liu et al.2024 · 50 citations
- Sailor: Open Language Models for South-East AsiaarXiv:2404.03608 · original ↗ · no summary yetLongxu Dou et al.2024 · 27 citations
- Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive SearcharXiv:2502.02508 · original ↗ · no summary yetMaohao Shen et al.2025 · 13 citations
- EffiCoder: Enhancing Code Generation in Large Language Models through Efficiency-Aware Fine-tuningarXiv:2410.10209 · original ↗ · no summary yetDong Huang et al.2024 · 11 citations
- Tailored Primitive Initialization is the Secret Key to Reinforcement LearningProceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · original ↗ · no summary yetYihang Yao et al.2026
Co-authors here
Venues
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2020
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/guangtao-zeng/