Zhendong Wang
Zhendong Wang has 2 papers in our library, in 2024, most of them on Language models & pretraining, Efficient models & compression; often with Mingyuan Zhou, Hai Huang, Tianlong Chen.
OpenAlex · ORCID · h-index 26 · 164 works · 2,214 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 42 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #10058
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 1 workArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 2Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation (2024 · 32 citations)
Diffusion models produce excellent images, but sampling requires many passes through the network. For example, EDM uses 35 NFE on CIFAR-10 32x32 and 511 NFE on ImageNet 64x64. Score identity Distillation (SiD) compresses a pretrained diffusion model into a generator that creates an image in a single forward pass, and… - Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM Generalization (2024 · 8 citations)
High-quality text for pretraining large language models is becoming scarce. This paper asks whether an already trained LLM can be improved cheaply by briefly continuing training on its own original data, without adding new sources. The authors first checked per-sample losses on C4 with LLaMA-2-7B. The very…
All works
- Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step GenerationarXiv:2404.04057Mingyuan Zhou, Huangjie Zheng, Zhendong Wang, et al.2024 · 32 citations
- Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM GeneralizationarXiv:2402.14270Xuxi Chen, Zhendong Wang, Daouda Sow, et al.2024 · 8 citations
- One-Step Diffusion Policy: Fast Visuomotor Policies via Diffusion Distillation ↗arXiv (Cornell University) · no summary yetZhendong Wang et al.2024 · 5 citations
- Probabilistic Conformal Prediction Using Conditional Random Samples ↗arXiv (Cornell University) · no summary yetZhendong Wang et al.2022 · 4 citations
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhendong-wang/