Xupeng Miao
Xupeng Miao has 3 papers in our library, in 2023, most of them on Language models & pretraining; often with Gabriele Oliaro, Xinhao Cheng, Zhihao Jia.
OpenAlex · ORCID · Wikidata · h-index 22 · 88 works · 1,774 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 258 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #4365
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArts and Humanities · 2 worksHardware and Architecture · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Networks and Communications · 1 workInformation Systems · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 3 works
Works by year
2020s
Papers
- SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verification (2023 · 220 citations)
Serving generative LLMs is slow and expensive because autoregressive decoding emits one token per step, which leaves GPUs underused and makes key-value caches costly in memory. - SpotServe: Serving Generative Large Language Models on Preemptible Instances (2023 · 145 citations)
SpotServe addresses the high cost of serving generative LLMs. It runs inference on preemptible cloud GPUs, such as AWS spot instances, which can be up to 90% cheaper than on-demand machines but can be reclaimed at any time. Earlier spot-based serving systems assumed that a model fits on one instance and handled… - Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems (2023 · 110 citations)
Generative LLMs are expensive to deploy. Their size and token-by-token generation make low-latency, high-throughput serving difficult, especially for organizations without large compute budgets. This survey by researchers at Purdue and Carnegie Mellon reviews the field from a machine-learning-systems perspective. It…
All works
- PointCLIP: Point Cloud Understanding by CLIP ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetRenrui Zhang et al.2022 · 460 citations
- SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and VerificationACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 220 citations
- SpotServe: Serving Generative Large Language Models on Preemptible InstancesACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)Xupeng Miao, Chunan Shi, Jiangfei Duan, et al.2023 · 145 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- Distributed Graph Neural Network Training: A Survey ↗arXiv:2211.00216 · no summary yetYingxia Shao et al.2022 · 103 citations
Co-authors here
- Gabriele Oliaro ×2
- Xinhao Cheng ×2
- Zhihao Jia ×2
- Zhihao Zhang ×2
- Bin Cui
- Dahua Lin
- Tianqi Chen
- Zhengxin Zhang
Venues
- ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) ×2: ASPLOS 2023 ×2
- ACM Computing Surveys: ACM Computing Surveys 2023
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/xupeng-miao/