Shengyu Liu
Shengyu Liu has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Xin Jin, Xuanzhe Liu, Yinmin Zhong.
OpenAlex · ORCID · h-index 8 · 18 works · 188 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 568 times in our library · ⭐ Paper Stars ranking: #3579
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArts and Humanities · 2 worksHardware and Architecture · 3 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 2 worksComputer Networks and Communications · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 3 works
Works by year
2020s
Papers
- DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving (2024 · 409 citations)
LLM inference has two phases with different profiles. Prefill processes the whole prompt in one compute-heavy step. Decoding emits one token per step and is bound by memory bandwidth. Mainstream systems batch both phases on the same GPUs. As a result, prefill delays inflate TPOT, decoding work inflates TTFT, and both… - LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism (2024 · 131 citations)
Long-context LLMs (Claude-3, Gemini-1.5 and LWM all accept up to 1M tokens) create very uneven resource demands. - Fast Distributed Inference Serving for Large Language Models (2023 · 123 citations)
FastServe, from Peking University, is a distributed serving system for large language models that targets the latency of interactive applications.
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shengyu-liu/