Siyuan Zhuang
Siyuan Zhuang has 2 papers in our library, in 2023, most of them on Language models & pretraining, Efficient models & compression; often with Ion Stoica, Joseph E. Gonzalez, Lianmin Zheng.
OpenAlex · ORCID · h-index 7 · 14 works · 3,214 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 3,075 citations in our library · 2 more in our library without a page yet · ⭐ Paper Star rank #851
Affiliations
Topics
Language models & pretraining (2) Efficient models & compression (1)
Works by year
2020s
Papers
- Efficient Memory Management for Large Language Model Serving with PagedAttention (2023 · 2,738 citations)
To make a large language model run fast, requests are processed in batches. The batch size is limited by GPU memory, specifically by the KV cache: for each request it grows and shrinks unpredictably. Existing systems, including FasterTransformer and Orca, reserve in advance a contiguous chunk of memory for each… - LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset (2023 · 235 citations)
Research into how people use large language models has been held back by the lack of public logs of genuine user interactions.
Also in our library
Co-authors here
- Ion Stoica ×2
- Joseph E. Gonzalez ×2
- Lianmin Zheng ×2
- Ying Sheng ×2
- Zhuohan Li ×2
- Cody Hao Yu
- Eric Xing
- Hao Zhang
- Tianle Li
- Wei-Lin Chiang
- Zi Lin
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/siyuan-zhuang/