Alexey Tumanov
Alexey Tumanov has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Amey Agrawal, Ashish Panwar, Bhargav S. Gulavani.
OpenAlex · ORCID · h-index 23 · 78 works · 3,288 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 668 times in our library · 8 more in our library without a page yet · ⭐ Paper Stars ranking: #4460
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArts and Humanities · 1 workHardware and Architecture · 2 worksArtificial Intelligence · 1 workLanguage and Linguistics · 1 workComputer Networks and Communications · 1 workInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve (2024 · 369 citations)
Serving LLMs online requires both high throughput, to keep costs down, and low latency between generated tokens. - Vidur: A Large-Scale Simulation Framework For LLM Inference (2024 · 90 citations)
Deploying a large language model involves many choices: the parallelism layout (TP, PP, number of replicas), the scheduler (Orca, vLLM, Sarathi-Serve), batch size, scheduler-specific knobs and the GPU SKU.
All works
- Ray: A Distributed Framework for Emerging AI Applications ↗arXiv (Cornell University) · no summary yetPhilipp Moritz et al.2017 · 437 citations
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-ServeOSDI 2024Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.2024 · 369 citations
- Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
- Real-Time Machine Learning ↗Workshop on Hot Topics in Operating Systems · no summary yetRobert Nishihara et al.2017 · 48 citations
- Dynamic Space-Time Scheduling for GPU Inference ↗arXiv:1901.00041 · no summary yetParas Jain et al.2018 · 43 citations
- Real-Time Machine Learning: The Missing Pieces ↗arXiv (Cornell University) · no summary yetRobert Nishihara et al.2017 · 16 citations
- InferLine: ML Inference Pipeline Composition Framework. ↗arXiv (Cornell University) · no summary yetDaniel Crankshaw et al.2018 · 10 citations
- HyperSched: Dynamic Resource Reallocation for Model Development on a Deadline ↗arXiv (Cornell University) · no summary yetRichard Liaw et al.2020 · 8 citations
- The OoO VLIW JIT Compiler for GPU Inference ↗arXiv:1901.10008 · no summary yetParas Jain et al.2019 · 7 citations
- SuperServe: Fine-Grained Inference Serving for Unpredictable Workloads ↗arXiv (Cornell University) · no summary yetAlind Khare et al.2023 · 6 citations
Co-authors here
- Amey Agrawal ×2
- Ashish Panwar ×2
- Bhargav S. Gulavani ×2
- Jayashree Mohan ×2
- Nipun Kwatra ×2
- Nitin Kedia ×2
- Ramachandran Ramjee ×2
Venues
- OSDI 2024
- Workshop on Hot Topics in Operating Systems
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/alexey-tumanov/