Ramachandran Ramjee
Ramachandran Ramjee has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Amey Agrawal, Ashish Panwar, Bhargav S. Gulavani.
OpenAlex · ORCID · Wikidata · h-index 40 · 134 works · 8,660 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 564 times in our library · ⭐ Paper Stars ranking: #3822
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArts and Humanities · 2 worksHardware and Architecture · 3 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Networks and Communications · 1 workInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 3 works
Works by year
2020s
Papers
- Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve (2024 · 369 citations)
Serving LLMs online requires both high throughput, to keep costs down, and low latency between generated tokens. - SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills (2023 · 144 citations)
Serving large language models is inefficient because generation has two very different stages. Processing the prompt (prefill) keeps a GPU fully busy even with a single request. Producing output one token at a time (decode) leaves most compute idle unless batches are large. Under pipeline parallelism, micro-batches… - Vidur: A Large-Scale Simulation Framework For LLM Inference (2024 · 90 citations)
Deploying a large language model involves many choices: the parallelism layout (TP, PP, number of replicas), the scheduler (Orca, vLLM, Sarathi-Serve), batch size, scheduler-specific knobs and the GPU SKU.
Co-authors here
- Amey Agrawal ×3
- Ashish Panwar ×3
- Bhargav S. Gulavani ×3
- Jayashree Mohan ×3
- Nipun Kwatra ×3
- Alexey Tumanov ×2
- Nitin Kedia ×2
Venues
- OSDI 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/ramachandran-ramjee/