Ion Gabriel Stoica
Ion Gabriel Stoica has 10 papers in our library, in 2023–2024, most of them on Language models & pretraining, Evaluation & benchmarks, Dialogue systems; often with Joseph E. Gonzalez, Lianmin Zheng, Wei-Lin Chiang.
OpenAlex · ORCID · Wikidata · h-index 132 · 717 works · 99,061 citations OpenAlex, 2026-10-14
📄 10 works in our library · 🔗 Cited 8,499 times in our library · 574 more in our library without a page yet · ⭐ Paper Stars ranking: #452
Affiliations
Fields, topics and concepts
📚 Shelves 12The field of science this work belongs to (OpenAlex fields).Computer Science · 10 worksArts and Humanities · 9 worksArtificial Intelligence · 10 worksLanguage and Linguistics · 9 worksHardware and Architecture · 3 worksInformation Systems · 3 worksComputer Networks and Communications · 1 workComputer Science Applications · 1 workSafety Research · 1 workSocial Sciences · 1 workMathematics · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 5Research subjects and languages the work is about.Language models & pretraining · 9 worksEfficient models & compression · 1 workEvaluation & benchmarks · 4 worksDialogue systems · 1 workBias, fairness & safety · 1 work
💡 Concepts 4Key ideas and methods explained on our concept pages.Language model · 1 workLarge language models · 1 workRetrieval-augmented generation · 1 workChatbots · 1 work
Works by year
2020s
Papers
- Efficient Memory Management for Large Language Model Serving with PagedAttention (2023 · 4,531 citations)
Serving large language models efficiently depends on how many requests a GPU can process together. The limiting factor is often the KV cache: the stored attention keys and values for each request, whose size changes as tokens are generated and whose final length is unknown in advance. Earlier systems such as… - SGLang: Efficient Execution of Structured Language Model Programs (2023 · 729 citations)
Modern LLM applications such as agents, few-shot evaluation, tree-of-thought search, RAG and JSON extraction rarely make a single model call. - LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code (2024 · 578 citations)
Widely used code benchmarks such as HumanEval and MBPP have become saturated. They also risk leaking into training data, and they test only one skill: turning a natural-language description into code. LiveCodeBench addresses these problems with a benchmark that keeps growing. It collects fresh problems from weekly… - Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference (2024 · 546 citations)
The authors show that conventional LLM benchmarks poorly reflect how models are actually used. These are fixed sets of closed-ended questions with reference answers: over time they leak into training data, become saturated, and do not account for human preferences in open-ended tasks. As an alternative, they propose… - LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset (2023 · 242 citations)
Research into how people use large language models has been held back by the lack of public logs of genuine user interactions. - From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipeline (2024 · 210 citations)
Static LLM benchmarks saturate quickly, can leak into training data, and mostly test close-ended tasks. Expert-built sets are expensive: GPQA's 500 questions reportedly cost over $120,000. Live human evaluation such as Chatbot Arena is too slow for developers to use routinely. The authors present BenchBuilder, an… - RAFT: Adapting Language Model to Domain Specific RAG (2024 · 137 citations)
The paper asks how a pretrained LLM should be prepared when it will answer questions over a known, fixed document collection, such as enterprise files, medical literature or API documentation, with retrieval at inference time. - Break the Sequential Dependency of LLM Inference Using Lookahead Decoding (2024 · 114 citations)
Generating text with LLMs one token at a time is slow. Each step is limited by memory bandwidth, so most of the GPU's compute sits idle. Speculative decoding helps, but it needs a draft model, which is hard to train and often fails to transfer across base models or datasets. The authors propose Lookahead Decoding… - Rethinking Benchmark and Contamination for Language Models with Rephrased Samples (2023 · 103 citations)
Public LLM benchmarks can leak into training corpora. Standard decontamination looks for surface similarity, using either n-gram overlap or an embedding-similarity threshold. The authors show that these checks are easy to get around. They had GPT-4 reword test items, or rewrite code in a different style or… - OR-Bench: An Over-Refusal Benchmark for Large Language Models (2024 · 76 citations)
Safety-tuned LLMs often refuse harmless requests that merely look risky. Before this work, the problem had no large-scale way to be measured. The only dedicated test set, XSTest, has 250 hand-written prompts, and recent strong models now answer almost all of them. The authors build an automated pipeline to fill this…
All works
- Chord ↗ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM) · no summary yetIon Gabriel Stoica et al.2001 · 9,623 citations
- Above the Clouds: A Berkeley View of Cloud Computing ↗no summary yetMichael Armbrust et al.2009 · 5,696 citations
- Efficient Memory Management for Large Language Model Serving with PagedAttentionarXiv:2309.06180Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, et al.2023 · 4,531 citations
- Spark: cluster computing with working sets ↗no summary yetMatei Zaharia et al.2010 · 4,118 citations
- Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing ↗no summary yetMatei Zaharia et al.2012 · 3,546 citations
- Chord: a scalable peer-to-peer lookup protocol for internet applications ↗IEEE/ACM Transactions on Networking · no summary yetIon Gabriel Stoica et al.2002 · 3,135 citations
- Apache Spark ↗Communications of the ACM · no summary yetMatei Zaharia et al.2016 · 2,436 citations
- Chord ↗ACM SIGCOMM Computer Communication Review · no summary yetIon Gabriel Stoica et al.2001 · 1,923 citations
- Improving MapReduce performance in heterogeneous environments ↗no summary yetMatei Zaharia et al.2008 · 1,592 citations
- Mesos: a platform for fine-grained resource sharing in the data center ↗no summary yetBenjamin Hindman et al.2011 · 1,582 citations
- Wide-area cooperative storage with CFS ↗no summary yetFrank Dabek et al.2001 · 1,430 citations
- Delay scheduling ↗European Conference on Computer Systems · no summary yetMatei Zaharia et al.2010 · 1,395 citations
- A data-oriented (and beyond) network architecture ↗ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM) · no summary yetTeemu Koponen et al.2007 · 1,368 citations
- Dominant resource fairness: fair allocation of multiple resource types ↗no summary yetAli Ghodsi et al.2011 · 1,077 citations
- Geographic routing without location information ↗Proceedings of the 28th Annual International Conference on Mobile Computing And Networking · no summary yetAnanth Rao et al.2003 · 748 citations
- SGLang: Efficient Execution of Structured Language Model ProgramsConference on Neural Information Processing Systems (NeurIPS)Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, et al.2023 · 729 citations
- BlinkDB ↗no summary yetSameer Agarwal et al.2013 · 694 citations
- Understanding the impact of video quality on user engagement ↗ACM SIGCOMM Conference (SIGCOMM) · no summary yetFlorin Dobrian et al.2011 · 674 citations
- Internet indirection infrastructure ↗ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM) · no summary yetIon Gabriel Stoica et al.2002 · 642 citations
- Tune: A Research Platform for Distributed Model Selection and Training ↗arXiv (Cornell University) · no summary yetRichard Liaw et al.2018 · 640 citations
- Reining in the outliers in map-reduce clusters using Mantri ↗Operating Systems Design and Implementation · no summary yetGanesh Ananthanarayanan et al.2010 · 639 citations
- GraphX ↗no summary yetReynold Xin et al.2013 · 581 citations
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for CodearXiv:2403.07974Naman Jain, King Han, Alex Gu, et al.2024 · 578 citations
- The impact of DHT routing geometry on resilience and proximity ↗ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM) · no summary yetKrishna P. Gummadi et al.2003 · 567 citations
- Robust incentive techniques for peer-to-peer networks ↗ACM Conference on Electronic Commerce (EC) · no summary yetMichal Feldman et al.2004 · 558 citations
See all 584 works by Ion Gabriel Stoica →
Co-authors here
- Joseph E. Gonzalez ×7
- Lianmin Zheng ×5
- Wei-Lin Chiang ×5
- Ying Sheng ×4
- Hao Zhang ×3
- Tianle Li ×3
- Banghua Zhu ×2
- Cody Hao Yu ×2
- Naman Jain ×2
- Siyuan Zhuang ×2
- Tianjun Zhang ×2
- Zhuohan Li ×2
Venues
- Lecture notes in computer science ×26
- PubMed ×26
- Proceedings of the VLDB Endowment ×18
- ACM SIGCOMM Computer Communication Review ×14
- Proceedings - ACM-SIGMOD International Conference on Management of Data ×12
- Networked Systems Design and Implementation ×11
- neural information processing systems ×11
- ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications (SIGCOMM) ×8
- UC Berkeley ×8
- ACM Symposium on Cloud Computing (SoCC) ×5
- ACM Workshop on Hot Topics in Networks (HotNets) ×5
- IEEE/ACM Transactions on Networking ×5
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/ion-gabriel-stoica/