William Brandon
William Brandon has 2 papers in our library, in 2023–2024, most of them on Efficient models & compression; often with Aniruddha Nrusimha, Mayank Mishra, Rameswar Panda.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 82 times in our library · ⭐ Paper Stars ranking: #8454
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 worksHardware and Architecture · 1 work
🧭 Topics 1Research subjects and languages the work is about.Efficient models & compression · 1 work
Works by year
2020s
Papers
- Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (2024 · 57 citations)
When large language models generate text autoregressively, they store keys and values (the KV cache) for every token and layer. - Striped Attention: Faster Ring Attention for Causal Transformers (2023 · 41 citations)
Ring Attention (Liu et al., 2023) makes very long contexts trainable by splitting queries, keys and values along the sequence across accelerators arranged in a ring.
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/william-brandon/