Daniel Y. Fu
Daniel Y. Fu has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, GPU & parallel computing; often with Anton Alexandrov, Beidi Chen, Ben Athiwaratkun.
OpenAlex · ORCID · h-index 7 · 35 works · 371 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 2,183 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #3248
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksHardware and Architecture · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksGPU & parallel computing · 1 work
Works by year
2020s
Papers
- FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU (2023 · 402 citations)
Running very large language models usually requires several expensive accelerators. GPT-175B alone needs about 325GB just for its weights. Many workloads, however, are batch jobs where latency matters little, such as benchmarking, information extraction and data wrangling. The authors build FlexGen, an inference… - RedPajama: an Open Dataset for Training Large Language Models (2024 · 260 citations)
Many leading LLMs are trained on data whose sources and cleaning steps are never disclosed. This makes open research on pretraining corpora slow and hard to replicate. The authors respond with two public releases. RedPajama-V1 rebuilds the LLaMA-1 training mixture from its brief published description and records…
All works
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness ↗arXiv:2205.14135 · no summary yetTri Dao et al.2022 · 2,495 citations
- FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUarXiv:2303.06865Ying Sheng, Lianmin Zheng, Binhang Yuan, et al.2023 · 402 citations
- RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
- Hyena Hierarchy: Towards Larger Convolutional Language Models ↗arXiv:2302.10866 · no summary yetMichael Poli et al.2023 · 182 citations
- Laughing Hyena Distillery: Extracting Compact Recurrences From Convolutions ↗neural information processing systems · no summary yetStefano Massaroli et al.2023 · 13 citations
- Exploring Diffusion Transformer Designs via Grafting ↗neural information processing systems · no summary yetKeshigeyan Chandrasegaran et al.2025 · 5 citations
Co-authors here
- Anton Alexandrov
- Beidi Chen
- Ben Athiwaratkun
- Christopher Ré
- Clark Barrett
- Huu Nguyen
- Joseph E. Gonzalez
- Lianmin Zheng
- Max Ryabinin
- Percy Liang
- Quentin Anthony
- Rahul Chalamala
Venues
- neural information processing systems ×2
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/daniel-y-fu/