Who cites Daniel Y. Fu
- ALLaM: Large Language Models for Arabic and EnglisharXiv:2407.15390M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
- Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
- Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
- Prompt Cache: Modular Attention Reuse for Low-Latency InferenceMLSys 2024In Gim, Guojun Chen, Seung-seob Lee, et al.2023 · 109 citations
- Mechanistic Interpretability for AI Safety — A ReviewarXiv:2404.14082Leonard Bereska, Efstratios Gavves2024 · 108 citations
- Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttentionUSENIX ATC 2024Bin Gao, Zhuomin He, Puru Sharma, et al.2024 · 105 citations
- ServerlessLLM: Low-Latency Serverless Inference for Large Language ModelsarXiv:2401.14351Yao Fu, Leyang Xue, Yeqi Huang, et al.2024 · 105 citations
- Qwen2.5-1M Technical ReportarXiv:2501.15383An Yang, Bowen Yu, Chengyuan Li, et al.2025 · 102 citations
- Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityarXiv:2401.05459Yuanchun Li, Hao Wen, Weijun Wang, et al.2024 · 100 citations
- World Model on Million-Length Video And Language With Blockwise RingAttentionarXiv:2402.08268Hao Liu, Wilson Yan, Matei Zaharia, et al.2024 · 99 citations
- MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731Ke Wang, Houxing Ren, Aojun Zhou, et al.2023 · 99 citations
- LongAlign: A Recipe for Long Context Alignment of Large Language ModelsarXiv:2401.18058Yushi Bai, Xin Lv, Jiajie Zhang, et al.2024 · 98 citations
- MAmmoTH2: Scaling Instructions from the WebConference on Neural Information Processing Systems (NeurIPS)Xiang Yue, Tuney Zheng, Ge Zhang, et al.2024 · 96 citations
- LLM Inference Unveiled: Survey and Roofline Model InsightsarXiv 2024Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.2024 · 91 citations
- PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM InferenceFindings of the Association for Computational LinguisticsDongjie Yang, Xiaodong Han, Yan Gao, et al.2024 · 91 citations
- Skywork: A More Open Bilingual Foundation ModelarXiv:2310.19341Tianwen Wei, Liang Zhao, Lichang Zhang, et al.2023 · 91 citations
- Rephrasing the Web: A Recipe for Compute and Data-Efficient Language ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Pratyush Maini, Skyler Seto, Richard Bai, et al.2024 · 90 citations
- Vidur: A Large-Scale Simulation Framework For LLM InferencearXiv:2405.05465Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.2024 · 90 citations
- Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
- Landmark Attention: Random-Access Infinite Context Length for TransformersarXiv:2305.16300Amirkeivan Mohtashami, Martin Jaggi2023 · 88 citations
- Large Language Models as General Pattern MachinesarXiv:2307.04721Suvir Mirchandani, Fei Xia, Pete Florence, et al.2023 · 88 citations
- Do Membership Inference Attacks Work on Large Language Models?arXiv:2402.07841Michael Duan, Anshuman Suri, Niloofar Mireshghallah, et al.2024 · 87 citations
- Liger Kernel: Efficient Triton Kernels for LLM TrainingarXiv:2410.10989Pin-Lun Hsu, Yun Dai, Vignesh Kothapalli, et al.2024 · 87 citations
- REST: Retrieval-Based Speculative DecodingarXiv:2311.08252Zhenyu He; Zexuan Zhong; Tianle Cai; Jason D. Lee;, Di He2023 · 87 citations
- LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-TrainingConference on Empirical Methods in Natural Language Processing (EMNLP)Tong Zhu, Xiaoye Qu, Daize Dong, et al.2024 · 85 citations
- PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human PreferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Jiaming Ji, Donghai Hong, Borong Zhang, et al.2025 · 83 citations
- EfficientQAT: Efficient Quantization-Aware Training for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhao Chen, Wenqi Shao, Peng Xu, et al.2025 · 82 citations
- Knowledge Fusion of Large Language ModelsarXiv:2401.10491Fanqi Wan, Xinting Huang, Deng Cai, et al.2024 · 82 citations
- OpenCoder: The Open Cookbook for Top-Tier Code Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Siming Huang, Tianhao Cheng, Jason Klein Liu, et al.2025 · 81 citations
- LLM Maybe LongLM: Self-Extend LLM Context Window Without TuningarXiv:2401.01325Hongye Jin, Xiaotian Han, Jingfeng Yang, et al.2024 · 81 citations
- Punica: Multi-Tenant LoRA ServingMLSys 2024Lequn Chen, Zihao Ye, Yongji Wu, et al.2023 · 81 citations
- MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
- Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionarXiv:2404.07143Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal2024 · 80 citations
- S-LoRA: Serving Thousands of Concurrent LoRA AdaptersMLSys 2024Ying Sheng, Shiyi Cao, Dacheng Li, et al.2023 · 80 citations
- A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?arXiv:2503.24235Qiyuan Zhang, Fuyuan Lyu, Zexu Sun, et al.2025 · 79 citations
- BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextarXiv:2403.18421Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, et al.2024 · 79 citations
- KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge GraphAnnual Meeting of the Association for Computational Linguistics (ACL)Jinhao Jiang, Kun Zhou, Wayne Xin Zhao, et al.2025 · 78 citations
- DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-InferencearXiv 2024 (Microsoft DeepSpeed)Connor Holmes, Masahiro Tanaka, Michael Wyatt, et al.2024 · 78 citations
- OVM, Outcome-supervised Value Models for Planning in Mathematical ReasoningFindings of the Association for Computational LinguisticsFei Yu, Anningzhe Gao, Benyou Wang2023 · 78 citations
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive RetrievalarXiv:2407.12883Hongjin Su, Howard Yen, Mengzhou Xia, et al.2024 · 77 citations
- Multilingual Large Language Model: A Survey of Resources, Taxonomy and FrontiersarXiv:2404.04925Libo Qin, Qiguang Chen, Yuhang Zhou, et al.2024 · 75 citations
- Small Language Models Learn Enhanced Reasoning Skills from Medical TextbooksarXiv:2404.00376Hyunjae Kim, Hyeon Hwang, Jiwoo Lee, et al.2024 · 75 citations
- Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI ArchitecturesProceedings - International Symposium on Computer Architecture/ProceedingsChenggang Zhao, Chengqi Deng, Chong Ruan, et al.2025 · 74 citations
- SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
- ReLoRA: High-Rank Training Through Low-Rank UpdatesarXiv:2307.05695Vladislav Lialin, Namrata Shivagunde, Sherin Muckatira, et al.2023 · 74 citations
- Skeleton-of-Thought: Prompting LLMs for Efficient Parallel GenerationarXiv:2307.15337Xuefei Ning, Zinan Lin, Zixuan Zhou, et al.2023 · 72 citations
- Seed-TTS: A Family of High-Quality Versatile Speech Generation ModelsarXiv:2406.02430Philip Anastassiou, Jiawei Chen, Jitong Chen, et al.2024 · 71 citations
- Kimi-VL Technical ReportarXiv:2504.07491Kimi Team, Angang Du, Bohong Yin, et al.2025 · 70 citations
- Kevin: Multi-Turn RL for Generating CUDA KernelsarXiv 2025Carlo Baronio, Pietro Marsella, Ben Pan, et al.2025 · 69 citations
- MagicPIG: LSH Sampling for Efficient LLM GenerationarXiv:2410.16179Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.2024 · 68 citations
- RetrievalAttention: Accelerating Long-Context LLM Inference via Vector RetrievalConference on Neural Information Processing Systems (NeurIPS)Di Liu, Meng Chen, Baotong Lu, et al.2024 · 66 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Multimodal Table UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Mingyu Zheng, Xinwei Feng, Qingyi Si, et al.2024 · 62 citations
- Tree Search for Language Model AgentsarXiv:2407.01476Jing Yu Koh, Stephen McAleer, Daniel Fried, et al.2024 · 61 citations
- In-context Pretraining: Language Modeling Beyond Document BoundariesarXiv:2310.10638Weijia Shi, Sewon Min, Maria Lomeli, et al.2023 · 61 citations
- Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
- Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-TuningarXiv:2402.00530Ming Li, Yong Zhang, Shwai He, et al.2024 · 60 citations
- XAttention: Block Sparse Attention with Antidiagonal ScoringarXiv:2503.16428Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.2025 · 59 citations
- BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsLanguage Resources and Evaluation Conference (LREC)Zican Dong, Tianyi Tang, Junyi Li, et al.2024 · 59 citations
- Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
- Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
- LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuningarXiv:2308.03303Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.2023 · 58 citations
- Unintended Impacts of LLM Alignment on Global RepresentationAnnual Meeting of the Association for Computational Linguistics (ACL)Michael J Ryan, William Held, Diyi Yang2024 · 57 citations
- Flex Attention: A Programming Model for Generating Optimized Attention KernelsarXiv:2412.05496Juechu Dong, Boyuan Feng, Driss Guessous, et al.2024 · 55 citations
- Zoology: Measuring and Improving Recall in Efficient Language ModelsarXiv:2312.04927Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou; Atri Rudra;, Christopher Re2023 · 55 citations
- Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise TrainingarXiv:2309.10400Dawei Zhu, Nan Yang, Liang Wang, et al.2023 · 52 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
- Self-Verification Improves Few-Shot Clinical Information ExtractionarXiv:2306.00024 · IMLH 2023Zelalem Gero, Chandan Singh, Hao Cheng, et al.2023 · 51 citations
- MiniMax-01: Scaling Foundation Models with Lightning AttentionarXiv:2501.08313MiniMax, Aonian Li, Bangwei Gong, et al.2025 · 50 citations
- WebLINX: Real-World Website Navigation with Multi-Turn DialoguearXiv:2402.05930Xing Han Lu, Zden\vek Kasner, Siva Reddy2024 · 50 citations
- MixEval: Deriving Wisdom of the Crowd from LLM Benchmark MixturesConference on Neural Information Processing Systems (NeurIPS)Jinjie Ni, Fuzhao Xue, Xiang Yue, et al.2024 · 47 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations
- AlGhafa Evaluation Benchmark for Arabic Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Ebtesam Almazrouei, Ruxandra Cojocaru, Michele Baldo, et al.2023 · 46 citations
- EuroLLM-9B: Technical ReportarXiv:2506.04079Pedro Henrique Martins, Joao Alves, Patrick Fernandes, et al.2025 · 45 citations
- Stop Looking for “Important Tokens” in Multimodal Language Models: Duplication Matters MoreConference on Empirical Methods in Natural Language Processing (EMNLP)Zichen Wen, Yifeng Gao, Shaobo Wang, et al.2025 · 44 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- SlimPajama-DC: Understanding Data Combinations for LLM TrainingarXiv:2309.10818Zhiqiang Shen, Tianhua Tao, Liqun Ma, et al.2023 · 38 citations
- Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese UnderstandingarXiv:2405.08748Zhimin Li, Jianwei Zhang, Qin Lin, et al.2024 · 35 citations
- On the Diversity of Synthetic Data and its Impact on Training Large Language ModelsarXiv:2410.15226Hao Chen, Abdul Waheed, Xiang Li, et al.2024 · 35 citations
- Efficient Online Data Mixing For Language Model Pre-TrainingarXiv:2312.02406Alon Albalak, Liangming Pan, Colin Raffel, et al.2023 · 35 citations
- TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormerarXiv:2307.14995Zhen Qin, Dong Li, Weigao Sun, et al.2023 · 33 citations
- The Hidden Attention of Mamba ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Ameen Ali Ali, Itamar Zimerman, Lior Wolf2025 · 32 citations
- A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language ModelsarXiv:2401.04658Zhen Qin, Weigao Sun, Dong Li, et al.2024 · 31 citations
- Scaling Laws and Compute-Optimal Training Beyond Fixed Training DurationsConference on Neural Information Processing Systems (NeurIPS)Alexander Hägele, Elie Bakouch, Atli Kosson, et al.2024 · 31 citations
- Weaver: Foundation Models for Creative WritingarXiv:2401.17268Tiannan Wang; Jiamin Chen; Qingrui Jia; Shuai Wang; Ruoyu Fang; Huilin Wang; Zhaowei Gao; Chunzhao Xie; Chuou Xu; Jihong Dai; Yibin Liu; Jialong Wu; Shengwei Ding; Long Li; Zhiwei Huang; Xinle Deng; Teng Yu; Gangan Ma; Han Xiao; Zixin Chen; Danjun Xiang; Yunxia Wang; Yuanyuan Zhu; Yi Xiao; Jing Wang; Yiru Wang; Siran Ding; Jiayang Huang; Jiayi Xu; Yilihamu Tayier; Zhenyu Hu; Yuan Gao; Chengfeng Zheng; Yueshu Ye; Yihang Li; Lei Wan; Xinyue Jiang; Yujie Wang; Siyu Cheng; Zhule Song; Xiangru Tang; Xiaohua Xu; Ningyu Zhang; Huajun Chen; Yuchen Eleanor Jiang;, Wangchunshu Zhou2024 · 31 citations
- Language Models as Science TutorsarXiv:2402.11111Alexis Chevalier, Jiayi Geng, Alexander Wettig, et al.2024 · 30 citations
- Towards Effective and Efficient Continual Pre-training of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Chen, Zhipeng Chen, Jiapeng Wang, et al.2025 · 29 citations
- Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
- Sailor: Open Language Models for South-East AsiaarXiv:2404.03608Longxu Dou, Qian Liu, Guangtao Zeng, et al.2024 · 27 citations
- Distillation Scaling LawsarXiv:2502.08606Dan Busbridge, Amitis Shidani, Floris Weers, et al.2025 · 26 citations
- TeleChat Technical ReportarXiv:2401.03804Zhongjiang He, Zihan Wang, Xinzhang Liu, et al.2024 · 24 citations
- RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
- MiniCPM4: Ultra-Efficient LLMs on End DevicesarXiv:2506.07900MiniCPM Team, Chaojun Xiao, Yuxuan Li, et al.2025 · 22 citations
- GSM-Infinite: How Do Your LLMs Behave over Infinitely Increasing Context Length and Reasoning Complexity?arXiv:2502.05252Yang Zhou, Hongyi Liu, Zhuoming Chen, et al.2025 · 21 citations
- LongReward: Improving Long-context Large Language Models with AI FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL)Jiajie Zhang, Zhongni Hou, Xin Lv, et al.2025 · 21 citations
- Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from JailbreakingConference on Empirical Methods in Natural Language Processing (EMNLP)Junda Zhu, Lingyong Yan, Shuaiqiang Wang, et al.2025 · 21 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/daniel-y-fu/cited-by/page/2/