Who cites Tri Dao
- LLaMA: Open and Efficient Foundation Language ModelsarXiv:2302.13971Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 9,603 citations
- Judging LLM-as-a-Judge with MT-Bench and Chatbot ArenaConference on Neural Information Processing Systems (NeurIPS)Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, et al.2023 · 4,573 citations
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information SystemsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,231 citations
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- Lost in the Middle: How Language Models Use Long ContextsTransactions of the Association for Computational Linguistics (TACL)Nelson F. Liu, Kevin Lin, John Hewitt, et al.2023 · 2,584 citations
- Reflexion: Language Agents with Verbal Reinforcement LearningConference on Neural Information Processing Systems (NeurIPS)Noah Shinn, Federico Cassano, Edward Berman, et al.2023 · 2,271 citations
- Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
- DINOv2: Learning Robust Visual Features without SupervisionarXiv:2304.07193Maxime Oquab, Timothee Darcet, Theo Moutakanni, et al.2023 · 1,513 citations
- Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,430 citations
- A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
- FlashAttention-2: Faster Attention with Better Parallelism and Work PartitioningarXiv:2307.08691Tri Dao2023 · 1,240 citations
- Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhonearXiv:2404.14219Marah Abdin, Jyoti Aneja, Hany Awadalla, et al.2024 · 1,134 citations
- LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yaowei Zheng, Richong Zhang, Junhao Zhang, et al.2024 · 1,048 citations
- GQA: Training Generalized Multi-Query Transformer Models from Multi-Head CheckpointsConference on Empirical Methods in Natural Language Processing (EMNLP)Joshua Ainslie, James Lee-Thorp, Michiel de Jong, et al.2023 · 1,026 citations
- A Survey on In-context LearningarXiv:2301.00234Qingxiu Dong, Lei Li, Damai Dai, et al.2023 · 978 citations
- C-Pack: Packed Resources For General Chinese EmbeddingsInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Shitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 922 citations
- Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any ResolutionarXiv:2409.12191Peng Wang, Shuai Bai, Sinan Tan, et al.2024 · 860 citations
- SGLang: Efficient Execution of Structured Language Model ProgramsConference on Neural Information Processing Systems (NeurIPS)Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, et al.2023 · 729 citations
- SWE-bench: Can Language Models Resolve Real-World GitHub Issues?arXiv:2310.06770Carlos E. Jimenez, John Yang, Alexander Wettig, et al.2024 · 704 citations
- Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
- ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All ToolsarXiv:2406.12793Team GLM, Aohan Zeng, Bin Xu, et al.2024 · 691 citations
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-ReflectionarXiv:2310.11511Akari Asai, Zeqiu Wu, Yizhong Wang, et al.2023 · 677 citations
- LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for CodearXiv:2403.07974Naman Jain, King Han, Alex Gu, et al.2024 · 578 citations
- gpt-oss-120b & gpt-oss-20b Model CardarXiv:2508.10925OpenAI: Sandhini Agarwal, Lama Ahmad, Jason Ai, et al.2025 · 576 citations
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsarXiv:2309.12284Longhui Yu, Weisen Jiang, Han Shi, et al.2023 · 565 citations
- Qwen2.5-Coder Technical ReportarXiv:2409.12186Binyuan Hui, Jian Yang, Zeyu Cui, et al.2024 · 559 citations
- Gorilla: Large Language Model Connected with Massive APIsConference on Neural Information Processing Systems (NeurIPS)Shishir G. Patil, Tianjun Zhang, Xin Wang, et al.2023 · 546 citations
- Instruction Tuning for Large Language Models: A SurveyACM Computing SurveysShengyu Zhang, Linfeng Dong, Xiaoya Li, et al.2023 · 520 citations
- Baichuan 2: Open Large-scale Language ModelsarXiv:2309.10305Aiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 517 citations
- MVBench: A Comprehensive Multi-modal Video Understanding BenchmarkIEEE Computer Society Conference on Computer Vision and Pattern RecognitionKunchang Li, Yali Wang, Yinan He, et al.2023 · 463 citations
- The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
- InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksarXiv:2312.14238Zhe Chen, Jiannan Wu, Wenhai Wang, et al.2023 · 435 citations
- Kimi k1.5: Scaling Reinforcement Learning with LLMsarXiv:2501.12599Kimi Team, Angang Du, Bofei Gao, et al.2025 · 431 citations
- BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsFindings of the Association for Computational LinguisticsYanis Labrak, Adrien Bazoge, Emmanuel Morin, et al.2024 · 409 citations
- Yi: Open Foundation Models by 01.AIarXiv:2403.04652Alex Young, Bei Chen, Chao Li, et al.2024 · 408 citations
- FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
- RULER: What's the Real Context Size of Your Long-Context Language Models?arXiv:2404.06654Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 400 citations
- LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language ModelsarXiv:2308.11462Neel Guha; Julian Nyarko; Daniel E. Ho; Christopher Re; Adam Chilton; Aditya Narayana; Alex Chohlas-Wood; Austin Peters; Brandon Waldon; Daniel N. Rockmore; Diego Zambrano; Dmitry Talisman; Enam Hoque; Faiz Surani; Frank Fagan; Galit Sarfaty; Gregory M. Dickinson; Haggai Porat; Jason Hegland; Jessica Wu; Joe Nudell; Joel Niklaus; John Nay; Jonathan H. Choi; Kevin Tobia; Margaret Hagan; Megan Ma; Michael Livermore; Nikon Rasumov-Rahe; Nils Holzenberger; Noam Kolt; Peter Henderson; Sean Rehaag; Sharad Goel; Shang Gao; Spencer Williams; Sunny Gandhi; Tom Zur; Varun Iyer;, Zehua Li2023 · 389 citations
- WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-InstructarXiv:2308.09583Haipeng Luo, Qingfeng Sun, Can Xu, et al.2023 · 372 citations
- A Survey on Large Language Models for Code GenerationarXiv:2406.00515Juyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 367 citations
- Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferencearXiv:2412.13663Benjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 358 citations
- SnapKV: LLM Knows What You are Looking for Before GenerationConference on Neural Information Processing Systems (NeurIPS)Yuhong Li, Yingbing Huang, Bowen Yang, et al.2024 · 355 citations
- TinyLlama: An Open-Source Small Language ModelarXiv:2401.02385Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 352 citations
- Textbooks Are All You Need II: phi-1.5 technical reportarXiv:2309.05463Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, et al.2023 · 336 citations
- MEDITRON-70B: Scaling Medical Pretraining for Large Language ModelsarXiv:2311.16079Zeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.2023 · 315 citations
- InternLM2 Technical ReportarXiv:2403.17297Zheng Cai, Maosong Cao, Haojiong Chen, et al.2024 · 301 citations
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- A Review of Large Language Models and Autonomous Agents in ChemistryarXiv:2407.01603Mayk Caldas Ramos, Christopher J. Collison, Andrew D. White2024 · 288 citations
- Llemma: An Open Language Model For MathematicsarXiv:2310.10631Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 286 citations
- An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language ModelsLecture notes in computer scienceLiang Chen, Haozhe Zhao, Tianyu Liu, et al.2024 · 279 citations
- MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training StrategiesarXiv:2404.06395Shengding Hu, Yuge Tu, Xu Han, et al.2024 · 269 citations
- LongLoRA: Efficient Fine-tuning of Long-Context Large Language ModelsarXiv:2309.12307Yukang Chen, Shengju Qian, Haotian Tang, et al.2023 · 268 citations
- Retentive Network: A Successor to Transformer for Large Language ModelsarXiv:2307.08621Yutao Sun, Li Dong, Shaohan Huang, et al.2023 · 265 citations
- RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
- Fine-Tuning LLaMA for Multi-Stage Text RetrievalInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Xueguang Ma, Liang Wang, Nan Yang, et al.2023 · 257 citations
- QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMsConference on Neural Information Processing Systems (NeurIPS)Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, et al.2024 · 254 citations
- Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelarXiv:2402.07827Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 253 citations
- InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingLecture notes in computer scienceYi Wang, Kunchang Li, Xinhao Li, et al.2024 · 253 citations
- LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kaiyu Yang, Aidan M. Swope, Alex Gu, et al.2023 · 253 citations
- Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts ArchitecturearXiv:2306.16092Jiaxi Cui; Munan Ning; Zongjian Li; Bohua Chen; Yang Yan; Hao Li; Bin Ling; Yonghong Tian;, Li Yuan2023 · 248 citations
- Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyarXiv:2403.14608Zeyu Han, Chao Gao, Jinyang Liu, et al.2024 · 240 citations
- mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Xin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 237 citations
- ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem SolvingarXiv:2309.17452Zhibin Gou, Zhihong Shao, Yeyun Gong, et al.2023 · 225 citations
- Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentarXiv:2308.05374Yang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 223 citations
- OpenHands: An Open Platform for AI Software Developers as Generalist AgentsarXiv:2407.16741Xingyao Wang, Boxuan Li, Yufan Song, et al.2024 · 221 citations
- Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
- Ring Attention with Blockwise Transformers for Near-Infinite ContextarXiv:2310.01889Hao Liu, Matei Zaharia, Pieter Abbeel2023 · 212 citations
- LIMO: Less is More for ReasoningarXiv:2502.03387Yixin Ye, Zhen Huang, Yang Xiao, et al.2025 · 209 citations
- EAGLE: Speculative Sampling Requires Rethinking Feature UncertaintyarXiv:2401.15077Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 208 citations
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferencearXiv:2406.10774Jiaming Tang, Yilong Zhao, Kan Zhu, et al.2024 · 203 citations
- AlphaEvolve: A coding agent for scientific and algorithmic discoveryarXiv:2506.13131Alexander Novikov, Ngân Vũ, Marvin Eisenberger, et al.2025 · 202 citations
- MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
- Model Tells You What to Discard: Adaptive KV Cache Compression for LLMsarXiv:2310.01801Suyu Ge, Yunan Zhang, Liyuan Liu, et al.2023 · 202 citations
- OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
- DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code IntelligencearXiv:2406.11931DeepSeek-AI, Qihao Zhu, Daya Guo, et al.2024 · 196 citations
- OmniQuant: Omnidirectionally Calibrated Quantization for Large Language ModelsarXiv:2308.13137Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.2023 · 195 citations
- LLM in a flash: Efficient Large Language Model Inference with Limited MemoryAnnual Meeting of the Association for Computational Linguistics (ACL)Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.2024 · 193 citations
- RAPTOR: Recursive Abstractive Processing for Tree-Organized RetrievalarXiv:2401.18059Parth Sarthi, Salman Abdullah, Aditi Tuli, et al.2024 · 193 citations
- DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
- CogVideoX: Text-to-Video Diffusion Models with An Expert TransformerarXiv:2408.06072Zhuoyi Yang, Jiayan Teng, Wendi Zheng, et al.2024 · 184 citations
- Effective Long-Context Scaling of Foundation ModelsarXiv:2309.16039Wenhan Xiong, Jingyu Liu, Igor Molybog, et al.2023 · 184 citations
- Adapting Language Models to Compress ContextsConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 182 citations
- SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
- InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and EfficiencyarXiv:2508.18265Weiyun Wang, Zhangwei Gao, Lixin Gu, et al.2025 · 179 citations
- KernelBench: Can LLMs Write Efficient GPU Kernels?arXiv:2502.10517Anne Ouyang, Simon Guo, Simran Arora, et al.2025 · 178 citations
- What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction TuningarXiv:2312.15685Wei Liu, Weihao Zeng, Keqing He, et al.2023 · 178 citations
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex InstructionsarXiv:2406.15877Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, et al.2024 · 176 citations
- Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
- LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic ProversConference on Empirical Methods in Natural Language Processing (EMNLP)Theo X. Olausson, Alex Gu, Benjamin Lipkin, et al.2023 · 172 citations
- Scaling Synthetic Data Creation with 1,000,000,000 PersonasarXiv:2406.20094Tao Ge, Xin Chan, Xiaoyang Wang, et al.2024 · 171 citations
- The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive RemediationsConference on Empirical Methods in Natural Language Processing (EMNLP)Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, et al.2023 · 171 citations
- ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectarXiv:2403.03853Xin Men, Mingyu Xu, Qingyu Zhang, et al.2024 · 170 citations
- LooGLE: Can Long-Context Language Models Understand Long Contexts?Annual Meeting of the Association for Computational Linguistics (ACL)Jiaqi Li, Mengmeng Wang, Zilong Zheng, et al.2023 · 165 citations
- Improving Medical Reasoning through Retrieval and Self-Reflection with Retrieval-Augmented Large Language ModelsBioinformaticsMinbyul Jeong, Jiwoong Sohn, Mujeen Sung, et al.2024 · 164 citations
- DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer ModelsarXiv:2309.14509Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.2023 · 162 citations
- From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction TuningarXiv:2308.12032Ming Li, Yong Zhang, Zhitao Li, et al.2023 · 161 citations
- L-Eval: Instituting Standardized Evaluation for Long Context Language ModelsarXiv:2307.11088Chenxin An, Shansan Gong, Ming Zhong, et al.2023 · 161 citations
- Jamba: A Hybrid Transformer-Mamba Language ModelarXiv:2403.19887Opher Lieber, Barak Lenz, Hofit Bata, et al.2024 · 159 citations
- TheoremQA: A Theorem-driven Question Answering DatasetConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Ming Yin, Max Ku, et al.2023 · 158 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tri-dao/cited-by/