Who cites Tri Dao
- Moshi: a speech-text foundation model for real-time dialoguearXiv:2410.00037Alexandre Defossez, Laurent Mazare, Manu Orsini, et al.2024 · 157 citations
- Simple and Effective Masked Diffusion Language ModelsConference on Neural Information Processing Systems (NeurIPS)Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.2024 · 152 citations
- CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding ChallengesAnnual Meeting of the Association for Computational Linguistics (ACL)Kechi Zhang, Jia Li, Ge Li, et al.2024 · 150 citations
- The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context LearningarXiv:2312.01552Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, et al.2023 · 150 citations
- Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Jun Zhang, Jue Wang, Huan Li, et al.2024 · 148 citations
- Unlocking Efficiency in Large Language Model Inference: A Comprehensive Survey of Speculative DecodingFindings of the Association for Computational LinguisticsHeming Xia, Zhe Yang, Qingxiu Dong, et al.2024 · 146 citations
- Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
- LongRoPE: Extending LLM Context Window Beyond 2 Million TokensarXiv:2402.13753Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, et al.2024 · 142 citations
- Long-context LLMs Struggle with Long In-context LearningarXiv:2404.02060Tianle Li, Ge Zhang, Quy Duc Do, et al.2024 · 138 citations
- EAGLE-2: Faster Inference of Language Models with Dynamic Draft TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Yuhui Li, Fangyun Wei, Chao Zhang, et al.2024 · 133 citations
- EuroLLM: Multilingual Language Models for EuropearXiv:2409.16235Pedro Henrique Martins, Patrick Fernandes, Joao Alves, et al.2024 · 133 citations
- Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
- Retrieval meets Long Context Large Language ModelsarXiv:2310.03025Peng Xu, Wei Ping, Xianchao Wu, et al.2023 · 130 citations
- Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
- InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context MemoryConference on Neural Information Processing Systems (NeurIPS)Chaojun Xiao, Pengle Zhang, Xu Han, et al.2024 · 126 citations
- Nomic Embed: Training a Reproducible Long Context Text EmbedderarXiv:2402.01613Zach Nussbaum, John X. Morris, Brandon Duderstadt, et al.2024 · 126 citations
- Generative Judge for Evaluating AlignmentarXiv:2310.05470Junlong Li, Shichao Sun, Weizhe Yuan, et al.2023 · 125 citations
- CRUXEval: A Benchmark for Code Reasoning, Understanding and ExecutionarXiv:2401.03065Alex Gu, Baptiste Rozière, Hugh Leather, et al.2024 · 122 citations
- AlphaMath Almost Zero: Process Supervision without ProcessConference on Neural Information Processing Systems (NeurIPS)Guoxin Chen, Minpeng Liao, Chengxi Li, et al.2024 · 120 citations
- Demystifying Long Chain-of-Thought Reasoning in LLMsarXiv:2502.03373Edward Yeo, Yuxuan Tong, Morry Niu, et al.2025 · 119 citations
- QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice CodebooksarXiv:2402.04396Albert Tseng, Jerry Chee, Qingyao Sun, et al.2024 · 117 citations
- Break the Sequential Dependency of LLM Inference Using Lookahead DecodingarXiv:2402.02057Yichao Fu, Peter Bailis, Ion Stoica, et al.2024 · 114 citations
- Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language CapabilitiesarXiv:2404.17790Kazuki Fujii, Taishi Nakamura, Mengsay Loem, et al.2024 · 114 citations
- DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
- ALLaM: Large Language Models for Arabic and EnglisharXiv:2407.15390M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
- Data Engineering for Scaling Language Models to 128K ContextarXiv:2402.10171Yao Fu, Rameswar Panda, Xinyao Niu, et al.2024 · 109 citations
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
- MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 103 citations
- Who Wrote this Code? Watermarking for Code GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Taehyun Lee, Seokhee Hong, Jaewoo Ahn, et al.2024 · 103 citations
- Rethinking Benchmark and Contamination for Language Models with Rephrased SamplesarXiv:2311.04850Shuo Yang, Wei-Lin Chiang, Lianmin Zheng, et al.2023 · 103 citations
- Qwen2.5-1M Technical ReportarXiv:2501.15383An Yang, Bowen Yu, Chengyuan Li, et al.2025 · 102 citations
- FireAct: Toward Language Agent Fine-tuningarXiv:2310.05915Baian Chen, Chang Shu, Ehsan Shareghi, et al.2023 · 101 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731Ke Wang, Houxing Ren, Aojun Zhou, et al.2023 · 99 citations
- LongAlign: A Recipe for Long Context Alignment of Large Language ModelsarXiv:2401.18058Yushi Bai, Xin Lv, Jiajie Zhang, et al.2024 · 98 citations
- MAmmoTH2: Scaling Instructions from the WebConference on Neural Information Processing Systems (NeurIPS)Xiang Yue, Tuney Zheng, Ge Zhang, et al.2024 · 96 citations
- A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
- InterCode: Standardizing and Benchmarking Interactive Coding with Execution FeedbackConference on Neural Information Processing Systems (NeurIPS)John Yang, Akshara Prabhakar, Karthik Narasimhan, et al.2023 · 95 citations
- Retrieval Head Mechanistically Explains Long-Context FactualityarXiv:2404.15574Wenhao Wu, Yizhong Wang, Guangxuan Xiao, et al.2024 · 94 citations
- On the Tool Manipulation Capability of Open-source Large Language ModelsarXiv:2305.16504Qiantong Xu, Fenglu Hong, Bo Li, et al.2023 · 92 citations
- PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM InferenceFindings of the Association for Computational LinguisticsDongjie Yang, Xiaodong Han, Yan Gao, et al.2024 · 91 citations
- Skywork: A More Open Bilingual Foundation ModelarXiv:2310.19341Tianwen Wei, Liang Zhao, Lichang Zhang, et al.2023 · 91 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
- Do Membership Inference Attacks Work on Large Language Models?arXiv:2402.07841Michael Duan, Anshuman Suri, Niloofar Mireshghallah, et al.2024 · 87 citations
- LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-TrainingConference on Empirical Methods in Natural Language Processing (EMNLP)Tong Zhu, Xiaoye Qu, Daize Dong, et al.2024 · 85 citations
- PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human PreferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Jiaming Ji, Donghai Hong, Borong Zhang, et al.2025 · 83 citations
- Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
- EfficientQAT: Efficient Quantization-Aware Training for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhao Chen, Wenqi Shao, Peng Xu, et al.2025 · 82 citations
- OpenCoder: The Open Cookbook for Top-Tier Code Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Siming Huang, Tianhao Cheng, Jason Klein Liu, et al.2025 · 81 citations
- LLM Maybe LongLM: Self-Extend LLM Context Window Without TuningarXiv:2401.01325Hongye Jin, Xiaotian Han, Jingfeng Yang, et al.2024 · 81 citations
- D4: Improving LLM Pretraining via Document De-Duplication and DiversificationConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Daniel Simig, Armen Aghajanyan, et al.2023 · 81 citations
- MoBA: Mixture of Block Attention for Long-Context LLMsConference on Neural Information Processing Systems (NeurIPS)Enzhe Lu, Zhejun Jiang, Jingyuan Liu, et al.2025 · 80 citations
- BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextarXiv:2403.18421Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, et al.2024 · 79 citations
- KG-Agent: An Efficient Autonomous Agent Framework for Complex Reasoning over Knowledge GraphAnnual Meeting of the Association for Computational Linguistics (ACL)Jinhao Jiang, Kun Zhou, Wayne Xin Zhao, et al.2025 · 78 citations
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive RetrievalarXiv:2407.12883Hongjin Su, Howard Yen, Mengzhou Xia, et al.2024 · 77 citations
- Small Language Models Learn Enhanced Reasoning Skills from Medical TextbooksarXiv:2404.00376Hyunjae Kim, Hyeon Hwang, Jiwoo Lee, et al.2024 · 75 citations
- Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI ArchitecturesProceedings - International Symposium on Computer Architecture/ProceedingsChenggang Zhao, Chengqi Deng, Chong Ruan, et al.2025 · 74 citations
- ReLoRA: High-Rank Training Through Low-Rank UpdatesarXiv:2307.05695Vladislav Lialin, Namrata Shivagunde, Sherin Muckatira, et al.2023 · 74 citations
- (Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary TextsTransactions of the Association for Computational Linguistics (TACL)Minghao Wu, Jiahao Xu, Yulin Yuan, et al.2025 · 71 citations
- Seed-TTS: A Family of High-Quality Versatile Speech Generation ModelsarXiv:2406.02430Philip Anastassiou, Jiawei Chen, Jitong Chen, et al.2024 · 71 citations
- The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
- Kimi-VL Technical ReportarXiv:2504.07491Kimi Team, Angang Du, Bohong Yin, et al.2025 · 70 citations
- Recent Advances in Speech Language Models: A SurveyAnnual Meeting of the Association for Computational Linguistics (ACL)Wenqian Cui, Dianzhi Yu, Xiaoqi Jiao, et al.2025 · 69 citations
- Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
- MagicPIG: LSH Sampling for Efficient LLM GenerationarXiv:2410.16179Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.2024 · 68 citations
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
- LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMsarXiv:2408.07055Yushi Bai, Jiajie Zhang, Xin Lv, et al.2024 · 66 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- OpenMoE: An Early Effort on Open Mixture-of-Experts Language ModelsarXiv:2402.01739Fuzhao Xue, Zian Zheng, Yao Fu, et al.2024 · 64 citations
- Multimodal Table UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Mingyu Zheng, Xinwei Feng, Qingyi Si, et al.2024 · 62 citations
- Unifying Multimodal Retrieval via Document Screenshot EmbeddingConference on Empirical Methods in Natural Language Processing (EMNLP)Xueguang Ma, Sheng-Chieh Lin, Minghan Li, et al.2024 · 61 citations
- In-context Pretraining: Language Modeling Beyond Document BoundariesarXiv:2310.10638Weijia Shi, Sewon Min, Maria Lomeli, et al.2023 · 61 citations
- Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
- Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-TuningarXiv:2402.00530Ming Li, Yong Zhang, Shwai He, et al.2024 · 60 citations
- XAttention: Block Sparse Attention with Antidiagonal ScoringarXiv:2503.16428Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.2025 · 59 citations
- BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsLanguage Resources and Evaluation Conference (LREC)Zican Dong, Tianyi Tang, Junyi Li, et al.2024 · 59 citations
- Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
- Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
- LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuningarXiv:2308.03303Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.2023 · 58 citations
- Unintended Impacts of LLM Alignment on Global RepresentationAnnual Meeting of the Association for Computational Linguistics (ACL)Michael J Ryan, William Held, Diyi Yang2024 · 57 citations
- A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
- Zoology: Measuring and Improving Recall in Efficient Language ModelsarXiv:2312.04927Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou; Atri Rudra;, Christopher Re2023 · 55 citations
- Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise TrainingarXiv:2309.10400Dawei Zhu, Nan Yang, Liang Wang, et al.2023 · 52 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- Sketch-of-Thought: Efficient LLM Reasoning with Adaptive Cognitive-Inspired SketchingConference on Empirical Methods in Natural Language Processing (EMNLP)Simon A. Aytes, Jinheon Baek, Sung Ju Hwang2025 · 51 citations
- From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
- RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement LearningarXiv:2410.02089Jonas Gehring, Kunhao Zheng, Jade Copet, et al.2024 · 51 citations
- XCodeEval: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Mohammad Abdullah Matin Khan, M Saiful Bari, Xuan Long Do, et al.2024 · 51 citations
- Self-Verification Improves Few-Shot Clinical Information ExtractionarXiv:2306.00024 · IMLH 2023Zelalem Gero, Chandan Singh, Hao Cheng, et al.2023 · 51 citations
- MiniMax-01: Scaling Foundation Models with Lightning AttentionarXiv:2501.08313MiniMax, Aonian Li, Bangwei Gong, et al.2025 · 50 citations
- Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
- WebLINX: Real-World Website Navigation with Multi-Turn DialoguearXiv:2402.05930Xing Han Lu, Zden\vek Kasner, Siva Reddy2024 · 50 citations
- The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce HarmConference on Empirical Methods in Natural Language Processing (EMNLP)Aakanksha, Arash Ahmadian, Beyza Ermis, et al.2024 · 49 citations
- Long Context Compression with Activation BeaconarXiv:2401.03462Peitian Zhang, Zheng Liu, Shitao Xiao, et al.2024 · 47 citations
- MixEval: Deriving Wisdom of the Crowd from LLM Benchmark MixturesConference on Neural Information Processing Systems (NeurIPS)Jinjie Ni, Fuzhao Xue, Xiang Yue, et al.2024 · 47 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
- Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tri-dao/cited-by/page/2/