Elamur Research⌕
☰
home / authors / Tri Dao / cited by / page 2

Who cites Tri Dao

5,065 citations of their works from 3,531 papers of our library (of the 149,439 whose bibliographies we read) · 462 with a page here, the most cited first · page 2 of 5 · 101–200 · ← Tri Dao

1 2 3 4 5

  1. Moshi: a speech-text foundation model for real-time dialoguearXiv:2410.00037Alexandre Defossez, Laurent Mazare, Manu Orsini, et al.2024 · 157 citations
  2. Simple and Effective Masked Diffusion Language ModelsConference on Neural Information Processing Systems (NeurIPS)Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.2024 · 152 citations
  3. The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context LearningarXiv:2312.01552Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu, et al.2023 · 150 citations
  4. LongRoPE: Extending LLM Context Window Beyond 2 Million TokensarXiv:2402.13753Yiran Ding, Li Lyna Zhang, Chengruidong Zhang, et al.2024 · 142 citations
  5. Long-context LLMs Struggle with Long In-context LearningarXiv:2404.02060Tianle Li, Ge Zhang, Quy Duc Do, et al.2024 · 138 citations
  6. EuroLLM: Multilingual Language Models for EuropearXiv:2409.16235Pedro Henrique Martins, Patrick Fernandes, Joao Alves, et al.2024 · 133 citations
  7. Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
  8. Retrieval meets Long Context Large Language ModelsarXiv:2310.03025Peng Xu, Wei Ping, Xianchao Wu, et al.2023 · 130 citations
  9. Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
  10. Nomic Embed: Training a Reproducible Long Context Text EmbedderarXiv:2402.01613Zach Nussbaum, John X. Morris, Brandon Duderstadt, et al.2024 · 126 citations
  11. Generative Judge for Evaluating AlignmentarXiv:2310.05470Junlong Li, Shichao Sun, Weizhe Yuan, et al.2023 · 125 citations
  12. CRUXEval: A Benchmark for Code Reasoning, Understanding and ExecutionarXiv:2401.03065Alex Gu, Baptiste Rozière, Hugh Leather, et al.2024 · 122 citations
  13. Demystifying Long Chain-of-Thought Reasoning in LLMsarXiv:2502.03373Edward Yeo, Yuxuan Tong, Morry Niu, et al.2025 · 119 citations
  14. QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice CodebooksarXiv:2402.04396Albert Tseng, Jerry Chee, Qingyao Sun, et al.2024 · 117 citations
  15. Break the Sequential Dependency of LLM Inference Using Lookahead DecodingarXiv:2402.02057Yichao Fu, Peter Bailis, Ion Stoica, et al.2024 · 114 citations
  16. Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language CapabilitiesarXiv:2404.17790Kazuki Fujii, Taishi Nakamura, Mengsay Loem, et al.2024 · 114 citations
  17. DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming HeadsarXiv:2410.10819Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.2024 · 114 citations
  18. ALLaM: Large Language Models for Arabic and EnglisharXiv:2407.15390M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
  19. Data Engineering for Scaling Language Models to 128K ContextarXiv:2402.10171Yao Fu, Rameswar Panda, Xinyao Niu, et al.2024 · 109 citations
  20. MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 103 citations
  21. Rethinking Benchmark and Contamination for Language Models with Rephrased SamplesarXiv:2311.04850Shuo Yang, Wei-Lin Chiang, Lianmin Zheng, et al.2023 · 103 citations
  22. Qwen2.5-1M Technical ReportarXiv:2501.15383An Yang, Bowen Yu, Chengyuan Li, et al.2025 · 102 citations
  23. FireAct: Toward Language Agent Fine-tuningarXiv:2310.05915Baian Chen, Chang Shu, Ehsan Shareghi, et al.2023 · 101 citations
  24. FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
  25. MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731Ke Wang, Houxing Ren, Aojun Zhou, et al.2023 · 99 citations
  26. LongAlign: A Recipe for Long Context Alignment of Large Language ModelsarXiv:2401.18058Yushi Bai, Xin Lv, Jiajie Zhang, et al.2024 · 98 citations
  27. A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
  28. Retrieval Head Mechanistically Explains Long-Context FactualityarXiv:2404.15574Wenhao Wu, Yizhong Wang, Guangxuan Xiao, et al.2024 · 94 citations
  29. On the Tool Manipulation Capability of Open-source Large Language ModelsarXiv:2305.16504Qiantong Xu, Fenglu Hong, Bo Li, et al.2023 · 92 citations
  30. Skywork: A More Open Bilingual Foundation ModelarXiv:2310.19341Tianwen Wei, Liang Zhao, Lichang Zhang, et al.2023 · 91 citations
  31. Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
  32. Do Membership Inference Attacks Work on Large Language Models?arXiv:2402.07841Michael Duan, Anshuman Suri, Niloofar Mireshghallah, et al.2024 · 87 citations
  33. Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
  34. LLM Maybe LongLM: Self-Extend LLM Context Window Without TuningarXiv:2401.01325Hongye Jin, Xiaotian Han, Jingfeng Yang, et al.2024 · 81 citations
  35. BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical TextarXiv:2403.18421Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, et al.2024 · 79 citations
  36. BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive RetrievalarXiv:2407.12883Hongjin Su, Howard Yen, Mengzhou Xia, et al.2024 · 77 citations
  37. Small Language Models Learn Enhanced Reasoning Skills from Medical TextbooksarXiv:2404.00376Hyunjae Kim, Hyeon Hwang, Jiwoo Lee, et al.2024 · 75 citations
  38. ReLoRA: High-Rank Training Through Low-Rank UpdatesarXiv:2307.05695Vladislav Lialin, Namrata Shivagunde, Sherin Muckatira, et al.2023 · 74 citations
  39. Seed-TTS: A Family of High-Quality Versatile Speech Generation ModelsarXiv:2406.02430Philip Anastassiou, Jiawei Chen, Jitong Chen, et al.2024 · 71 citations
  40. The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
  41. Kimi-VL Technical ReportarXiv:2504.07491Kimi Team, Angang Du, Bohong Yin, et al.2025 · 70 citations
  42. MagicPIG: LSH Sampling for Efficient LLM GenerationarXiv:2410.16179Zhuoming Chen, Ranajoy Sadhukhan, Zihao Ye, et al.2024 · 68 citations
  43. MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
  44. LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMsarXiv:2408.07055Yushi Bai, Jiajie Zhang, Xin Lv, et al.2024 · 66 citations
  45. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
  46. OpenMoE: An Early Effort on Open Mixture-of-Experts Language ModelsarXiv:2402.01739Fuzhao Xue, Zian Zheng, Yao Fu, et al.2024 · 64 citations
  47. In-context Pretraining: Language Modeling Beyond Document BoundariesarXiv:2310.10638Weijia Shi, Sewon Min, Maria Lomeli, et al.2023 · 61 citations
  48. Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
  49. Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-TuningarXiv:2402.00530Ming Li, Yong Zhang, Shwai He, et al.2024 · 60 citations
  50. XAttention: Block Sparse Attention with Antidiagonal ScoringarXiv:2503.16428Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.2025 · 59 citations
  51. Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
  52. Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
  53. LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuningarXiv:2308.03303Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.2023 · 58 citations
  54. A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
  55. Zoology: Measuring and Improving Recall in Efficient Language ModelsarXiv:2312.04927Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou; Atri Rudra;, Christopher Re2023 · 55 citations
  56. Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
  57. PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise TrainingarXiv:2309.10400Dawei Zhu, Nan Yang, Liang Wang, et al.2023 · 52 citations
  58. Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
  59. From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
  60. RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement LearningarXiv:2410.02089Jonas Gehring, Kunhao Zheng, Jade Copet, et al.2024 · 51 citations
  61. Self-Verification Improves Few-Shot Clinical Information ExtractionarXiv:2306.00024 · IMLH 2023Zelalem Gero, Chandan Singh, Hao Cheng, et al.2023 · 51 citations
  62. MiniMax-01: Scaling Foundation Models with Lightning AttentionarXiv:2501.08313MiniMax, Aonian Li, Bangwei Gong, et al.2025 · 50 citations
  63. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
  64. WebLINX: Real-World Website Navigation with Multi-Turn DialoguearXiv:2402.05930Xing Han Lu, Zden\vek Kasner, Siva Reddy2024 · 50 citations
  65. Long Context Compression with Activation BeaconarXiv:2401.03462Peitian Zhang, Zheng Liu, Shitao Xiao, et al.2024 · 47 citations
  66. Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
  67. Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesarXiv:2407.13623Chaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 46 citations
  68. Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations

1 2 3 4 5

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/tri-dao/cited-by/page/2/