Who cites Yu Lu
- Massive Activations in Large Language ModelsarXiv:2402.17762Mingjie Sun, Xinlei Chen, J. Zico Kolter, et al.2024 · 88 citations
- Landmark Attention: Random-Access Infinite Context Length for TransformersarXiv:2305.16300Amirkeivan Mohtashami, Martin Jaggi2023 · 88 citations
- Large Language Models as General Pattern MachinesarXiv:2307.04721Suvir Mirchandani, Fei Xia, Pete Florence, et al.2023 · 88 citations
- Liger Kernel: Efficient Triton Kernels for LLM TrainingarXiv:2410.10989Pin-Lun Hsu, Yun Dai, Vignesh Kothapalli, et al.2024 · 87 citations
- Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
- Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal ModelarXiv:2408.11039Chunting Zhou, Lili Yu, Arun Babu, et al.2024 · 83 citations
- LLM Maybe LongLM: Self-Extend LLM Context Window Without TuningarXiv:2401.01325Hongye Jin, Xiaotian Han, Jingfeng Yang, et al.2024 · 81 citations
- Thor: Wielding Hammers to Integrate Language Models and Automated Theorem ProversarXiv:2205.10893Albert Q. Jiang, Wenda Li, Szymon Tworkowski, et al.2022 · 79 citations
- QuRating: Selecting High-Quality Data for Training Language ModelsarXiv:2402.09739Alexander Wettig, Aatmik Gupta, Saumya Malik, et al.2024 · 74 citations
- SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference AccelerationInternational Conference on Learning Representations (ICLR)Jintao Zhang, Jia Wei, Haofeng Huang, et al.2024 · 74 citations
- ReLoRA: High-Rank Training Through Low-Rank UpdatesarXiv:2307.05695Vladislav Lialin, Namrata Shivagunde, Sherin Muckatira, et al.2023 · 74 citations
- Long Context Transfer from Language to VisionarXiv:2406.16852Peiyuan Zhang, Kaichen Zhang, Bo Li, et al.2024 · 73 citations
- What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
- HelpSteer: Multi-attribute Helpfulness Dataset for SteerLMConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zhilin Wang, Yi Dong, Jiaqi Zeng, et al.2024 · 72 citations
- Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QAConference on Empirical Methods in Natural Language Processing (EMNLP)Minzheng Wang, Longze Chen, Fu Cheng, et al.2024 · 72 citations
- Physics of Language Models: Part 3.2, Knowledge ManipulationarXiv:2309.14402Zeyuan Allen-Zhu, Yuanzhi Li2023 · 72 citations
- Kimi-VL Technical ReportarXiv:2504.07491Kimi Team, Angang Du, Bohong Yin, et al.2025 · 70 citations
- Summary of a Haystack: A Challenge to Long-Context LLMs and RAG SystemsConference on Empirical Methods in Natural Language Processing (EMNLP)Philippe Laban, Alexander Fabbri, Caiming Xiong, et al.2024 · 69 citations
- Apertus: Democratizing Open and Compliant LLMs for Global Language EnvironmentsAnnual Meeting of the Association for Computational Linguistics (ACL)Alejandro Hernández-Cano, Alexander Hägele, Allen Hao Huang, et al.2026 · 68 citations
- Seed1.5-VL Technical ReportarXiv:2505.07062Dong Guo, Faming Wu, Feida Zhu, et al.2025 · 67 citations
- An Empirical Study of Mamba-based Language ModelsarXiv:2406.07887Roger Waleffe, Wonmin Byeon, Duncan Riach, et al.2024 · 67 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Phi-4-reasoning Technical ReportarXiv:2504.21318Marah Abdin, Sahaj Agarwal, Ahmed Awadallah, et al.2025 · 64 citations
- OpenMoE: An Early Effort on Open Mixture-of-Experts Language ModelsarXiv:2402.01739Fuzhao Xue, Zian Zheng, Yao Fu, et al.2024 · 64 citations
- Natural Language to Code Generation in Interactive Data Science NotebooksAnnual Meeting of the Association for Computational Linguistics (ACL)Pengcheng Yin, Wen-Ding Li, Kefan Xiao, et al.2023 · 63 citations
- MiMo-V2-Flash Technical ReportarXiv:2601.02780Xiaomi LLM-Core Team; Bangjun Xiao; Bingquan Xia; Bo Yang; Bofei Gao; Bowen Shen; Chen Zhang; Chenhong He; Chiheng Lou; Fuli Luo; Gang Wang; Gang Xie; Hailin Zhang; Hanglong Lv; Hanyu Li; Heyu Chen; Hongshen Xu; Houbin Zhang; Huaqiu Liu; Jiangshan Duo; Jianyu Wei; Jiebao Xiao; Jinhao Dong; Jun Shi; Junhao Hu; Kainan Bao; Kang Zhou; Lei Li; Liang Zhao; Linghao Zhang; Peidian Li; Qianli Chen; Shaohui Liu; Shihua Yu; Shijie Cao; Shimao Chen; Shouqiu Yu; Shuo Liu; Tianling Zhou; Weijiang Su; Weikun Wang; Wenhan Ma; Xiangwei Deng; Bohan Mao; Bowen Ye; Can Cai; Chenghua Wang; Chengxuan Zhu; Chong Ma; Chun Chen; Chunan Li; Dawei Zhu; Deshan Xiao; Dong Zhang; Duo Zhang; Fangyue Liu; Feiyu Yang; Fengyuan Shi; Guoan Wang; Hao Tian; Hao Wu; Heng Qu; Hongfei Yi; Hongxu An; Hongyi Guan; Xing Zhang; Yifan Song; Yihan Yan; Yihao Zhao; Yingchun Lai; Yizhao Gao; Yu Cheng; Yuanyuan Tian; Yudong Wang; Zhen Tang; Zhengju Tang; Zhengtao Wen; Zhichao Song; Zhixian Zheng; Zihan Jiang; Jian Wen; Jiarui Sun; Jiawei Li; Jinlong Xue; Jun Xia; Kai Fang; Menghang Zhu; Nuo Chen; Qian Tu; Qihao Zhang; Qiying Wang; Rang Li; Rui Ma; Shaolei Zhang; Shengfan Wang; Shicheng Li; Shuhao Gu; Shuhuai Ren; Sirui Deng; Tao Guo; Tianyang Lu; Weiji Zhuang; Weikang Zhang; Weimin Xiong; Wenshan Huang; Wenyu Yang; Xin Zhang; Xing Yong; Xu Wang; Xueyang Xie; Yilin Jiang; Yixin Yang; Yongzhe He; Yu Tu; Yuanliang Dong; Yuchen Liu; Yue Ma; Yue Yu; Yuxing Xiang; Zhaojun Huang; Zhenru Lin; Zhipeng Xu; Zhiyang Chen; Zhonghua Deng; Zihan Zhang;, Zihao Yue2026 · 60 citations
- Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language ModelsarXiv:2402.02244Xindi Wang, Mahsa Salmani, Parsa Omidi, et al.2024 · 60 citations
- mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
- BAMBOO: A Comprehensive Benchmark for Evaluating Long Text Modeling Capacities of Large Language ModelsLanguage Resources and Evaluation Conference (LREC)Zican Dong, Tianyi Tang, Junyi Li, et al.2024 · 59 citations
- Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
- Simple linear attention language models balance the recall-throughput tradeoffarXiv:2402.18668Simran Arora, Sabri Eyuboglu, Michael Zhang, et al.2024 · 59 citations
- Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning ProcessarXiv:2407.20311Tian Ye, Zicheng Xu, Yuanzhi Li, et al.2024 · 58 citations
- Scaling Laws of RoPE-based ExtrapolationarXiv:2310.05209Xiaoran Liu, Hang Yan, Shuo Zhang, et al.2023 · 54 citations
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise TrainingarXiv:2309.10400Dawei Zhu, Nan Yang, Liang Wang, et al.2023 · 52 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- MiniMax-01: Scaling Foundation Models with Lightning AttentionarXiv:2501.08313MiniMax, Aonian Li, Bangwei Gong, et al.2025 · 50 citations
- LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Fengqi Zhu, Rongzhen Wang, Shen Nie, et al.2026 · 49 citations
- Long Context Compression with Activation BeaconarXiv:2401.03462Peitian Zhang, Zheng Liu, Shitao Xiao, et al.2024 · 47 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations
- AlGhafa Evaluation Benchmark for Arabic Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Ebtesam Almazrouei, Ruxandra Cojocaru, Michele Baldo, et al.2023 · 46 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- Long-Context Language Modeling with Parallel Context EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Howard Yen, Tianyu Gao, Danqi Chen2024 · 44 citations
- Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language ModelsarXiv:2404.12387Reka Team: Aitor Ormazabal, Che Zheng, Cyprien de Masson d'Autume, et al.2024 · 42 citations
- Paloma: A Benchmark for Evaluating Language Model FitConference on Neural Information Processing Systems (NeurIPS)Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.2023 · 42 citations
- DeepSeek: Paradigm Shifts and Technical Evolution in Large AI ModelsarXiv:2507.09955Luolin Xiong, Haofen Wang, Xi Chen, et al.2025 · 41 citations
- LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256KarXiv:2402.05136Tao Yuan, Xuefei Ning, Dong Zhou, et al.2024 · 41 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- LongEmbed: Extending Embedding Models for Long Context RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Dawei Zhu, Liang Wang, Nan Yang, et al.2024 · 37 citations
- Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language ModelsarXiv:2407.07263Jupinder Parmar, Sanjev Satheesh, Mostofa Patwary, et al.2024 · 36 citations
- MinerU2.5: A Decoupled Vision-Language Model for Efficient High-Resolution Document ParsingAnnual Meeting of the Association for Computational Linguistics (ACL)Junbo Niu, Zheng Liu, Zhuangcheng Gu, et al.2026 · 35 citations
- ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world ScenariosInternational Conference on Computational Linguistics (COLING)Junjie Ye, Guanyu Li, SongYang Gao, et al.2025 · 35 citations
- Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese UnderstandingarXiv:2405.08748Zhimin Li, Jianwei Zhang, Qin Lin, et al.2024 · 35 citations
- MambaByte: Token-free Selective State Space ModelarXiv:2401.13660Junxiong Wang, Tushaar Gangavarapu, Jing Nathan Yan, et al.2024 · 35 citations
- Efficient Online Data Mixing For Language Model Pre-TrainingarXiv:2312.02406Alon Albalak, Liangming Pan, Colin Raffel, et al.2023 · 35 citations
- EuroBERT: Scaling Multilingual Encoders for European LanguagesarXiv:2503.05500Nicolas Boizard, Hippolyte Gisserot-Boukhlef, Duarte M. Alves, et al.2025 · 34 citations
- TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked TextConference on Empirical Methods in Natural Language Processing (EMNLP)Songshuo Lu, Hua Wang, Yutian Rong, et al.2025 · 32 citations
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language ModelsarXiv:2401.04658Zhen Qin, Weigao Sun, Dong Li, et al.2024 · 31 citations
- Scaling Laws and Compute-Optimal Training Beyond Fixed Training DurationsConference on Neural Information Processing Systems (NeurIPS)Alexander Hägele, Elie Bakouch, Atli Kosson, et al.2024 · 31 citations
- Weaver: Foundation Models for Creative WritingarXiv:2401.17268Tiannan Wang; Jiamin Chen; Qingrui Jia; Shuai Wang; Ruoyu Fang; Huilin Wang; Zhaowei Gao; Chunzhao Xie; Chuou Xu; Jihong Dai; Yibin Liu; Jialong Wu; Shengwei Ding; Long Li; Zhiwei Huang; Xinle Deng; Teng Yu; Gangan Ma; Han Xiao; Zixin Chen; Danjun Xiang; Yunxia Wang; Yuanyuan Zhu; Yi Xiao; Jing Wang; Yiru Wang; Siran Ding; Jiayang Huang; Jiayi Xu; Yilihamu Tayier; Zhenyu Hu; Yuan Gao; Chengfeng Zheng; Yueshu Ye; Yihang Li; Lei Wan; Xinyue Jiang; Yujie Wang; Siyu Cheng; Zhule Song; Xiangru Tang; Xiaohua Xu; Ningyu Zhang; Huajun Chen; Yuchen Eleanor Jiang;, Wangchunshu Zhou2024 · 31 citations
- Language Models as Science TutorsarXiv:2402.11111Alexis Chevalier, Jiayi Geng, Alexander Wettig, et al.2024 · 30 citations
- Nemotron-4 15B Technical ReportarXiv:2402.16819Jupinder Parmar, Shrimai Prabhumoye, Joseph Jennings, et al.2024 · 30 citations
- ProxyQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Haochen Tan, Zhijiang Guo, Zhan Shi, et al.2024 · 30 citations
- InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language ModelsarXiv:2503.06692Yuchen Yan, Yongliang Shen, Yang Liu, et al.2025 · 29 citations
- NovelQA: Benchmarking Question Answering on Documents Exceeding 200K TokensarXiv:2403.12766Cunxiang Wang, Ruoxi Ning, Boqi Pan, et al.2024 · 29 citations
- JetMoE: Reaching Llama2 Performance with 0.1M DollarsarXiv:2404.07413Yikang Shen, Zhen Guo, Tianle Cai, et al.2024 · 28 citations
- Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Qianchi Zhang, Hainan Zhang, Liang Pang, et al.2026 · 27 citations
- Sailor: Open Language Models for South-East AsiaarXiv:2404.03608Longxu Dou, Qian Liu, Guangtao Zeng, et al.2024 · 27 citations
- Distillation Scaling LawsarXiv:2502.08606Dan Busbridge, Amitis Shidani, Floris Weers, et al.2025 · 26 citations
- Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by TencentarXiv:2411.02265Xingwu Sun, Yanfeng Chen, Yiqing Huang, et al.2024 · 25 citations
- Baichuan-M1: Pushing the Medical Capability of Large Language ModelsarXiv:2502.12671Bingning Wang, Haizhou Zhao, Huozhi Zhou, et al.2025 · 24 citations
- MiMo-Audio: Audio Language Models are Few-Shot LearnersarXiv:2512.23808Xiaomi LLM-Core Team, Dong Zhang, Gang Wang, et al.2025 · 24 citations
- Personalized Generation In Large Model Era: A SurveyAnnual Meeting of the Association for Computational Linguistics (ACL)Yiyan Xu, Jinghao Zhang, Alireza Salemi, et al.2025 · 24 citations
- TeleChat Technical ReportarXiv:2401.03804Zhongjiang He, Zihan Wang, Xinzhang Liu, et al.2024 · 24 citations
- Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language ModelarXiv:2404.04167Xinrun Du; Zhouliang Yu; Songyang Gao; Ding Pan; Yuyang Cheng; Ziyang Ma; Ruibin Yuan; Xingwei Qu; Jiaheng Liu; Tianyu Zheng; Xinchen Luo; Guorui Zhou; Wenhu Chen;, Ge Zhang2024 · 23 citations
- Scaling Latent Reasoning via Looped Language ModelsarXiv:2510.25741Rui-Jie Zhu, Zixuan Wang, Kai Hua, et al.2025 · 22 citations
- Can Language Models Reason about Individualistic Human Values and Preferences?Annual Meeting of the Association for Computational Linguistics (ACL)Liwei Jiang, Taylor Sorensen, Sydney Levine, et al.2025 · 21 citations
- Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation ModelarXiv:2502.10248Guoqing Ma, Haoyang Huang, Kun Yan, et al.2025 · 21 citations
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language ModelsarXiv:2406.06563Tianwen Wei, Bo Zhu, Liang Zhao, et al.2024 · 21 citations
- ModuleFormer: Modularity Emerges from Mixture-of-ExpertsarXiv:2306.04640Yikang Shen, Zheyu Zhang, Tianyou Cao, et al.2023 · 21 citations
- NeoBERT: A Next-Generation BERTarXiv:2502.19587Lola Le Breton, Quentin Fournier, Mariam El Mezouar, et al.2025 · 20 citations
- Resolving Discrepancies in Compute-Optimal Scaling of Language ModelsConference on Neural Information Processing Systems (NeurIPS)Tomer Porian, Mitchell Wortsman, Jenia Jitsev, et al.2024 · 19 citations
- Quality-Diversity through AI FeedbackarXiv:2310.13032Herbie Bradley, Andrew Dai, Hannah Teufel, et al.2023 · 19 citations
- HunyuanImage 3.0 Technical ReportarXiv:2509.23951Tencent Hunyuan Foundation Model Team2025 · 17 citations
- Orion-14B: Open-source Multilingual Large Language ModelsarXiv:2401.12246Du Chen, Yi Huang, Xiaopu Li, et al.2024 · 17 citations
- LongRecipe: Recipe for Efficient Long Context Generalization in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiyuan Hu, Yuliang Liu, Jinman Zhao, et al.2025 · 16 citations
- Dataset Decomposition: Faster LLM Training with Variable Sequence Length CurriculumConference on Neural Information Processing Systems (NeurIPS)Hadi Pouransari, Chun-Liang Li, Jen-Hao Rick Chang, et al.2024 · 16 citations
- Linearizing Large Language ModelsarXiv:2405.06640Jean Mercat, Igor Vasiljevic, Sedrick Keh, et al.2024 · 16 citations
- LitLLMs, LLMs for Literature Review: Are we there yet?arXiv:2412.15249Shubham Agarwal, Gaurav Sahu, Abhay Puri, et al.2024 · 16 citations
- TigerBot: An Open Multilingual Multitask LLMarXiv:2312.08688Ye Chen, Wei Cai, Liangmin Wu, et al.2023 · 15 citations
- Jais 2: A Family of Arabic-Centric Open Large Language ModelsarXiv:2608.13580Mohamed Anwar, Abed Alhakim Freihat, George Ibrahim, et al.2026 · 14 citations
- Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhisong Zhang, Yan Wang, Xinting Huang, et al.2025 · 14 citations
- Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token ReductionFindings of the Association for Computational LinguisticsZhenmei Shi, Yifei Ming, Xuan-Phi Nguyen, et al.2026 · 13 citations
- Personalized Text Generation with Contrastive Activation SteeringAnnual Meeting of the Association for Computational Linguistics (ACL)Jinghao Zhang, Yuting Liu, Wenjie Wang, et al.2025 · 13 citations
- POSITION BIAS MITIGATES POSITION BIAS: Mitigate Position Bias Through Inter-Position Knowledge DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Yifei Wang, Feng Xiong, Yong Wang, et al.2025 · 13 citations
- Scaling Reasoning, Losing Control: Evaluating Instruction Following in Large Reasoning ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Tingchen Fu, Yafu Li, Jiawei Gu, et al.2026 · 12 citations
- LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Jianghao Chen, Junhong Wu, Yangyifan Xu, et al.2025 · 12 citations
- Latent Inter-User Difference Modeling for LLM PersonalizationConference on Empirical Methods in Natural Language Processing (EMNLP)Yilun Qiu, Tianhao Shi, Xiaoyan Zhao, et al.2025 · 12 citations
- Base of RoPE Bounds Context LengtharXiv:2405.14591Xin Men, Mingyu Xu, Bingning Wang, et al.2024 · 12 citations
- Maximize Your Data's Potential: Enhancing LLM Accuracy with Two-Phase PretrainingarXiv:2412.15285Steven Feng, Shrimai Prabhumoye, Kezhi Kong, et al.2024 · 12 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yu-lu/cited-by/page/2/