Who cites «Massive Activations in Large Language Models»
- FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information FunnelingarXiv:2406.02069Zefan Cai, Yichi Zhang, Bofei Gao, et al.2024 · 155 citations
- A Primer on the Inner Workings of Transformer-based Language ModelsarXiv:2405.00208Javier Ferrando, Gabriele Sarti, Arianna Bisazza, et al.2024 · 72 citations
- MiMo-V2-Flash Technical ReportarXiv:2601.02780Xiaomi LLM-Core Team; Bangjun Xiao; Bingquan Xia; Bo Yang; Bofei Gao; Bowen Shen; Chen Zhang; Chenhong He; Chiheng Lou; Fuli Luo; Gang Wang; Gang Xie; Hailin Zhang; Hanglong Lv; Hanyu Li; Heyu Chen; Hongshen Xu; Houbin Zhang; Huaqiu Liu; Jiangshan Duo; Jianyu Wei; Jiebao Xiao; Jinhao Dong; Jun Shi; Junhao Hu; Kainan Bao; Kang Zhou; Lei Li; Liang Zhao; Linghao Zhang; Peidian Li; Qianli Chen; Shaohui Liu; Shihua Yu; Shijie Cao; Shimao Chen; Shouqiu Yu; Shuo Liu; Tianling Zhou; Weijiang Su; Weikun Wang; Wenhan Ma; Xiangwei Deng; Bohan Mao; Bowen Ye; Can Cai; Chenghua Wang; Chengxuan Zhu; Chong Ma; Chun Chen; Chunan Li; Dawei Zhu; Deshan Xiao; Dong Zhang; Duo Zhang; Fangyue Liu; Feiyu Yang; Fengyuan Shi; Guoan Wang; Hao Tian; Hao Wu; Heng Qu; Hongfei Yi; Hongxu An; Hongyi Guan; Xing Zhang; Yifan Song; Yihan Yan; Yihao Zhao; Yingchun Lai; Yizhao Gao; Yu Cheng; Yuanyuan Tian; Yudong Wang; Zhen Tang; Zhengju Tang; Zhengtao Wen; Zhichao Song; Zhixian Zheng; Zihan Jiang; Jian Wen; Jiarui Sun; Jiawei Li; Jinlong Xue; Jun Xia; Kai Fang; Menghang Zhu; Nuo Chen; Qian Tu; Qihao Zhang; Qiying Wang; Rang Li; Rui Ma; Shaolei Zhang; Shengfan Wang; Shicheng Li; Shuhao Gu; Shuhuai Ren; Sirui Deng; Tao Guo; Tianyang Lu; Weiji Zhuang; Weikang Zhang; Weimin Xiong; Wenshan Huang; Wenyu Yang; Xin Zhang; Xing Yong; Xu Wang; Xueyang Xie; Yilin Jiang; Yixin Yang; Yongzhe He; Yu Tu; Yuanliang Dong; Yuchen Liu; Yue Ma; Yue Yu; Yuxing Xiang; Zhaojun Huang; Zhenru Lin; Zhipeng Xu; Zhiyang Chen; Zhonghua Deng; Zihan Zhang;, Zihao Yue2026 · 60 citations
- DeepSeek: Paradigm Shifts and Technical Evolution in Large AI ModelsarXiv:2507.09955Luolin Xiong, Haofen Wang, Xi Chen, et al.2025 · 41 citations
- Unveiling Linguistic Regions in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhihao Zhang, Jun Zhao, Qi Zhang, et al.2024 · 39 citations
- MiniCPM4: Ultra-Efficient LLMs on End DevicesarXiv:2506.07900MiniCPM Team, Chaojun Xiao, Yuxuan Li, et al.2025 · 22 citations
- Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Xiaofeng Zhang, Yihao Quan, Chen Shen, et al.2025 · 14 citations
- Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language ModelsFindings of the Association for Computational LinguisticsHengyuan Zhang, Zhihao Zhang, Ercong Nie, et al.2026 · 9 citations
- Softpick: No Attention Sink, No Massive Activations with Rectified SoftmaxFindings of the Association for Computational LinguisticsZayd Muhammad Kawakibi Zuhri, Erland Hilman Fuadi, Alham Fikri Aji2026 · 6 citations
- Attention Sinks in Diffusion Language ModelsFindings of the Association for Computational LinguisticsMaximo Eduardo Rulli, Simone Petruzzi, Edoardo Michielon, et al.2026 · 5 citations
- Revealing and Enhancing Core Visual Regions: Harnessing Internal Attention Dynamics for Hallucination Mitigation in LVLMsFindings of the Association for Computational LinguisticsGuangtao Lyu, Qi Liu, Chenghao Xu, et al.2026 · 5 citations
- Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Binxing Xu, Hao Gu, Lujun Li, et al.2026 · 3 citations
- Lizard: An Efficient Linearization Framework for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chien Van Nguyen, Huy Huu Nguyen, Ruiyi Zhang, et al.2026 · 2 citations
- Mid-Think: Training-Free Intermediate-Budget Reasoning via Token-Level TriggersFindings of the Association for Computational LinguisticsVan Yang, Shouren Wang, Debargha Ganguly, et al.2026 · 1 citation
- ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha MomentsAnnual Meeting of the Association for Computational Linguistics (ACL)Yuquan Wang, Mi Zhang, Yining Wang, et al.2026 · 1 citation
- Exploring Attention Attractors in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Ziheng Wang, Zihao Yue, Wenxuan Wang, et al.2026
- Latent Attention Denoising: A Training-Free Energy-Based Framework for Mitigating Hallucinations in Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiwen Luo, Siyu Jiang, Weilong Jiang, et al.2026
- Noise Steering for Controlled Text Generation: Improving Diversity and Reading-Level Fidelity in Arabic Educational Story GenerationWorkshop on Innovative Use of NLP for Building Educational Applications (BEA)Haziq Khalid, Salsabeel Shapsough, Imran Zualkernan2026
- TokenPenalty: Alleviating Attention Sinks and Positional Decay in LVLMsFindings of the Association for Computational LinguisticsXiaofeng Zhang, Yuanchao Zhu, Qiyan Zhao, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/sun-2024-massive-activations-large-language-models/cited-by/