Who cites Mingjie Sun
- Reducing Transformer Depth on Demand with Structured DropoutarXiv:1909.11556Angela Fan, Edouard Grave, Armand Joulin2019 · 560 citations
- Compressing BERT: Studying the Effects of Weight Pruning on Transfer LearningWorkshop on Representation Learning for NLPMitchell Gordon, Kevin Duh, Nicholas Andrews2020 · 407 citations
- FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
- Structured Pruning Learns Compact and Accurate ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 221 citations
- Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LuncharXiv:2311.03099Le Yu, Bowen Yu, Haiyang Yu, et al.2023 · 217 citations
- Deja Vu: Contextual Sparsity for Efficient LLMs at Inference TimeInternational Conference on Machine Learning (ICML)Zichang Liu, Jue Wang, Tri Dao, et al.2023 · 185 citations
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information FunnelingarXiv:2406.02069Zefan Cai, Yichi Zhang, Bofei Gao, et al.2024 · 155 citations
- Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Jun Zhang, Jue Wang, Huan Li, et al.2024 · 148 citations
- H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language ModelsarXiv:2306.14048Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.2023 · 124 citations
- Learning Language Specific Sub-network for Multilingual Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Zehui Lin, Liwei Wu, Mingxuan Wang, et al.2021 · 104 citations
- Accelerating Sparse Deep Neural NetworksarXiv 2021 (NVIDIA)Asit Mishra, Jorge Albericio Latorre, Jeff Pool, et al.2021 · 97 citations
- Training Language Models to Reason EfficientlyConference on Neural Information Processing Systems (NeurIPS)Daman Arora, Andrea Zanette2025 · 74 citations
- A Primer on the Inner Workings of Transformer-based Language ModelsarXiv:2405.00208Javier Ferrando, Gabriele Sarti, Arianna Bisazza, et al.2024 · 72 citations
- MiMo-V2-Flash Technical ReportarXiv:2601.02780Xiaomi LLM-Core Team; Bangjun Xiao; Bingquan Xia; Bo Yang; Bofei Gao; Bowen Shen; Chen Zhang; Chenhong He; Chiheng Lou; Fuli Luo; Gang Wang; Gang Xie; Hailin Zhang; Hanglong Lv; Hanyu Li; Heyu Chen; Hongshen Xu; Houbin Zhang; Huaqiu Liu; Jiangshan Duo; Jianyu Wei; Jiebao Xiao; Jinhao Dong; Jun Shi; Junhao Hu; Kainan Bao; Kang Zhou; Lei Li; Liang Zhao; Linghao Zhang; Peidian Li; Qianli Chen; Shaohui Liu; Shihua Yu; Shijie Cao; Shimao Chen; Shouqiu Yu; Shuo Liu; Tianling Zhou; Weijiang Su; Weikun Wang; Wenhan Ma; Xiangwei Deng; Bohan Mao; Bowen Ye; Can Cai; Chenghua Wang; Chengxuan Zhu; Chong Ma; Chun Chen; Chunan Li; Dawei Zhu; Deshan Xiao; Dong Zhang; Duo Zhang; Fangyue Liu; Feiyu Yang; Fengyuan Shi; Guoan Wang; Hao Tian; Hao Wu; Heng Qu; Hongfei Yi; Hongxu An; Hongyi Guan; Xing Zhang; Yifan Song; Yihan Yan; Yihao Zhao; Yingchun Lai; Yizhao Gao; Yu Cheng; Yuanyuan Tian; Yudong Wang; Zhen Tang; Zhengju Tang; Zhengtao Wen; Zhichao Song; Zhixian Zheng; Zihan Jiang; Jian Wen; Jiarui Sun; Jiawei Li; Jinlong Xue; Jun Xia; Kai Fang; Menghang Zhu; Nuo Chen; Qian Tu; Qihao Zhang; Qiying Wang; Rang Li; Rui Ma; Shaolei Zhang; Shengfan Wang; Shicheng Li; Shuhao Gu; Shuhuai Ren; Sirui Deng; Tao Guo; Tianyang Lu; Weiji Zhuang; Weikang Zhang; Weimin Xiong; Wenshan Huang; Wenyu Yang; Xin Zhang; Xing Yong; Xu Wang; Xueyang Xie; Yilin Jiang; Yixin Yang; Yongzhe He; Yu Tu; Yuanliang Dong; Yuchen Liu; Yue Ma; Yue Yu; Yuxing Xiang; Zhaojun Huang; Zhenru Lin; Zhipeng Xu; Zhiyang Chen; Zhonghua Deng; Zihan Zhang;, Zihao Yue2026 · 60 citations
- DeepSeek: Paradigm Shifts and Technical Evolution in Large AI ModelsarXiv:2507.09955Luolin Xiong, Haofen Wang, Xi Chen, et al.2025 · 41 citations
- Unveiling Linguistic Regions in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhihao Zhang, Jun Zhao, Qi Zhang, et al.2024 · 39 citations
- MiniCPM4: Ultra-Efficient LLMs on End DevicesarXiv:2506.07900MiniCPM Team, Chaojun Xiao, Yuxuan Li, et al.2025 · 22 citations
- ModuleFormer: Modularity Emerges from Mixture-of-ExpertsarXiv:2306.04640Yikang Shen, Zheyu Zhang, Tianyou Cao, et al.2023 · 21 citations
- Shallow Focus, Deep Fixes: Enhancing Shallow Layers Vision Attention Sinks to Alleviate Hallucination in LVLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Xiaofeng Zhang, Yihao Quan, Chen Shen, et al.2025 · 14 citations
- Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language ModelsFindings of the Association for Computational LinguisticsHengyuan Zhang, Zhihao Zhang, Ercong Nie, et al.2026 · 9 citations
- Softpick: No Attention Sink, No Massive Activations with Rectified SoftmaxFindings of the Association for Computational LinguisticsZayd Muhammad Kawakibi Zuhri, Erland Hilman Fuadi, Alham Fikri Aji2026 · 6 citations
- Attention Sinks in Diffusion Language ModelsFindings of the Association for Computational LinguisticsMaximo Eduardo Rulli, Simone Petruzzi, Edoardo Michielon, et al.2026 · 5 citations
- Revealing and Enhancing Core Visual Regions: Harnessing Internal Attention Dynamics for Hallucination Mitigation in LVLMsFindings of the Association for Computational LinguisticsGuangtao Lyu, Qi Liu, Chenghao Xu, et al.2026 · 5 citations
- Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Binxing Xu, Hao Gu, Lujun Li, et al.2026 · 3 citations
- Lizard: An Efficient Linearization Framework for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chien Van Nguyen, Huy Huu Nguyen, Ruiyi Zhang, et al.2026 · 2 citations
- Mid-Think: Training-Free Intermediate-Budget Reasoning via Token-Level TriggersFindings of the Association for Computational LinguisticsVan Yang, Shouren Wang, Debargha Ganguly, et al.2026 · 1 citation
- ReasoningGuard: Safeguarding Large Reasoning Models with Inference-time Safety Aha MomentsAnnual Meeting of the Association for Computational Linguistics (ACL)Yuquan Wang, Mi Zhang, Yining Wang, et al.2026 · 1 citation
- Exploring Attention Attractors in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Ziheng Wang, Zihao Yue, Wenxuan Wang, et al.2026
- Latent Attention Denoising: A Training-Free Energy-Based Framework for Mitigating Hallucinations in Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiwen Luo, Siyu Jiang, Weilong Jiang, et al.2026
- LBLLM: Lightweight Binarization of Large Language Models via Three-Stage DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Siqing Song, Chuang Wang, Yong Lang, et al.2026
- Noise Steering for Controlled Text Generation: Improving Diversity and Reading-Level Fidelity in Arabic Educational Story GenerationWorkshop on Innovative Use of NLP for Building Educational Applications (BEA)Haziq Khalid, Salsabeel Shapsough, Imran Zualkernan2026
- SPIDE: Serial and Parallel Intertwined Speculative DecodingFindings of the Association for Computational LinguisticsWenru Xu, Peixuan Xu, Ziqi Yang, et al.2026
- TokenPenalty: Alleviating Attention Sinks and Positional Decay in LVLMsFindings of the Association for Computational LinguisticsXiaofeng Zhang, Yuanchao Zhu, Qiyan Zhao, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/mingjie-sun/cited-by/