🧑‍🔬 Who cites Linlin Li

736 citations of their works from 734 papers of our library (of the 149,439 whose bibliographies we read) · 84 with a page here, the most cited first · ← Linlin Li

1. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
2. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
3. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing SurveysPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,423 citations
4. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Omar Khattab, Matei Zaharia2020 · 1,789 citations
5. Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
6. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
7. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingarXiv:2111.09543Pengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,320 citations
8. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Timo Schick, Hinrich Schütze2021 · 1,132 citations
9. MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.2020 · 1,016 citations
10. GLM-130B: An Open Bilingual Pre-trained ModelarXiv:2210.02414Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 786 citations
11. FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
12. DeeBERT: Dynamic Early Exiting for Accelerating BERT InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Ji Xin, Raphael Tang, Jaejun Lee, et al.2020 · 487 citations
13. LLM-Pruner: On the Structural Pruning of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Xinyin Ma, Gongfan Fang, Xinchao Wang2023 · 452 citations
14. Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware SamplingInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Sebastian Hofstatter, Sheng-Chieh Lin, Jheng-Hong Yang, et al.2021 · 425 citations
15. Security and Privacy Challenges of Large Language Models: A SurveyACM Computing SurveysBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 424 citations
16. FastBERT: a Self-distilling BERT with Adaptive Inference TimeAnnual Meeting of the Association for Computational Linguistics (ACL)Weijie Liu, Peng Zhou, Zhiruo Wang, et al.2020 · 383 citations
17. Parameter-Efficient Transfer Learning with Diff PruningAnnual Meeting of the Association for Computational Linguistics (ACL)Demi Guo, Alexander Rush, Yoon Kim2021 · 367 citations
18. SPoT: Better Frozen Model Adaptation through Soft Prompt TransferAnnual Meeting of the Association for Computational Linguistics (ACL)Tu Vu, Brian Lester, Noah Constant, et al.2022 · 306 citations
19. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale TransformersConference on Neural Information Processing Systems (NeurIPS)Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, et al.2022 · 304 citations
20. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
21. On-Policy Distillation of Language Models: Learning from Self-Generated MistakesarXiv:2306.13649Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, et al.2023 · 299 citations
22. Survey: Multiword Expression Processing: A SurveyComputational LinguisticsMathieu Constant, Gülşen Eryiǧit, Johanna Monti, et al.2017 · 296 citations
23. ZeroGen: Efficient Zero-shot Learning via Dataset GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Jiacheng Ye, Jiahui Gao, Qintong Li, et al.2022 · 245 citations
24. BERT-of-Theseus: Compressing BERT by Progressive Module ReplacingConference on Empirical Methods in Natural Language Processing (EMNLP)Canwen Xu, Wangchunshu Zhou, Tao Ge, et al.2020 · 240 citations
25. An Empirical Study on Compositionality in Compound NounsInternational Joint Conference on Natural Language Processing (IJCNLP)Siva Reddy, Diana McCarthy, Suresh Manandhar2011 · 233 citations
26. Structured Pruning Learns Compact and Accurate ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 221 citations
27. TernaryBERT: Distillation-aware Ultra-low Bit BERTConference on Empirical Methods in Natural Language Processing (EMNLP)Wei Zhang, Lu Hou, Yichun Yin, et al.2020 · 213 citations
28. DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationConference of the European Chapter of the Association for Computational Linguistics (EACL)Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, et al.2023 · 203 citations
29. Large Language Model as Attributed Training Data Generator: A Tale of Diversity and BiasConference on Neural Information Processing Systems (NeurIPS)Yue Yu, Yuchen Zhuang, Jieyu Zhang, et al.2023 · 202 citations
30. Structured Pruning of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ziheng Wang, Jeremy Wohlwend, Tao Lei2020 · 202 citations
31. Block Pruning For Faster TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)François Lagunas, Ella Charlaix, Victor Sanh, et al.2021 · 199 citations
32. The Right Tool for the Job: Matching Model and Instance ComplexitiesAnnual Meeting of the Association for Computational Linguistics (ACL)Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, et al.2020 · 196 citations
33. Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-TuningInternational Conference on Computational Linguistics (COLING)Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, et al.2022 · 195 citations
34. Compressing Large-Scale Transformer-Based Models: A Case Study on BERTTransactions of the Association for Computational Linguistics (TACL)Prakhar Ganesh, Yao Chen, Xin Lou, et al.2021 · 190 citations
35. BinaryBERT: Pushing the Limit of BERT QuantizationAnnual Meeting of the Association for Computational Linguistics (ACL)Haoli Bai, Wei Zhang, Lu Hou, et al.2021 · 166 citations
36. CPM: A Large-scale Generative Chinese Pre-trained Language ModelAI OpenZhengyan Zhang, Xu Han, Hao Zhou, et al.2020 · 150 citations
37. Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
38. MiniLLM: On-Policy Distillation of Large Language ModelsarXiv:2306.08543Yuxian Gu, Li Dong, Furu Wei, et al.2023 · 144 citations
39. I-BERT: Integer-only BERT QuantizationInternational Conference on Machine Learning (ICML)Sehoon Kim, Amir Gholami, Zhewei Yao, et al.2021 · 122 citations
40. MAGPIE: A Large Corpus of Potentially Idiomatic ExpressionsLanguage Resources and Evaluation Conference (LREC)Hessel Haagsma, Johan Bos, Malvina Nissim2020 · 118 citations
41. MoEfication: Transformer Feed-forward Layers are Mixtures of ExpertsFindings of the Association for Computational LinguisticsZhengyan Zhang, Yankai Lin, Zhiyuan Liu, et al.2022 · 115 citations
42. f-Divergence Minimization for Sequence-Level Knowledge DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Yuqiao Wen, Zichao Li, Wenyu Du, et al.2023 · 92 citations
43. BERT Busters: Outlier Dimensions that Disrupt TransformersFindings of the Association for Computational LinguisticsOlga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, et al.2021 · 90 citations
44. Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
45. Idiomatic Expression Identification using Semantic CompatibilityTransactions of the Association for Computational Linguistics (TACL)Ziheng Zeng, Suma Bhat2021 · 75 citations
46. The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
47. Idiom Token Classification using Sentential Distributed SemanticsAnnual Meeting of the Association for Computational Linguistics (ACL)Giancarlo Salton, Robert Ross, John Kelleher2016 · 65 citations
48. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731Shuohuan Wang, Yu Sun, Yang Xiang, et al.2021 · 63 citations
49. ID10M: Idiom Identification in 10 LanguagesFindings of the Association for Computational LinguisticsSimone Tedeschi, Federico Martelli, Roberto Navigli2022 · 49 citations
50. F-coref: Fast, Accurate and Easy to Use Coreference ResolutionConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Shon Otmazgin, Arie Cattan, Yoav Goldberg2022 · 45 citations
51. Dual-Space Knowledge Distillation for Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Songming Zhang, Xue Zhang, Zengkui Sun, et al.2024 · 39 citations
52. Improving Stance Detection with Multi-Dataset Learning and Knowledge DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Yingjie Li, Chenye Zhao, Cornelia Caragea2021 · 39 citations
53. Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMsarXiv:2402.12030 · Transactions on Machine Learning Research, January 2025Nicolas Boizard, Kevin El Haddad, Celine Hudelot, et al.2024 · 35 citations
54. A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
55. Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
56. FuseChat: Knowledge Fusion of Chat ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Fanqi Wan, Longguang Zhong, Ziyi Yang, et al.2025 · 25 citations
57. Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context ExpertsFindings of the Association for Computational LinguisticsNghia T. Le, Fan Bai, Alan Ritter2022 · 20 citations
58. Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge DistillationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Abhijnan Nath, Shadi Manafi Avari, Avyakta Chelle, et al.2024 · 16 citations
59. Pre-training Distillation for Large Language Models: A Design Space ExplorationAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Peng, Xin Lv, Yushi Bai, et al.2025 · 14 citations
60. Distilling Calibrated Knowledge for Stance DetectionFindings of the Association for Computational LinguisticsYingjie Li, Cornelia Caragea2023 · 13 citations
61. Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language InferenceConference on Empirical Methods in Natural Language Processing (EMNLP)Sara Rajaee, Yadollah Yaghoobzadeh, Mohammad Taher Pilehvar2022 · 13 citations
62. EMO: Embedding Model Distillation via Intra-Model Relation and Optimal Transport AlignmentsConference on Empirical Methods in Natural Language Processing (EMNLP)Minh-Phuc Truong, Hai An Vu, Tu Vu, et al.2025 · 10 citations
63. Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key InformationConference on Empirical Methods in Natural Language Processing (EMNLP)Yao Chen, Jiawei Sheng, Wenyuan Zhang, et al.2025 · 10 citations
64. Knowledge Distillation of Black-Box Large Language ModelsarXiv:2401.07013Hongzhan Chen, Ruijun Chen, Yuqi Yi, et al.2024 · 10 citations
65. A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity UnderstandingLanguage Resources and Evaluation Conference (LREC)Dilara Torunoğlu-Selamet, Doğukan Arslan, Rodrigo Wilkens, et al.2026 · 8 citations
66. Cross-lingual transfer for low-resource Arabic language understandingArabic Natural Language Processing Workshop (WANLP)Khadige Abboud, Olga Golovneva, Christopher DiPersio2022 · 8 citations
67. TinyR1-32B-Preview: Boosting Accuracy with Branch-Merge DistillationarXiv:2503.04872Lin Sun, Guangxiang Zhao, Xiaoqi Jian, et al.2025 · 7 citations
68. Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Anshumann, Mohd Abbas Zaidi, Akhil Kedia, et al.2025 · 6 citations
69. Detecting Anti-Semitic Hate Speech using Transformer-based Large Language ModelsarXiv:2405.03794Dengyi Liu, Minghao Wang, Andrew G. Catlin2024 · 6 citations
70. Balancing Fidelity and Plasticity: Aligning Mixed-Precision Fine-Tuning with Linguistic HierarchiesFindings of the Association for Computational LinguisticsChanghai Zhou, Shiyang Zhang, Yuhua Zhou, et al.2026 · 3 citations
71. Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
72. FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model CompressionFindings of the Association for Computational LinguisticsJiayi Tian, Ryan Solgi, Jinming Lu, et al.2026 · 2 citations
73. LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Robin Vujanic, Thomas Rückstieß2026 · 2 citations
74. Multi-Granularity Semantic Revision for Large Language Model DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Liu, Yun Zhang, Wei Li, et al.2026 · 2 citations
75. Enhanced Arabic Text Retrieval with Attentive Relevance ScoringIEEE International Workshop on Machine Learning for Signal Processing (MLSP)Salah Eddine Bekhouche, Azeddine Benlamoudi, Yazid Bounab, et al.2025 · 2 citations
76. Semantically Motivated Hebrew Verb-Noun Multi-Word Expressions IdentificationChaya Liebeskind, Yaakov HaCohen-Kerner2016 · 2 citations
77. SindBERT, the Sailor: Charting the Seas of Turkish NLPWorkshop Natural Language Processing for Turkic LanguagesRaphael Schmitt, Stefan Schweter2026 · 1 citation
78. TaoType: Predicting Fine-Grained Typing Intent for Faster SearchAnnual Meeting of the Association for Computational Linguistics (ACL)Yipeng Yu, Yichen Yuan, Chengxiao Feng, et al.2026 · 1 citation
79. ID10M-JAM: Stress-Testing Idiom Identification Under Challenging ContextFindings of the Association for Computational LinguisticsKai Golan Hashiloni, Lior Livyatan, Ofri Hefetz, et al.2026
80. Investigating Memorization in Language Models Trained via Knowledge DistillationLanguage Resources and Evaluation Conference (LREC)Maarten Mäcking, Michaela Regneri2026
81. ReasMark: A Robust Watermark for Attributing LLM Reasoning Under Knowledge Distillation AttacksAnnual Meeting of the Association for Computational Linguistics (ACL)Peizhuo Lv, Ruihua Zhou, Yunpeng Li, et al.2026
82. A Hybrid DeBERTa and Gated Broad Learning System for Cyberbullying Detection in English TextarXiv:2506.16052Devesh Kumar2025
83. Non Idiomatic Conventionalised Expressions: A New Pain in the Neck?Pacific Asia Conference on Language, Information and Computation (PACLIC)Ganesh Katrapati, Manish Shrivastava2025
84. The semantic transparency of English compound nounsMartin Schäfer2018

650 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/linlin-li/cited-by/