🧑‍🔬 Who cites Xiao Chen

714 citations of their works from 680 papers of our library (of the 149,439 whose bibliographies we read) · 83 with a page here, the most cited first · ← Xiao Chen

1. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
2. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
3. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing SurveysPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,423 citations
4. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Omar Khattab, Matei Zaharia2020 · 1,789 citations
5. Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
6. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
7. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingarXiv:2111.09543Pengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,320 citations
8. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Timo Schick, Hinrich Schütze2021 · 1,132 citations
9. MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.2020 · 1,016 citations
10. GLM-130B: An Open Bilingual Pre-trained ModelarXiv:2210.02414Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 786 citations
11. FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
12. DeeBERT: Dynamic Early Exiting for Accelerating BERT InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Ji Xin, Raphael Tang, Jaejun Lee, et al.2020 · 487 citations
13. LLM-Pruner: On the Structural Pruning of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Xinyin Ma, Gongfan Fang, Xinchao Wang2023 · 452 citations
14. Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware SamplingInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Sebastian Hofstatter, Sheng-Chieh Lin, Jheng-Hong Yang, et al.2021 · 425 citations
15. Security and Privacy Challenges of Large Language Models: A SurveyACM Computing SurveysBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 424 citations
16. FastBERT: a Self-distilling BERT with Adaptive Inference TimeAnnual Meeting of the Association for Computational Linguistics (ACL)Weijie Liu, Peng Zhou, Zhiruo Wang, et al.2020 · 383 citations
17. Parameter-Efficient Transfer Learning with Diff PruningAnnual Meeting of the Association for Computational Linguistics (ACL)Demi Guo, Alexander Rush, Yoon Kim2021 · 367 citations
18. WARP: Word-level Adversarial ReProgrammingarXiv:2101.00121Karen Hambardzumyan, Hrant Khachatrian, Jonathan May2021 · 340 citations
19. SPoT: Better Frozen Model Adaptation through Soft Prompt TransferAnnual Meeting of the Association for Computational Linguistics (ACL)Tu Vu, Brian Lester, Noah Constant, et al.2022 · 306 citations
20. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale TransformersConference on Neural Information Processing Systems (NeurIPS)Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, et al.2022 · 304 citations
21. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
22. On-Policy Distillation of Language Models: Learning from Self-Generated MistakesarXiv:2306.13649Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, et al.2023 · 299 citations
23. LLM-QAT: Data-Free Quantization Aware Training for Large Language ModelsFindings of the Association for Computational LinguisticsZechun Liu, Barlas Oguz, Changsheng Zhao, et al.2024 · 276 citations
24. ZeroGen: Efficient Zero-shot Learning via Dataset GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Jiacheng Ye, Jiahui Gao, Qintong Li, et al.2022 · 245 citations
25. BERT-of-Theseus: Compressing BERT by Progressive Module ReplacingConference on Empirical Methods in Natural Language Processing (EMNLP)Canwen Xu, Wangchunshu Zhou, Tao Ge, et al.2020 · 240 citations
26. Structured Pruning Learns Compact and Accurate ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 221 citations
27. TernaryBERT: Distillation-aware Ultra-low Bit BERTConference on Empirical Methods in Natural Language Processing (EMNLP)Wei Zhang, Lu Hou, Yichun Yin, et al.2020 · 213 citations
28. DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationConference of the European Chapter of the Association for Computational Linguistics (EACL)Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, et al.2023 · 203 citations
29. Large Language Model as Attributed Training Data Generator: A Tale of Diversity and BiasConference on Neural Information Processing Systems (NeurIPS)Yue Yu, Yuchen Zhuang, Jieyu Zhang, et al.2023 · 202 citations
30. Structured Pruning of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ziheng Wang, Jeremy Wohlwend, Tao Lei2020 · 202 citations
31. Block Pruning For Faster TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)François Lagunas, Ella Charlaix, Victor Sanh, et al.2021 · 199 citations
32. The Right Tool for the Job: Matching Model and Instance ComplexitiesAnnual Meeting of the Association for Computational Linguistics (ACL)Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, et al.2020 · 196 citations
33. Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-TuningInternational Conference on Computational Linguistics (COLING)Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, et al.2022 · 195 citations
34. Compressing Large-Scale Transformer-Based Models: A Case Study on BERTTransactions of the Association for Computational Linguistics (TACL)Prakhar Ganesh, Yao Chen, Xin Lou, et al.2021 · 190 citations
35. SqueezeLLM: Dense-and-Sparse QuantizationarXiv:2306.07629Sehoon Kim, Coleman Hooper, Amir Gholami, et al.2023 · 170 citations
36. BinaryBERT: Pushing the Limit of BERT QuantizationAnnual Meeting of the Association for Computational Linguistics (ACL)Haoli Bai, Wei Zhang, Lu Hou, et al.2021 · 166 citations
37. CPM: A Large-scale Generative Chinese Pre-trained Language ModelAI OpenZhengyan Zhang, Xu Han, Hao Zhou, et al.2020 · 150 citations
38. Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
39. MiniLLM: On-Policy Distillation of Large Language ModelsarXiv:2306.08543Yuxian Gu, Li Dong, Furu Wei, et al.2023 · 144 citations
40. I-BERT: Integer-only BERT QuantizationInternational Conference on Machine Learning (ICML)Sehoon Kim, Amir Gholami, Zhewei Yao, et al.2021 · 122 citations
41. MoEfication: Transformer Feed-forward Layers are Mixtures of ExpertsFindings of the Association for Computational LinguisticsZhengyan Zhang, Yankai Lin, Zhiyuan Liu, et al.2022 · 115 citations
42. Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to SystemsACM Computing SurveysXupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.2023 · 110 citations
43. jina-embeddings-v3: Multilingual Embeddings With Task LoRAarXiv:2409.10173Saba Sturua, Isabelle Mohr, Mohammad Kalim Akram, et al.2024 · 109 citations
44. LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale InstructionsarXiv:2304.14402Minghao Wu, Abdul Waheed, Chiyu Zhang, et al.2023 · 106 citations
45. IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language ReasoningarXiv:2110.13214Pan Lu, Liang Qiu, Jiaqi Chen, et al.2021 · 103 citations
46. f-Divergence Minimization for Sequence-Level Knowledge DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Yuqiao Wen, Zichao Li, Wenyu Du, et al.2023 · 92 citations
47. BERT Busters: Outlier Dimensions that Disrupt TransformersFindings of the Association for Computational LinguisticsOlga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, et al.2021 · 90 citations
48. Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
49. Knowledge Fusion of Large Language ModelsarXiv:2401.10491Fanqi Wan, Xinting Huang, Deng Cai, et al.2024 · 82 citations
50. The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
51. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731Shuohuan Wang, Yu Sun, Yang Xiang, et al.2021 · 63 citations
52. F-coref: Fast, Accurate and Easy to Use Coreference ResolutionConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Shon Otmazgin, Arie Cattan, Yoav Goldberg2022 · 45 citations
53. Dual-Space Knowledge Distillation for Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Songming Zhang, Xue Zhang, Zengkui Sun, et al.2024 · 39 citations
54. Improving Stance Detection with Multi-Dataset Learning and Knowledge DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Yingjie Li, Chenye Zhao, Cornelia Caragea2021 · 39 citations
55. Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMsarXiv:2402.12030 · Transactions on Machine Learning Research, January 2025Nicolas Boizard, Kevin El Haddad, Celine Hudelot, et al.2024 · 35 citations
56. A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
57. Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
58. FuseChat: Knowledge Fusion of Chat ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Fanqi Wan, Longguang Zhong, Ziyi Yang, et al.2025 · 25 citations
59. Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context ExpertsFindings of the Association for Computational LinguisticsNghia T. Le, Fan Bai, Alan Ritter2022 · 20 citations
60. Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge DistillationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Abhijnan Nath, Shadi Manafi Avari, Avyakta Chelle, et al.2024 · 16 citations
61. Pre-training Distillation for Large Language Models: A Design Space ExplorationAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Peng, Xin Lv, Yushi Bai, et al.2025 · 14 citations
62. Distilling Calibrated Knowledge for Stance DetectionFindings of the Association for Computational LinguisticsYingjie Li, Cornelia Caragea2023 · 13 citations
63. Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language InferenceConference on Empirical Methods in Natural Language Processing (EMNLP)Sara Rajaee, Yadollah Yaghoobzadeh, Mohammad Taher Pilehvar2022 · 13 citations
64. EMO: Embedding Model Distillation via Intra-Model Relation and Optimal Transport AlignmentsConference on Empirical Methods in Natural Language Processing (EMNLP)Minh-Phuc Truong, Hai An Vu, Tu Vu, et al.2025 · 10 citations
65. Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key InformationConference on Empirical Methods in Natural Language Processing (EMNLP)Yao Chen, Jiawei Sheng, Wenyuan Zhang, et al.2025 · 10 citations
66. Knowledge Distillation of Black-Box Large Language ModelsarXiv:2401.07013Hongzhan Chen, Ruijun Chen, Yuqi Yi, et al.2024 · 10 citations
67. Cross-lingual transfer for low-resource Arabic language understandingArabic Natural Language Processing Workshop (WANLP)Khadige Abboud, Olga Golovneva, Christopher DiPersio2022 · 8 citations
68. TinyR1-32B-Preview: Boosting Accuracy with Branch-Merge DistillationarXiv:2503.04872Lin Sun, Guangxiang Zhao, Xiaoqi Jian, et al.2025 · 7 citations
69. Sparse Logit Sampling: Accelerating Knowledge Distillation in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Anshumann, Mohd Abbas Zaidi, Akhil Kedia, et al.2025 · 6 citations
70. Detecting Anti-Semitic Hate Speech using Transformer-based Large Language ModelsarXiv:2405.03794Dengyi Liu, Minghao Wang, Andrew G. Catlin2024 · 6 citations
71. Balancing Fidelity and Plasticity: Aligning Mixed-Precision Fine-Tuning with Linguistic HierarchiesFindings of the Association for Computational LinguisticsChanghai Zhou, Shiyang Zhang, Yuhua Zhou, et al.2026 · 3 citations
72. Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
73. FLAT-LLM: Fine-grained Low-rank Activation Space Transformation for Large Language Model CompressionFindings of the Association for Computational LinguisticsJiayi Tian, Ryan Solgi, Jinming Lu, et al.2026 · 2 citations
74. LEAF: Knowledge Distillation of Text Embedding Models with Teacher-Aligned RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Robin Vujanic, Thomas Rückstieß2026 · 2 citations
75. Multi-Granularity Semantic Revision for Large Language Model DistillationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Liu, Yun Zhang, Wei Li, et al.2026 · 2 citations
76. Enhanced Arabic Text Retrieval with Attentive Relevance ScoringIEEE International Workshop on Machine Learning for Signal Processing (MLSP)Salah Eddine Bekhouche, Azeddine Benlamoudi, Yazid Bounab, et al.2025 · 2 citations
77. SindBERT, the Sailor: Charting the Seas of Turkish NLPWorkshop Natural Language Processing for Turkic LanguagesRaphael Schmitt, Stefan Schweter2026 · 1 citation
78. TaoType: Predicting Fine-Grained Typing Intent for Faster SearchAnnual Meeting of the Association for Computational Linguistics (ACL)Yipeng Yu, Yichen Yuan, Chengxiao Feng, et al.2026 · 1 citation
79. Cultivating Forensic Reasoning for Generalizable Multimodal Manipulation DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Yuchen Zhang, Yaxiong Wang, Kecheng Han, et al.2026
80. Investigating Memorization in Language Models Trained via Knowledge DistillationLanguage Resources and Evaluation Conference (LREC)Maarten Mäcking, Michaela Regneri2026
81. ReasMark: A Robust Watermark for Attributing LLM Reasoning Under Knowledge Distillation AttacksAnnual Meeting of the Association for Computational Linguistics (ACL)Peizhuo Lv, Ruihua Zhou, Yunpeng Li, et al.2026
82. When Debiasing Backfires: Counterintuitive Side Effects of Preprocessing-Based Stereotype MitigationFindings of the Association for Computational LinguisticsYahan Zheng, John J. Guerrerio, Soroush Vosoughi, et al.2026
83. A Hybrid DeBERTa and Gated Broad Learning System for Cyberbullying Detection in English TextarXiv:2506.16052Devesh Kumar2025

597 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/xiao-chen/cited-by/