Elamur Research⌕
☰
home / papers / The Power of Scale for Parameter-Efficient Prompt… / cited by / page 2

Who cites «The Power of Scale for Parameter-Efficient Prompt Tuning»

1,372 papers of our library cite it (of the 149,439 whose bibliographies we read) · 266 with a page here, the most cited first · page 2 of 3 · 101–200 · ← back to «The Power of Scale for Parameter-Efficient Prompt Tuning»

1 2 3

  1. Extracting Latent Steering Vectors from Pretrained Language ModelsFindings of the Association for Computational LinguisticsNishant Subramani, Nivedita Suresh, Matthew Peters2022 · 137 citations
  2. DiffusionBERT: Improving Generative Masked Language Models with Diffusion ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhengfu He, Tianxiang Sun, Qiong Tang, et al.2023 · 136 citations
  3. AdaMix: Mixture-of-Adaptations for Parameter-efficient Model TuningConference on Empirical Methods in Natural Language Processing (EMNLP)Yaqing Wang, Sahaj Agarwal, Subhabrata Mukherjee, et al.2022 · 135 citations
  4. FreshLLMs: Refreshing Large Language Models with Search Engine AugmentationarXiv:2310.03214Tu Vu, Mohit Iyyer, Xuezhi Wang, et al.2023 · 134 citations
  5. ZeroSCROLLS: A Zero-Shot Benchmark for Long Text UnderstandingFindings of the Association for Computational LinguisticsUri Shaham, Maor Ivgi, Avia Efrat, et al.2023 · 132 citations
  6. Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-TuningarXiv:2303.15647Vladislav Lialin, Vijeta Deshpande, Xiaowei Yao, et al.2023 · 129 citations
  7. Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled DataFindings of the Association for Computational LinguisticsKashun Shum, Shizhe Diao, Tong Zhang2023 · 128 citations
  8. LM vs LM: Detecting Factual Errors via Cross ExaminationConference on Empirical Methods in Natural Language Processing (EMNLP)Roi Cohen, May Hamri, Mor Geva, et al.2023 · 126 citations
  9. Quiet-STaR: Language models can teach themselves to think before speaking2024 · 122 citations
  10. ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft PromptsConference on Empirical Methods in Natural Language Processing (EMNLP)Akari Asai, Mohammadreza Salehi, Matthew Peters, et al.2022 · 122 citations
  11. A Real-World WebAgent with Planning, Long Context Understanding, and Program SynthesisarXiv:2307.12856Izzeddin Gur, Hiroki Furuta, Austin Huang, et al.2023 · 120 citations
  12. Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question AnsweringarXiv:2306.04136Jinheon Baek, Alham Fikri Aji, Amir Saffari2023 · 119 citations
  13. The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-TuningConference on Empirical Methods in Natural Language Processing (EMNLP)Seungone Kim, Se Joo, Doyoung Kim, et al.2023 · 118 citations
  14. Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context LearningConference on Neural Information Processing Systems (NeurIPS)Xinyi Wang, Wanrong Zhu, Michael Saxon, et al.2023 · 116 citations
  15. Natural Language to Code Translation with ExecutionConference on Empirical Methods in Natural Language Processing (EMNLP)Freda Shi, Daniel Fried, Marjan Ghazvininejad, et al.2022 · 116 citations
  16. Inspecting and Editing Knowledge Representations in Language ModelsarXiv:2304.00740Evan Hernandez, Belinda Z. Li, Jacob Andreas2023 · 115 citations
  17. Ground-Truth Labels Matter: A Deeper Look into Input-Label DemonstrationsConference on Empirical Methods in Natural Language Processing (EMNLP)Kang Min Yoo, Junyeob Kim, Hyuhng Joon Kim, et al.2022 · 114 citations
  18. Efficient Large Scale Language Modeling with Mixtures of ExpertsarXiv:2112.10684Mikel Artetxe, Shruti Bhosale, Naman Goyal, et al.2021 · 113 citations
  19. EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt OptimizersarXiv:2309.08532Qingyan Guo, Rui Wang, Junliang Guo, et al.2023 · 111 citations
  20. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
  21. LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA CompositionarXiv:2307.13269Chengsong Huang, Qian Liu, Bill Yuchen Lin, et al.2023 · 108 citations
  22. BLOOM+1: Adding Language Support to BLOOM for Zero-Shot PromptingAnnual Meeting of the Association for Computational Linguistics (ACL)Zheng Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, et al.2023 · 102 citations
  23. PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt OptimizationarXiv:2310.16427Xinyuan Wang, Chenxi Li, Zhen Wang, et al.2023 · 102 citations
  24. CPM-2: Large-scale Cost-effective Pre-trained Language ModelsAI OpenZhengyan Zhang, Yuxian Gu, Xu Han, et al.2021 · 102 citations
  25. Rationale-Augmented Ensembles in Language ModelsarXiv:2207.00747Xuezhi Wang, Jason Wei, Dale Schuurmans, et al.2022 · 101 citations
  26. LoRA+: Efficient Low Rank Adaptation of Large ModelsarXiv:2402.12354Soufiane Hayou, Nikhil Ghosh, Bin Yu2024 · 97 citations
  27. Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank AdaptationarXiv:2305.15011Haonan Li, Fajri Koto, Minghao Wu, et al.2023 · 96 citations
  28. True Few-Shot Learning with Prompts–-A Real-World PerspectiveTransactions of the Association for Computational Linguistics (TACL)Timo Schick, Hinrich Schütze2022 · 96 citations
  29. LoRAMoE: Alleviating World Knowledge Forgetting in Large Language Models via MoE-Style PluginAnnual Meeting of the Association for Computational Linguistics (ACL)Shihan Dou, Enyu Zhou, Yan Liu, et al.2024 · 93 citations
  30. AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language ModelsarXiv:2310.15140Sicheng Zhu, Ruiyi Zhang, Bang An, et al.2023 · 90 citations
  31. Task Contamination: Language Models May Not Be Few-Shot AnymoreProceedings of the AAAI Conference on Artificial IntelligenceChangmao Li, Jeffrey Flanigan2023 · 89 citations
  32. A Survey of Large Language Models in Medicine: Progress, Application, and ChallengearXiv:2311.05112Hongjian Zhou, Fenglin Liu, Boyang Gu, et al.2023 · 87 citations
  33. Democratizing Large Language Models via Personalized Parameter-Efficient Fine-tuningConference on Empirical Methods in Natural Language Processing (EMNLP)Zhaoxuan Tan, Qingkai Zeng, Yijun Tian, et al.2024 · 86 citations
  34. PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language ModelsarXiv:2404.02948Fanxu Meng, Zhaohui Wang, Muhan Zhang2024 · 86 citations
  35. Multi-lingual Evaluation of Code Generation ModelsarXiv:2210.14868Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, et al.2022 · 86 citations
  36. On Prompt-Driven Safeguarding for Large Language ModelsarXiv:2401.18018Chujie Zheng, Fan Yin, Hao Zhou, et al.2024 · 85 citations
  37. Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMarXiv:2303.01911Rachel Bawden, François Yvon2023 · 85 citations
  38. Finding Skill Neurons in Pre-trained Transformer-based Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, et al.2022 · 85 citations
  39. AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelarXiv:2208.01448Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.2022 · 84 citations
  40. Large Language Model Instruction Following: A Survey of Progresses and ChallengesComputational LinguisticsRenze Lou, Kai Zhang, Wenpeng Yin2024 · 83 citations
  41. Talk like a Graph: Encoding Graphs for Large Language ModelsarXiv:2310.04560Bahare Fatemi, Jonathan Halcrow, Bryan Perozzi2023 · 81 citations
  42. S-LoRA: Serving Thousands of Concurrent LoRA AdaptersMLSys 2024Ying Sheng, Shiyi Cao, Dacheng Li, et al.2023 · 80 citations
  43. Tuning Language Models by ProxyarXiv:2401.08565Alisa Liu, Xiaochuang Han, Yizhong Wang, et al.2024 · 79 citations
  44. CODI: Compressing Chain-of-Thought into Continuous Space via Self-DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Zhenyi Shen, Hanqi Yan, Linhai Zhang, et al.2025 · 78 citations
  45. Language models are not naysayers: An analysis of language models on negation benchmarksJoint Conference on Lexical and Computational Semantics (*SEM)Thinh Hung Truong, Timothy Baldwin, Karin Verspoor, et al.2023 · 78 citations
  46. Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft PromptingFindings of the Association for Computational LinguisticsChen Chen, Yufei Wang, Aixin Sun, et al.2023 · 75 citations
  47. What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
  48. Black-Box Prompt Optimization: Aligning Large Language Models without Model TrainingAnnual Meeting of the Association for Computational Linguistics (ACL)Jiale Cheng, Xiao Liu, Kehan Zheng, et al.2024 · 72 citations
  49. Skeleton-of-Thought: Prompting LLMs for Efficient Parallel GenerationarXiv:2307.15337Xuefei Ning, Zinan Lin, Zixuan Zhou, et al.2023 · 72 citations
  50. Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive TasksConference on Neural Information Processing Systems (NeurIPS)Minki Kang, Seanie Lee, Jinheon Baek, et al.2023 · 71 citations
  51. Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction TuningarXiv:2309.05444Ted Zadouri, Ahmet Ustun, Arash Ahmadian, et al.2023 · 69 citations
  52. Questions Are All You Need to Train a Dense Passage RetrieverTransactions of the Association for Computational Linguistics (TACL)Devendra Singh Sachan, Mike Lewis, Dani Yogatama, et al.2023 · 65 citations
  53. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
  54. Evaluation of OpenAI o1: Opportunities and Challenges of AGIarXiv:2409.18486Tianyang Zhong, Zhengliang Liu, Yi Pan, et al.2024 · 64 citations
  55. Learning From Mistakes Makes LLM Better ReasonerarXiv:2310.20689Shengnan An, Zexiong Ma, Zeqi Lin, et al.2023 · 64 citations
  56. Exploring the Benefits of Training Expert Language Models over Instruction TuningarXiv:2302.03202Joel Jang, Seungone Kim, Seonghyeon Ye, et al.2023 · 63 citations
  57. ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language ModelsarXiv:2305.18323Binfeng Xu, Zhiyuan Peng, Bowen Lei, et al.2023 · 61 citations
  58. Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task ArithmeticAnnual Meeting of the Association for Computational Linguistics (ACL)Rishabh Bhardwaj, Duc Anh Do, Soujanya Poria2024 · 59 citations
  59. SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yige Xu, Xu Guo, Zhiwei Zeng, et al.2025 · 58 citations
  60. LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuningarXiv:2308.03303Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.2023 · 58 citations
  61. In-context Learning with Retrieved Demonstrations for Language Models: A SurveyarXiv:2401.11624Man Luo, Xin Xu, Yue Liu, et al.2024 · 54 citations
  62. The Learnability of In-Context LearningConference on Neural Information Processing Systems (NeurIPS)Noam Wies, Yoav Levine, Amnon Shashua2023 · 53 citations
  63. From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
  64. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
  65. Parameter-Efficient Fine-Tuning Design SpacesarXiv:2301.01821Jiaao Chen, Aston Zhang, Xingjian Shi, et al.2023 · 47 citations
  66. AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-TuningTransactions of the Association for Computational Linguistics (TACL)Han Zhou, Xingchen Wan, Ivan Vulić, et al.2024 · 46 citations
  67. “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training DataConference of the European Chapter of the Association for Computational Linguistics (EACL)Orion Weller, Marc Marone, Nathaniel Weir, et al.2024 · 46 citations
  68. DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation RecognitionFindings of the Association for Computational LinguisticsChunkit Chan, Xin Liu, Jiayang Cheng, et al.2023 · 45 citations
  69. QAmeleon: Multilingual QA with Only 5 ExamplesTransactions of the Association for Computational Linguistics (TACL)Priyanka Agrawal, Chris Alberti, Fantine Huot, et al.2023 · 45 citations
  70. Transcending Scaling Laws with 0.1% Extra ComputearXiv:2210.11399Yi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 42 citations
  71. A Systematic Survey of Automatic Prompt Optimization TechniquesConference on Empirical Methods in Natural Language Processing (EMNLP)Kiran Ramnath, Kang Zhou, Sheng Guan, et al.2025 · 40 citations
  72. JASMINE: Arabic GPT Models for Few-Shot LearningConference on Empirical Methods in Natural Language Processing (EMNLP)El Moatez Billah Nagoudi, Muhammad Abdul-Mageed, AbdelRahim Elmadany, et al.2023 · 38 citations
  73. Aligning Large Language Models with Human Preferences through Representation EngineeringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhao Liu, Xiaohua Wang, Muling Wu, et al.2024 · 37 citations
  74. 500xCompressor: Generalized Prompt Compression for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zongqian Li, Yixuan Su, Nigel Collier2025 · 32 citations
  75. A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
  76. AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZInternational Conference on Learning Representations (ICLR)Jonas Belouadi, Anne Lauscher, Steffen Eger2023 · 31 citations
  77. The Life Cycle of Knowledge in Big Language Models: A SurveyarXiv:2303.07616 · Machine Intelligence Research. vol. 21, no. 2, pp. 217-238, 2024Boxi Cao, Hongyu Lin, Xianpei Han, et al.2023 · 31 citations
  78. LangBridge: Multilingual Reasoning Without Multilingual SupervisionAnnual Meeting of the Association for Computational Linguistics (ACL)Dongkeun Yoon, Joel Jang, Sungdong Kim, et al.2024 · 29 citations
  79. Multi-modal Stance Detection: New Datasets and ModelFindings of the Association for Computational LinguisticsBin Liang, Ang Li, Jingqian Zhao, et al.2024 · 28 citations
  80. Astraios: Parameter-Efficient Instruction Tuning Code Large Language ModelsarXiv:2401.00788Terry Yue Zhuo, Armel Zebaze, Nitchakarn Suppattarachai, et al.2024 · 21 citations
  81. MoRAL: MoE Augmented LoRA for LLMs' Lifelong LearningarXiv:2402.11260Shu Yang; Muhammad Asif Ali; Cheng-Long Wang; Lijie Hu;, Di Wang2024 · 21 citations
  82. Personality Alignment of Large Language ModelsarXiv:2408.11779Minjun Zhu, Yixuan Weng, Linyi Yang, et al.2024 · 21 citations
  83. ConnPrompt: Connective-cloze Prompt Learning for Implicit Discourse Relation RecognitionInternational Conference on Computational Linguistics (COLING)Wei Xiang, Zhenglin Wang, Lu Dai, et al.2022 · 21 citations
  84. DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic RulesYanchen Liu, William Held, Diyi Yang2023 · 20 citations
  85. Few-Shot Anaphora Resolution in Scientific Protocols via Mixtures of In-Context ExpertsFindings of the Association for Computational LinguisticsNghia T. Le, Fan Bai, Alan Ritter2022 · 20 citations
  86. Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation RecognitionAnnual Meeting of the Association for Computational Linguistics (ACL)Haodong Zhao, Ruifang He, Mengnan Xiao, et al.2023 · 19 citations
  87. Zero-Shot Chain-of-Thought Reasoning Guided by Evolutionary Algorithms in Large Language ModelsLecture notes in computer scienceFeihu Jin, Yifan Liu, Ying Tan2024 · 18 citations
  88. Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Zihan Wang, Deli Chen, Damai Dai, et al.2024 · 17 citations
  89. Soft Prompting for Unlearning in Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Karuna Bhaila, Minh-Hao Van, Xintao Wu2025 · 16 citations
  90. StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style ElementsJillian Fisher, Skyler Hallinan, Ximing Lu, et al.2024 · 16 citations
  91. MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought ReasoningarXiv:2505.20096Thang Nguyen, Peter Chin, Yu-Wing Tai2025 · 14 citations
  92. UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter Efficient Fine-Tuning of Large ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Xueyan Zhang, Jinman Zhao, Zhifei Yang, et al.2025 · 14 citations
  93. ConPET: Continual Parameter-Efficient Tuning for Large Language ModelsarXiv:2309.14763Chenyang Song, Xu Han, Zheni Zeng, et al.2023 · 14 citations
  94. LoRA-drop: Efficient LoRA Parameter Pruning based on Output EvaluationInternational Conference on Computational Linguistics (COLING)Hongyun Zhou, Xiangyu Lu, Wang Xu, et al.2025 · 12 citations
  95. Explaining Relationships Among Research PapersInternational Conference on Computational Linguistics (COLING)Xiangci Li, Jessica Ouyang2025 · 11 citations
  96. FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language ModelsInternational Conference on Computational Linguistics (COLING)Tao Fan, Guoqiang Ma, Yan Kang, et al.2025 · 10 citations
  97. Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language ModelInternational Conference on Computational Linguistics (COLING)Haoyun Xu, Runzhe Zhan, Yingpeng Ma, et al.2025 · 10 citations
  98. A Generative Approach for Mitigating Structural Biases in Natural Language InferenceJoint Conference on Lexical and Computational Semantics (*SEM)Dimion Asael, Zachary Ziegler, Yonatan Belinkov2022 · 10 citations
  99. Zero-shot and Few-shot Learning with Instruction-following LLMs for Claim Matching in Automated Fact-checkingInternational Conference on Computational Linguistics (COLING)Dina Pisarevskaya, Arkaitz Zubiaga2025 · 9 citations
  100. Taxonomy Tree Generation from Citation GrapharXiv:2410.03761Yuntong Hu, Zhuofeng Li, Zheng Zhang, et al.2024 · 9 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/lester-2021-power-scale-parameter-efficient-prompt/cited-by/page/2/