Elamur Research⌕
☰
home / papers / QLoRA: Efficient Finetuning of Quantized LLMs / cited by

Who cites «QLoRA: Efficient Finetuning of Quantized LLMs»

1,501 papers of our library cite it (of the 149,439 whose bibliographies we read) · 202 with a page here, the most cited first · page 1 of 3 · 1–100 · ← back to «QLoRA: Efficient Finetuning of Quantized LLMs»

1 2 3

  1. Judging LLM-as-a-Judge with MT-Bench and Chatbot ArenaConference on Neural Information Processing Systems (NeurIPS)Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, et al.2023 · 4,573 citations
  2. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
  3. Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
  4. A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
  5. LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yaowei Zheng, Richong Zhang, Junhao Zhang, et al.2024 · 1,048 citations
  6. Universal and Transferable Adversarial Attacks on Aligned Language ModelsarXiv:2307.15043Andy Zou, Zifan Wang, Nicholas Carlini, et al.2023 · 1,005 citations
  7. Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
  8. MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsarXiv:2309.12284Longhui Yu, Weisen Jiang, Han Shi, et al.2023 · 565 citations
  9. Instruction Tuning for Large Language Models: A SurveyACM Computing SurveysShengyu Zhang, Linfeng Dong, Xiaoya Li, et al.2023 · 520 citations
  10. Large Language Models: A SurveyarXiv:2402.06196Shervin Minaee, Tomas Mikolov, Narjes Nikzad, et al.2024 · 471 citations
  11. FinGPT: Open-Source Financial Large Language ModelsarXiv:2306.06031Hongyang Yang, Xiao-Yang Liu, Christina Dan Wang2023 · 445 citations
  12. AgentBench: Evaluating LLMs as AgentsarXiv:2308.03688Xiao Liu, Hao Yu, Hanchen Zhang, et al.2023 · 432 citations
  13. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsFindings of the Association for Computational LinguisticsYanis Labrak, Adrien Bazoge, Emmanuel Morin, et al.2024 · 409 citations
  14. A Survey on Model Compression for Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Xunyu Zhu, Jian Li, Yong Liu, et al.2024 · 381 citations
  15. A Survey on Large Language Models for Code GenerationarXiv:2406.00515Juyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 367 citations
  16. AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language ModelsarXiv:2310.04451Xiaogeng Liu, Nan Xu, Muhao Chen, et al.2023 · 350 citations
  17. Large Language Models for Information Retrieval: A SurveyACM Transactions on Information SystemsYutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen2023 · 339 citations
  18. MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
  19. How Far Can Camels Go? Exploring the State of Instruction Tuning on Open ResourcesConference on Neural Information Processing Systems (NeurIPS)Yizhong Wang, Hamish Ivison, Pradeep Dasigi, et al.2023 · 317 citations
  20. MEDITRON-70B: Scaling Medical Pretraining for Large Language ModelsarXiv:2311.16079Zeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.2023 · 315 citations
  21. Multi-step Jailbreaking Privacy Attacks on ChatGPTFindings of the Association for Computational LinguisticsHaoran Li, Dadi Guo, Wei Fan, et al.2023 · 304 citations
  22. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
  23. MAmmoTH: Building Math Generalist Models through Hybrid Instruction TuningarXiv:2309.05653Xiang Yue, Xingwei Qu, Ge Zhang, et al.2023 · 295 citations
  24. KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache QuantizationConference on Neural Information Processing Systems (NeurIPS)Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.2024 · 294 citations
  25. Efficient and Effective Text Encoding for Chinese LLaMA and AlpacaarXiv:2304.08177Yiming Cui, Ziqing Yang, Xin Yao2023 · 287 citations
  26. Chatlaw: A Multi-Agent Legal Assistant based on a Role-Aligned Mixture-of-Experts ArchitecturearXiv:2306.16092Jiaxi Cui; Munan Ning; Zongjian Li; Bohua Chen; Yang Yan; Hao Li; Bin Ling; Yonghong Tian;, Li Yuan2023 · 248 citations
  27. Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyarXiv:2403.14608Zeyu Han, Chao Gao, Jinyang Liu, et al.2024 · 240 citations
  28. TrustLLM: Trustworthiness in Large Language ModelsarXiv:2401.05561Yue Huang, Lichao Sun, Haoran Wang, et al.2024 · 237 citations
  29. Baseline Defenses for Adversarial Attacks Against Aligned Language ModelsarXiv:2309.00614Neel Jain, Avi Schwarzschild, Yuxin Wen, et al.2023 · 236 citations
  30. Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2arXiv:2311.10702Hamish Ivison, Yizhong Wang, Valentina Pyatkin, et al.2023 · 207 citations
  31. Aligning Large Language Models with Human: A SurveyarXiv:2307.12966Yufei Wang, Wanjun Zhong, Liangyou Li, et al.2023 · 202 citations
  32. Making Retrieval-Augmented Language Models Robust to Irrelevant ContextarXiv:2310.01558Ori Yoran, Tomer Wolfson, Ori Ram, et al.2023 · 195 citations
  33. OmniQuant: Omnidirectionally Calibrated Quantization for Large Language ModelsarXiv:2308.13137Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.2023 · 195 citations
  34. OpenChat: Advancing Open-source Language Models with Mixed-Quality DataarXiv:2309.11235Guan Wang, Sijie Cheng, Xianyuan Zhan, et al.2023 · 174 citations
  35. ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectarXiv:2403.03853Xin Men, Mingyu Xu, Qingyu Zhang, et al.2024 · 170 citations
  36. SqueezeLLM: Dense-and-Sparse QuantizationarXiv:2306.07629Sehoon Kim, Coleman Hooper, Amir Gholami, et al.2023 · 170 citations
  37. Interpretable Long-Form Legal Question Answering with Retrieval-Augmented Large Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceAntoine Louis, Gijs van Dijck, Gerasimos Spanakis2023 · 157 citations
  38. OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceChanghun Lee, Jungyu Jin, Taesu Kim, et al.2023 · 149 citations
  39. Self-Alignment with Instruction BacktranslationarXiv:2308.06259Xian Li, Ping Yu, Chunting Zhou, et al.2023 · 139 citations
  40. Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow InstructionsarXiv:2309.07875Federico Bianchi, Mirac Suzgun, Giuseppe Attanasio, et al.2023 · 135 citations
  41. A Survey on Recent Advances in LLM-Based Multi-turn Dialogue SystemsACM Computing SurveysZihao Yi, Jiarui Ouyang, Zhe Xu, et al.2024 · 130 citations
  42. Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-TuningarXiv:2303.15647Vladislav Lialin, Vijeta Deshpande, Xiaowei Yao, et al.2023 · 129 citations
  43. SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware DecodingAnnual Meeting of the Association for Computational Linguistics (ACL)Zhangchen Xu, Fengqing Jiang, Luyao Niu, et al.2024 · 127 citations
  44. Scaling Sentence Embeddings with Large Language ModelsFindings of the Association for Computational LinguisticsTing Jiang, Shaohan Huang, Zhongzhi Luan, et al.2024 · 127 citations
  45. Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
  46. Quantifying the Persona Effect in LLM SimulationsAnnual Meeting of the Association for Computational Linguistics (ACL)Tiancheng Hu, Nigel Collier2024 · 116 citations
  47. GoLLIE: Annotation Guidelines improve Zero-Shot Information-ExtractionarXiv:2310.03668Oscar Sainz, Iker Garcia-Ferrero, Rodrigo Agerri, et al.2023 · 114 citations
  48. FireAct: Toward Language Agent Fine-tuningarXiv:2310.05915Baian Chen, Chang Shu, Ehsan Shareghi, et al.2023 · 101 citations
  49. FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
  50. VeRA: Vector-based Random Matrix AdaptationarXiv:2310.11454Dawid J. Kopiczko, Tijmen Blankevoort, Yuki M. Asano2023 · 99 citations
  51. “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language ModelsFindings of the Association for Computational LinguisticsXinpeng Wang, Bolei Ma, Chengzhi Hu, et al.2024 · 91 citations
  52. Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
  53. Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
  54. EfficientQAT: Efficient Quantization-Aware Training for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhao Chen, Wenqi Shao, Peng Xu, et al.2025 · 82 citations
  55. Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
  56. AutoRE: Document-Level Relation Extraction with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Lilong Xue, Dan Zhang, Yuxiao Dong, et al.2024 · 79 citations
  57. Multilingual Instruction Tuning With Just a Pinch of MultilingualityFindings of the Association for Computational LinguisticsUri Shaham, Jonathan Herzig, Roee Aharoni, et al.2024 · 78 citations
  58. Systematic Biases in LLM Simulations of DebatesConference on Empirical Methods in Natural Language Processing (EMNLP)Amir Taubenfeld, Yaniv Dover, Roi Reichart, et al.2024 · 76 citations
  59. ReLoRA: High-Rank Training Through Low-Rank UpdatesarXiv:2307.05695Vladislav Lialin, Namrata Shivagunde, Sherin Muckatira, et al.2023 · 74 citations
  60. The Unreasonable Ineffectiveness of the Deeper LayersarXiv:2403.17887Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.2024 · 71 citations
  61. Aligning Large and Small Language Models via Chain-of-Thought ReasoningConference of the European Chapter of the Association for Computational Linguistics (EACL)Leonardo Ranaldi, Andre Freitas2024 · 70 citations
  62. xLAM: A Family of Large Action Models to Empower AI Agent SystemsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Jianguo Zhang, Tian Lan, Ming Zhu, et al.2025 · 68 citations
  63. A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
  64. Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language ModelsFindings of the Association for Computational LinguisticsZehui Chen, Kuikun Liu, Qiuchen Wang, et al.2024 · 64 citations
  65. Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-TuningarXiv:2402.00530Ming Li, Yong Zhang, Shwai He, et al.2024 · 60 citations
  66. LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuningarXiv:2308.03303Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.2023 · 58 citations
  67. In-context Learning with Retrieved Demonstrations for Language Models: A SurveyarXiv:2401.11624Man Luo, Xin Xu, Yue Liu, et al.2024 · 54 citations
  68. SALMON: Self-Alignment with Instructable Reward ModelsarXiv:2310.05910Zhiqing Sun, Yikang Shen, Hongxin Zhang, et al.2023 · 41 citations
  69. Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
  70. Self-Refine Instruction-Tuning for Aligning Reasoning in Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Leonardo Ranaldi, Andre Freitas2024 · 35 citations
  71. Towards Cross-Tokenizer Distillation: the Universal Logit Distillation Loss for LLMsarXiv:2402.12030 · Transactions on Machine Learning Research, January 2025Nicolas Boizard, Kevin El Haddad, Celine Hudelot, et al.2024 · 35 citations
  72. A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
  73. AutomaTikZ: Text-Guided Synthesis of Scientific Vector Graphics with TikZInternational Conference on Learning Representations (ICLR)Jonas Belouadi, Anne Lauscher, Steffen Eger2023 · 31 citations
  74. CIDAR: Culturally Relevant Instruction Dataset For ArabicFindings of the Association for Computational LinguisticsZaid Alyafeai, Khalid Almubarak, Ahmed Ashraf, et al.2024 · 30 citations
  75. MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media TextsAnnual Meeting of the Association for Computational Linguistics (ACL)Dominik Macko, Jakub Kopál, Robert Moro, et al.2025 · 28 citations
  76. SAC3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check ConsistencyarXiv:2311.01740Jiaxin Zhang, Zhuohang Li, Kamalika Das, et al.2023 · 28 citations
  77. Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
  78. SemEval-2026 Task 11: Disentangling Content and Formal Reasoning in Large Language ModelsInternational Workshop on Semantic Evaluation (SemEval)Marco Valentino, Leonardo Ranaldi, Giulia Pucci, et al.2026 · 22 citations
  79. Personality Alignment of Large Language ModelsarXiv:2408.11779Minjun Zhu, Yixuan Weng, Linyi Yang, et al.2024 · 21 citations
  80. CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and AugmentationTransactions of the Association for Computational Linguistics (TACL)Ingo Ziegler, Abdullatif Köksal, Desmond Elliott, et al.2025 · 20 citations
  81. Can we obtain significant success in RST discourse parsing by using Large Language Models?Conference of the European Chapter of the Association for Computational Linguistics (EACL)Aru Maekawa, Tsutomu Hirao, Hidetaka Kamigaito, et al.2024 · 19 citations
  82. Soft Prompting for Unlearning in Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Karuna Bhaila, Minh-Hao Van, Xintao Wu2025 · 16 citations
  83. Analyzing and Adapting Large Language Models for Few-Shot Multilingual NLU: Are We There Yet?Transactions of the Association for Computational Linguistics (TACL)Evgeniia Razumovskaia, Ivan Vulić, Anna Korhonen2025 · 15 citations
  84. L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hyesung Jeon, Yulhwa Kim, Jae-Joon Kim2025 · 15 citations
  85. MAPoRL: Multi-Agent Post-Co-Training for Collaborative Large Language Models with Reinforcement LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Chanwoo Park, Seungju Han, Xingzhi Guo, et al.2025 · 15 citations
  86. Language Resources for Dutch Large Language ModellingarXiv:2312.12852Bram Vanroy2023 · 15 citations
  87. MA-RAG: Multi-Agent Retrieval-Augmented Generation via Collaborative Chain-of-Thought ReasoningarXiv:2505.20096Thang Nguyen, Peter Chin, Yu-Wing Tai2025 · 14 citations
  88. UORA: Uniform Orthogonal Reinitialization Adaptation in Parameter Efficient Fine-Tuning of Large ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Xueyan Zhang, Jinman Zhao, Zhifei Yang, et al.2025 · 14 citations
  89. Analyzing Multilingual Competency of LLMs in Multi-Turn Instruction Following: A Case Study of ArabicArabic Natural Language Processing Conference (ArabicNLP)Sabri Boughorbel, Majd Hawasly2023 · 14 citations
  90. TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in LLMs through Translation-Assisted Chain-of-Thought ProcessesarXiv:2311.10797Bibek Upadhayay, Vahid Behzadan2023 · 14 citations
  91. Can a Single Model Master Both Multi-turn Conversations and Tool Use? CoALM: A Unified Conversational Agentic Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Emre Can Acikgoz, Jeremiah Greer, Akul Datta, et al.2025 · 13 citations
  92. What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific PresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Dongqi Liu, Chenxi Whitehouse, Xi Yu, et al.2025 · 13 citations
  93. LoRA-drop: Efficient LoRA Parameter Pruning based on Output EvaluationInternational Conference on Computational Linguistics (COLING)Hongyun Zhou, Xiangyu Lu, Wang Xu, et al.2025 · 12 citations
  94. Learning from Diverse Reasoning Paths with Routing and CollaborationConference on Empirical Methods in Natural Language Processing (EMNLP)Zhenyu Lei, Zhen Tan, Song Wang, et al.2025 · 11 citations
  95. Can LLMs assist with Ambiguity? A Quantitative Evaluation of various Large Language Models on Word Sense DisambiguationarXiv:2411.18337T.G.D.K. Sumanathilaka, Nicholas Micallef, Julian Hough2024 · 11 citations
  96. Mixed Distillation Helps Smaller Language Model Better ReasoningarXiv:2312.10730Chenglin Li, Qianglong Chen, Liangyue Li, et al.2023 · 11 citations
  97. QU-NLP at QIAS 2025 Shared Task: A Two-Phase LLM Fine-Tuning and Retrieval-Augmented Generation Approach for Islamic Inheritance ReasoningArabic Natural Language Processing Conference (ArabicNLP)Mohammad AL-Smadi2025 · 10 citations
  98. Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMsInternational Conference on Computational Linguistics (COLING)Tamzeed Mahfuz, Satak Kumar Dey, Ruwad Naswan, et al.2025 · 10 citations
  99. RGR-KBQA: Generating Logical Forms for Question Answering Using Knowledge-Graph-Enhanced Large Language ModelInternational Conference on Computational Linguistics (COLING)Tengfei Feng, Liang He2025 · 9 citations
  100. Arabic Automatic Story Generation with Large Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Ahmed Oumar El-Shangiti, Fakhraddin Alwajih, Muhammad Abdul-Mageed2024 · 9 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/dettmers-2023-qlora-efficient-finetuning-quantized-llms/cited-by/