Who cites «Finetuned Language Models Are Zero-Shot Learners»
- Unlearn What You Want to Forget: Efficient Unlearning for LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Jiaao Chen, Diyi Yang2023 · 124 citations
- Mini-Gemini: Mining the Potential of Multi-modality Vision Language ModelsIEEE Transactions on Pattern Analysis and Machine IntelligenceYanwei Li, Yuechen Zhang, Chengyao Wang, et al.2024 · 123 citations
- Sleeper Agents: Training Deceptive LLMs that Persist Through Safety TrainingarXiv:2401.05566Evan Hubinger, Carson Denison, Jesse Mu, et al.2024 · 123 citations
- Quiet-STaR: Language models can teach themselves to think before speaking2024 · 122 citations
- ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft PromptsConference on Empirical Methods in Natural Language Processing (EMNLP)Akari Asai, Mohammadreza Salehi, Matthew Peters, et al.2022 · 122 citations
- The Alignment Problem from a Deep Learning PerspectivearXiv:2209.00626Richard Ngo, Lawrence Chan, Soren Mindermann2022 · 121 citations
- Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language ModelsarXiv:2501.09686Fengli Xu, Qianyue Hao, Zefang Zong, et al.2025 · 120 citations
- #InsTag: Instruction Tagging for Analyzing Supervised Fine-tuning of Large Language ModelsarXiv:2308.07074Keming Lu, Hongyi Yuan, Zheng Yuan, et al.2023 · 120 citations
- UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity RecognitionarXiv:2308.03279Wenxuan Zhou, Sheng Zhang, Yu Gu, et al.2023 · 120 citations
- Explanations from Large Language Models Make Small Reasoners BetterarXiv:2210.06726Shiyang Li, Jianshu Chen, Yelong Shen, et al.2022 · 120 citations
- Best Practices and Lessons Learned on Synthetic DataarXiv:2404.07503Ruibo Liu, Jerry Wei, Fangyu Liu, et al.2024 · 119 citations
- CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Zirui Wang, Mengzhou Xia, Luxi He, et al.2024 · 119 citations
- SaulLM-7B: A pioneering Large Language Model for LawarXiv:2403.03883Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, et al.2024 · 119 citations
- Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question AnsweringarXiv:2306.04136Jinheon Baek, Alham Fikri Aji, Amir Saffari2023 · 119 citations
- Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation ExtractorsFindings of the Association for Computational LinguisticsKai Zhang, Bernal Jimenez Gutierrez, Yu Su2023 · 118 citations
- ChatGPT or Grammarly? Evaluating ChatGPT on Grammatical Error Correction BenchmarkarXiv:2303.13648Haoran Wu, Wenxuan Wang, Yuxuan Wan, et al.2023 · 118 citations
- The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-TuningConference on Empirical Methods in Natural Language Processing (EMNLP)Seungone Kim, Se Joo, Doyoung Kim, et al.2023 · 118 citations
- Platypus: Quick, Cheap, and Powerful Refinement of LLMsarXiv:2308.07317Ariel N. Lee, Cole J. Hunter, Nataniel Ruiz2023 · 117 citations
- PandaGPT: One Model To Instruction-Follow Them AllarXiv:2305.16355Yixuan Su, Tian Lan, Huayang Li, et al.2023 · 115 citations
- In-context Autoencoder for Context Compression in a Large Language ModelarXiv:2307.06945Tao Ge, Jing Hu, Lei Wang, et al.2023 · 114 citations
- LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form SummarizationConference of the European Chapter of the Association for Computational Linguistics (EACL)Kalpesh Krishna, Erin Bransom, Bailey Kuehl, et al.2023 · 114 citations
- ExT5: Towards Extreme Multi-Task Scaling for Transfer LearningarXiv:2111.10952Vamsi Aribandi, Yi Tay, Tal Schuster, et al.2021 · 114 citations
- ALLaM: Large Language Models for Arabic and EnglisharXiv:2407.15390M Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
- GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLPConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tawkat Islam Khondaker, Abdul Waheed, El Moatez Billah Nagoudi, et al.2023 · 110 citations
- jina-embeddings-v3: Multilingual Embeddings With Task LoRAarXiv:2409.10173Saba Sturua, Isabelle Mohr, Mohammad Kalim Akram, et al.2024 · 109 citations
- RouteLLM: Learning to Route LLMs with Preference DataarXiv:2406.18665Isaac Ong, Amjad Almahairi, Vincent Wu, et al.2024 · 109 citations
- LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA CompositionarXiv:2307.13269Chengsong Huang, Qian Liu, Bill Yuchen Lin, et al.2023 · 108 citations
- Learning to Retrieve In-Context Examples for Large Language ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL)Liang Wang, Nan Yang, Furu Wei2024 · 106 citations
- Disentangling Length from Quality in Direct Preference OptimizationFindings of the Association for Computational LinguisticsRyan Park, Rafael Rafailov, Stefano Ermon, et al.2024 · 105 citations
- LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale InstructionsarXiv:2304.14402Minghao Wu, Abdul Waheed, Chiyu Zhang, et al.2023 · 105 citations
- Statistical Rejection Sampling Improves Preference OptimizationarXiv:2309.06657Tianqi Liu, Yao Zhao, Rishabh Joshi, et al.2023 · 105 citations
- Zero-Shot Listwise Document Reranking with a Large Language ModelarXiv:2305.02156Xueguang Ma, Xinyu Zhang, Ronak Pradeep, et al.2023 · 105 citations
- PolyLM: An Open Source Polyglot Large Language ModelarXiv:2307.06018Xiangpeng Wei, Haoran Wei, Huan Lin, et al.2023 · 103 citations
- FireAct: Toward Language Agent Fine-tuningarXiv:2310.05915Baian Chen, Chang Shu, Ehsan Shareghi, et al.2023 · 101 citations
- Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityarXiv:2401.05459Yuanchun Li, Hao Wen, Weijun Wang, et al.2024 · 100 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical ReasoningarXiv:2310.03731Ke Wang, Houxing Ren, Aojun Zhou, et al.2023 · 99 citations
- Sparse Upcycling: Training Mixture-of-Experts from Dense CheckpointsarXiv:2212.05055Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, et al.2022 · 98 citations
- Text and Patterns: For Effective Chain of Thought, It Takes Two to TangoarXiv:2209.07686Aman Madaan, Amir Yazdanbakhsh2022 · 98 citations
- Safety Alignment Should Be Made More Than Just a Few Tokens DeeparXiv:2406.05946Xiangyu Qi, Ashwinee Panda, Kaifeng Lyu, et al.2024 · 97 citations
- MAmmoTH2: Scaling Instructions from the WebConference on Neural Information Processing Systems (NeurIPS)Xiang Yue, Tuney Zheng, Ge Zhang, et al.2024 · 96 citations
- Bactrian-X: Multilingual Replicable Instruction-Following Models with Low-Rank AdaptationarXiv:2305.15011Haonan Li, Fajri Koto, Minghao Wu, et al.2023 · 96 citations
- True Few-Shot Learning with Prompts–-A Real-World PerspectiveTransactions of the Association for Computational Linguistics (TACL)Timo Schick, Hinrich Schütze2022 · 96 citations
- A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
- LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mihir Parmar, Nisarg Patel, Neeraj Varshney, et al.2024 · 93 citations
- Exploring the Potential of ChatGPT on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse RelationsFindings of the Association for Computational LinguisticsChunkit Chan, Cheng Jiayang, Weiqi Wang, et al.2024 · 92 citations
- WildTeaming at Scale: From In-the-Wild Jailbreaks to (Adversarially) Safer Language ModelsConference on Neural Information Processing Systems (NeurIPS)Liwei Jiang, Kavel Rao, Seungju Han, et al.2024 · 92 citations
- ChatHaruhi: Reviving Anime Character in Reality via Large Language ModelarXiv:2308.09597Cheng Li, Ziang Leng, Chenxi Yan, et al.2023 · 92 citations
- Proving Test Set Contamination in Black Box Language ModelsarXiv:2310.17623Yonatan Oren, Nicole Meister, Niladri Chatterji, et al.2023 · 92 citations
- Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language ModelsarXiv:2306.08018Yin Fang, Xiaozhuan Liang, Ningyu Zhang, et al.2023 · 91 citations
- Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable SurveyConference of the European Chapter of the Association for Computational Linguistics (EACL)Sachin Kumar, Vidhisha Balachandran, Lucille Njoo, et al.2023 · 90 citations
- Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewardsConference on Neural Information Processing Systems (NeurIPS)Alexandre Rame, Guillaume Couairon, Mustafa Shukor, et al.2023 · 90 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning AbilitiesConference on Empirical Methods in Natural Language Processing (EMNLP)Sreyan Ghosh, Sonal Kumar, Ashish Seth, et al.2024 · 87 citations
- SORRY-Bench: Systematically Evaluating Large Language Model Safety RefusalarXiv:2406.14598Tinghao Xie, Xiangyu Qi, Yi Zeng, et al.2024 · 87 citations
- Multilingual Large Language Models Are Not (Yet) Code-SwitchersConference on Empirical Methods in Natural Language Processing (EMNLP)Ruochen Zhang, Samuel Cahyawijaya, Jan Christian Blaise Cruz, et al.2023 · 86 citations
- PromptNER: Prompting For Named Entity RecognitionarXiv:2305.15444Dhananjay Ashok, Zachary C. Lipton2023 · 86 citations
- Solving Math Word Problems via Cooperative Reasoning induced Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Zhu, Junjie Wang, Lin Zhang, et al.2023 · 86 citations
- The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMsConference on Neural Information Processing Systems (NeurIPS)Laura Ruis, Akbir Khan, Stella Biderman, et al.2022 · 86 citations
- Benchmark Data Contamination of Large Language Models: A SurveyarXiv:2406.04244Cheng Xu, Shuhao Guan, Derek Greene, et al.2024 · 85 citations
- MathScale: Scaling Instruction Tuning for Mathematical ReasoningarXiv:2403.02884Zhengyang Tang, Xingxing Zhang, Benyou Wang, et al.2024 · 83 citations
- LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model DevelopmentAnnual Meeting of the Association for Computational Linguistics (ACL)Ilias Chalkidis, Nicolas Garneau, Catalina Goanta, et al.2023 · 83 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- Interpretability at Scale: Identifying Causal Mechanisms in AlpacaConference on Neural Information Processing Systems (NeurIPS)Zhengxuan Wu, Atticus Geiger, Thomas Icard, et al.2023 · 81 citations
- Multilingual Instruction Tuning With Just a Pinch of MultilingualityFindings of the Association for Computational LinguisticsUri Shaham, Jonathan Herzig, Roee Aharoni, et al.2024 · 78 citations
- FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation ResearcharXiv:2405.13576Jiajie Jin, Yutao Zhu, Guanting Dong, et al.2024 · 77 citations
- Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing ExaminationsarXiv:2303.18027Jungo Kasai, Yuhei Kasai, Keisuke Sakaguchi, et al.2023 · 77 citations
- SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-ScalingarXiv:2312.15166Dahyun Kim, Chanjun Park, Sanghoon Kim, et al.2023 · 77 citations
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model EvaluatorsarXiv:2403.16950Yinhong Liu, Han Zhou, Zhijiang Guo, et al.2024 · 76 citations
- Analyzing Dataset Annotation Quality Management in the WildComputational LinguisticsJan-Christoph Klie, Richard Eckart de Castilho, Iryna Gurevych2024 · 76 citations
- GPT4Graph: Can Large Language Models Understand Graph Structured Data ? An Empirical Evaluation and BenchmarkingarXiv:2305.15066Jiayan Guo, Lun Du, Hengyu Liu, et al.2023 · 75 citations
- Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text IntegrationarXiv:2306.09093Chenyang Lyu, Minghao Wu, Longyue Wang, et al.2023 · 75 citations
- Dynamic Early Exit in Reasoning ModelsarXiv:2504.15895Chenxu Yang, Qingyi Si, Yongjie Duan, et al.2025 · 74 citations
- Instruction Mining: Instruction Data Selection for Tuning Large Language ModelsarXiv:2307.06290Yihan Cao, Yanbin Kang, Chi Wang, et al.2023 · 74 citations
- Large Language Models as Analogical ReasonersarXiv:2310.01714Michihiro Yasunaga, Xinyun Chen, Yujia Li, et al.2023 · 74 citations
- Benchmarking Benchmark Leakage in Large Language ModelsarXiv:2404.18824Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.2024 · 73 citations
- What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
- Skeleton-of-Thought: Prompting LLMs for Efficient Parallel GenerationarXiv:2307.15337Xuefei Ning, Zinan Lin, Zixuan Zhou, et al.2023 · 72 citations
- InPars: Data Augmentation for Information Retrieval using Large Language ModelsarXiv:2202.05144Luiz Bonifacio, Hugo Abonizio, Marzieh Fadaee, et al.2022 · 72 citations
- The Ghost in the Machine has an American accent: value conflict in GPT-3arXiv:2203.07785Rebecca L Johnson, Giada Pistilli, Natalia Menedez-Gonzalez, et al.2022 · 72 citations
- Extrapolating Large Language Models to Non-English by Aligning LanguagesarXiv:2308.04948Wenhao Zhu, Yunzhe Lv, Qingxiu Dong, et al.2023 · 71 citations
- Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-Intensive TasksConference on Neural Information Processing Systems (NeurIPS)Minki Kang, Seanie Lee, Jinheon Baek, et al.2023 · 71 citations
- Lion: Adversarial Distillation of Proprietary Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxin Jiang, Chunkit Chan, Mingyang Chen, et al.2023 · 70 citations
- Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language ModelsarXiv:2305.14705Sheng Shen, Le Hou, Yanqi Zhou, et al.2023 · 70 citations
- Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction TuningarXiv:2309.05444Ted Zadouri, Ahmet Ustun, Arash Ahmadian, et al.2023 · 69 citations
- Model Editing Harms General Abilities of Large Language Models: Regularization to the RescueConference on Empirical Methods in Natural Language Processing (EMNLP)Jia-Chen Gu, Hao-Xiang Xu, Jun-Yu Ma, et al.2024 · 67 citations
- On Context Utilization in Summarization with Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mathieu Ravaut, Aixin Sun, Nancy Chen, et al.2024 · 67 citations
- On the Effects of Data Scale on UI Control AgentsConference on Neural Information Processing Systems (NeurIPS)Wei Li, William Bishop, Alice Li, et al.2024 · 67 citations
- Learning by Distilling ContextarXiv:2209.15189Charlie Snell, Dan Klein, Ruiqi Zhong2022 · 67 citations
- Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank ModificationsarXiv:2402.05162Boyi Wei, Kaixuan Huang, Yangsibo Huang, et al.2024 · 66 citations
- MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Chia-Yuan Chang, Zhimeng Jiang, Vineeth Rakesh, et al.2025 · 65 citations
- Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language ModelsarXiv:2402.13064Haoran Li, Qingxiu Dong, Zhengyang Tang, et al.2024 · 65 citations
- Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-JudgeConference on Empirical Methods in Natural Language Processing (EMNLP)Tianhao Wu, Weizhe Yuan, Olga Golovneva, et al.2025 · 64 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Exploring the Benefits of Training Expert Language Models over Instruction TuningarXiv:2302.03202Joel Jang, Seungone Kim, Seonghyeon Ye, et al.2023 · 63 citations
- Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
- SatLM: Satisfiability-Aided Language Models Using Declarative PromptingConference on Neural Information Processing Systems (NeurIPS)Xi Ye, Qiaochu Chen, Isil Dillig, et al.2023 · 62 citations
- One-Shot Learning as Instruction Data Prospector for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yunshui Li, Binyuan Hui, Xiaobo Xia, et al.2024 · 61 citations
- Teaching Large Language Models to Reason with Reinforcement LearningarXiv:2403.04642Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, et al.2024 · 61 citations
- MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language BenchmarkarXiv:2402.04788Dongping Chen, Ruoxi Chen, Shilin Zhang, et al.2024 · 60 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/wei-2021-finetuned-language-models-zero-shot/cited-by/page/3/