Who cites «What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?»
- Emergent Abilities of Large Language ModelsarXiv:2206.07682Jason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,269 citations
- Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,246 citations
- Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
- The Flan Collection: Designing Data and Methods for Effective Instruction TuningarXiv:2301.13688Shayne Longpre, Le Hou, Tu Vu, et al.2023 · 607 citations
- The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
- Large Language Models Struggle to Learn Long-Tail KnowledgearXiv:2211.08411Nikhil Kandpal, Haikang Deng, Adam Roberts, et al.2022 · 366 citations
- UL2: Unifying Language Learning ParadigmsarXiv:2205.05131Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 347 citations
- Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
- Efficient Training of Language Models to Fill in the MiddlearXiv:2207.14255Mohammad Bavarian, Heewoo Jun, Nikolas Tezak, et al.2022 · 144 citations
- Scaling Up Models and Data with t5x and seqioarXiv:2203.17189Adam Roberts, Hyung Won Chung, Anselm Levskaya, et al.2022 · 130 citations
- A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & ToxicityarXiv:2305.13169Shayne Longpre, Gregory Yauney, Emily Reif, et al.2023 · 104 citations
- FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
- Benchmark Data Contamination of Large Language Models: A SurveyarXiv:2406.04244Cheng Xu, Shuhao Guan, Derek Greene, et al.2024 · 85 citations
- AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelarXiv:2208.01448Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.2022 · 84 citations
- What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
- Transcending Scaling Laws with 0.1% Extra ComputearXiv:2210.11399Yi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 42 citations
- TADA : Task Agnostic Dialect Adapters for EnglishFindings of the Association for Computational LinguisticsWilliam Held, Caleb Ziems, Diyi Yang2023 · 17 citations
- Just read twice: closing the recall gap for recurrent language modelsarXiv:2407.05483Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re2024 · 8 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/cited-by/