Elamur Research⌕
☰
home / papers / What Language Model Architecture and Pretraining… / cited by

Who cites «What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?»

40 papers of our library cite it (of the 149,439 whose bibliographies we read) · 18 with a page here, the most cited first · ← back to «What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization?»

  1. Emergent Abilities of Large Language ModelsarXiv:2206.07682Jason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,269 citations
  2. Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,246 citations
  3. Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
  4. The Flan Collection: Designing Data and Methods for Effective Instruction TuningarXiv:2301.13688Shayne Longpre, Le Hou, Tu Vu, et al.2023 · 607 citations
  5. The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
  6. Large Language Models Struggle to Learn Long-Tail KnowledgearXiv:2211.08411Nikhil Kandpal, Haikang Deng, Adam Roberts, et al.2022 · 366 citations
  7. UL2: Unifying Language Learning ParadigmsarXiv:2205.05131Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 347 citations
  8. Generative Representational Instruction TuningarXiv:2402.09906Niklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 172 citations
  9. Efficient Training of Language Models to Fill in the MiddlearXiv:2207.14255Mohammad Bavarian, Heewoo Jun, Nikolas Tezak, et al.2022 · 144 citations
  10. Scaling Up Models and Data with t5x and seqioarXiv:2203.17189Adam Roberts, Hyung Won Chung, Anselm Levskaya, et al.2022 · 130 citations
  11. A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & ToxicityarXiv:2305.13169Shayne Longpre, Gregory Yauney, Emily Reif, et al.2023 · 104 citations
  12. FLASK: Fine-grained Language Model Evaluation based on Alignment Skill SetsarXiv:2307.10928Seonghyeon Ye, Doyoung Kim, Sungdong Kim, et al.2023 · 100 citations
  13. Benchmark Data Contamination of Large Language Models: A SurveyarXiv:2406.04244Cheng Xu, Shuhao Guan, Derek Greene, et al.2024 · 85 citations
  14. AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelarXiv:2208.01448Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.2022 · 84 citations
  15. What Language Model to Train if You Have One Million GPU Hours?arXiv:2210.15424Teven Le Scao, Thomas Wang, Daniel Hesslow, et al.2022 · 73 citations
  16. Transcending Scaling Laws with 0.1% Extra ComputearXiv:2210.11399Yi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 42 citations
  17. Just read twice: closing the recall gap for recurrent language modelsarXiv:2407.05483Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re2024 · 8 citations

22 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/wang-2022-language-model-architecture-pretraining-objective/cited-by/