🔗 Who cites «Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer»

7,433 papers of our library cite it (of the 140,884 whose bibliographies we read) · 592 with a page here, the most cited first · page 1 of 6 · 1–100 · ← the paper

1 2 … 6 next →

1. Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, et al.2021 · 33,826 citations
2. Transformers: State-of-the-Art Natural Language ProcessingThomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,591 citations
3. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,752 citations
4. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, et al.2022 · 11,278 citations
5. Language Models are Few-Shot LearnersTom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 10,782 citations
6. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,295 citations
7. ChatGPT for Good? On Opportunities and Challenges of Large Language Models for EducationEnkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, et al.2023 · 7,429 citations
8. Survey of Hallucination in Natural Language GenerationZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,947 citations
9. LLaMA: Open and Efficient Foundation Language ModelsHugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 5,609 citations
10. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,375 citations
11. Dense Passage Retrieval for Open-Domain Question AnsweringVladimir Karpukhin, Barlas Oguz, Sewon Min, et al.2020 · 5,370 citations
12. Large language models are zero-shot reasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.2022 · 3,780 citations
13. Measuring Massive Multitask Language UnderstandingDan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 3,489 citations
14. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,221 citations
15. On the Opportunities and Risks of Foundation ModelsRishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,044 citations
16. CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesZhangyin Feng, Daya Guo, Duyu Tang, et al.2020 · 2,954 citations
17. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
18. Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingYu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon2020 · 2,636 citations
19. PaLM: Scaling Language Modeling with PathwaysAakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 2,603 citations
20. Lost in the Middle: How Language Models Use Long ContextsNelson F. Liu, Kevin Lin, John Hewitt, et al.2023 · 2,540 citations
21. Evaluating Large Language Models Trained on CodeMark Chen, Jerry Tworek, Heewoo Jun, et al.2021 · 2,529 citations
22. Robust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, et al.2022 · 2,497 citations
23. Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, et al.2023 · 2,487 citations
24. Photorealistic Text-to-Image Diffusion Models with Deep Language UnderstandingChitwan Saharia, William Chan, Saurabh Saxena, et al.2022 · 2,416 citations
25. Measuring Mathematical Problem Solving With the MATH DatasetDan Hendrycks, Collin Burns, Saurav Kadavath, et al.2021 · 2,318 citations
26. Emergent Abilities of Large Language ModelsJason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,215 citations
27. Scaling Instruction-Finetuned Language ModelsHyung Won Chung, Le Hou, Shayne Longpre, et al.2022 · 2,176 citations
28. Flamingo: a Visual Language Model for Few-Shot LearningJean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,108 citations
29. TruthfulQA: Measuring How Models Mimic Human FalsehoodsStephanie Lin, Jacob Hilton, Owain Evans2022 · 2,047 citations
30. Making Pre-trained Language Models Better Few-shot LearnersTianyu Gao, Adam Fisch, Danqi Chen2021 · 1,952 citations
31. Scaling Laws for Neural Language ModelsJared Kaplan, Sam McCandlish, Tom Henighan, et al.2020 · 1,814 citations
32. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationJingqing Zhang, Yao Zhao, Mohammad Saleh, et al.2019 · 1,806 citations
33. DeBERTa: Decoding-enhanced BERT with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,800 citations
34. Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language InferenceTimo Schick, Hinrich Schütze2021 · 1,796 citations
35. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTOmar Khattab, Matei Zaharia2020 · 1,776 citations
36. Pre-trained Models for Natural Language Processing: A SurveyXipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,740 citations
37. Longformer: The Long-Document TransformerIz Beltagy, Matthew E. Peters, Arman Cohan2020 · 1,737 citations
38. OPT: Open Pre-trained Transformer Language ModelsSusan Zhang, Stephen Roller, Naman Goyal, et al.2022 · 1,709 citations
39. Leveraging Passage Retrieval with Generative Models for Open Domain Question AnsweringGautier Izacard, Edouard Grave2021 · 1,674 citations
40. Qwen Technical ReportJinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,643 citations
41. Multitask Prompted Training Enables Zero-Shot Task GeneralizationVictor Sanh, Albert Webson, Colin Raffel, et al.2021 · 1,577 citations
42. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLinting Xue, Noah Constant, Adam Roberts, et al.2021 · 1,574 citations
43. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,548 citations
44. Unifying Large Language Models and Knowledge Graphs: A RoadmapShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,545 citations
45. Scaling Up Visual and Vision-Language Representation Learning With Noisy Text SupervisionChao Jia, Yinfei Yang, Ye Xia, et al.2021 · 1,528 citations
46. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextGemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,522 citations
47. Efficient Transformers: A SurveyYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,513 citations
48. GLM: General Language Model Pretraining with Autoregressive Blank InfillingZhengxiao Du, Yujie Qian, Xiao Liu, et al.2022 · 1,449 citations
49. DINOv2: Learning Robust Visual Features without SupervisionMaxime Oquab, Timothee Darcet, Theo Moutakanni, et al.2023 · 1,425 citations
50. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?Sewon Min, Xinxi Lyu, Ari Holtzman, et al.2022 · 1,423 citations
51. Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.2020 · 1,412 citations
52. Code Llama: Open Foundation Models for CodeBaptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
53. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,316 citations
54. LaMDA: Language Models for Dialog ApplicationsRomal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,314 citations
55. AraBERT: Transformer-based Model for Arabic Language UnderstandingWissam Antoun, Fady Baly, Hazem Hajj2020 · 1,297 citations
56. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
57. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsSamuel Gehman, Suchin Gururangan, Maarten Sap, et al.2020 · 1,277 citations
58. The Rise and Potential of Large Language Model Based Agents: A SurveyZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,262 citations
59. CamemBERT: a Tasty French Language ModelLouis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,262 citations
60. What Makes Good In-Context Examples for GPT-3?Jiachang Liu, Dinghan Shen, Yizhe Zhang, et al.2022 · 1,235 citations
61. M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge DistillationJianlv Chen, Shitao Xiao, Peitian Zhang, et al.2024 · 1,196 citations
62. Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order SensitivityYao Lu, Max Bartolo, Alastair Moore, et al.2022 · 1,187 citations
63. Program Synthesis with Large Language ModelsJacob Austin, Augustus Odena, Maxwell Nye, et al.2021 · 1,136 citations
64. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze2021 · 1,118 citations
65. Training Compute-Optimal Large Language ModelsJordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.2022 · 1,110 citations
66. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,105 citations
67. Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemMirac Suzgun, Nathan Scales, Nathanael Schärli, et al.2023 · 1,094 citations
68. Bias and Fairness in Large Language Models: A SurveyIsabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.2023 · 1,072 citations
69. RoFormer: Enhanced Transformer with Rotary Position EmbeddingJianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 1,072 citations
70. InstructBLIP: Towards General-purpose Vision-Language Models with Instruction TuningWenliang Dai, Junnan Li, Dongxu Li, et al.2023 · 1,051 citations
71. GPT Understands, TooXiao Liu, Yanan Zheng, Zhengxiao Du, et al.2021 · 1,039 citations
72. MTEB: Massive Text Embedding BenchmarkNiklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,021 citations
73. P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and TasksXiao Liu, Kaixuan Ji, Yicheng Fu, et al.2022 · 1,013 citations
74. GQA: Training Generalized Multi-Query Transformer Models from Multi-Head CheckpointsJoshua Ainslie, James Lee-Thorp, Michiel de Jong, et al.2023 · 1,012 citations
75. A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language ModelsWenqi Fan; Yujuan Ding; Liangbo Ning; Shijie Wang; Hengyun Li; Dawei Yin; Tat-Seng Chua;, Qing Li2024 · 1,006 citations
76. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 992 citations
77. Solving Quantitative Reasoning Problems with Language ModelsAitor Lewkowycz, Anders Andreassen, David Dohan, et al.2022 · 973 citations
78. GPQA: A Graduate-Level Google-Proof Q&A BenchmarkDavid Rein, Betty Li Hou, Asa Cooper Stickland, et al.2023 · 964 citations
79. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 962 citations
80. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, et al.2020 · 944 citations
81. Out of One, Many: Using Language Models to Simulate Human SamplesLisa P. Argyle, Ethan C. Busby, Nancy Fulda, et al.2022 · 942 citations
82. C-Pack: Packed Resources For General Chinese EmbeddingsShitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 920 citations
83. Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 901 citations
84. Do As I Can, Not As I Say: Grounding Language in Robotic AffordancesMichael Ahn, Anthony Brohan, Noah Brown, et al.2022 · 873 citations
85. UNIFIEDQA: Crossing Format Boundaries with a Single QA SystemDaniel Khashabi, Sewon Min, Tushar Khot, et al.2020 · 843 citations
86. Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Chengwei Qin, Aston Zhang, Zhuosheng Zhang, et al.2023 · 818 citations
87. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 818 citations
88. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 806 citations
89. BARTScore: Evaluating Generated Text as Text GenerationWeizhe Yuan, Graham Neubig, Pengfei Liu2021 · 806 citations
90. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 799 citations
91. Explainability for Large Language Models: A SurveyHaiyan Zhao, Hanjie Chen, Fan Yang, et al.2023 · 785 citations
92. Can Large Language Models Transform Computational Social Science?Caleb Ziems, William Held, Omar Shaikh, et al.2023 · 776 citations
93. Towards Reasoning in Large Language Models: A SurveyJie Huang, Kevin Chen-Chuan Chang2023 · 775 citations
94. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
95. Reproducible scaling laws for contrastive language-image learningMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 750 citations
96. AdapterHub: A Framework for Adapting TransformersJonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.2020 · 747 citations
97. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 744 citations
98. Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningHaokun Liu, Derek Tam, Mohammed Muqeeth, et al.2022 · 735 citations
99. IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian LanguagesDivyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.2020 · 730 citations
100. WizardLM: Empowering large pre-trained language models to follow complex instructionsCan Xu, Qingfeng Sun, Kai Zheng, et al.2023 · 729 citations

1 2 … 6 next →

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/cited-by/