🔗 Who cites «Scaling Up Models and Data with t5x and seqio»

84 papers of our library cite it (of the 149,439 whose bibliographies we read) · 30 with a page here, the most cited first · ← back to «Scaling Up Models and Data with t5x and seqio»

1. PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
2. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelBigScience Episode – Workshop on Challenges & Perspectives in Creating Large Language ModelsSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 831 citations
3. Crosslingual Generalization through Multitask FinetuningarXiv:2211.01786Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 703 citations
4. The Flan Collection: Designing Data and Methods for Effective Instruction TuningarXiv:2301.13688Shayne Longpre, Le Hou, Tu Vu, et al.2023 · 607 citations
5. AudioLM: a Language Modeling Approach to Audio GenerationIEEE/ACM Transactions on Audio Speech and Language ProcessingZalan Borsos, Raphael Marinier, Damien Vincent, et al.2022 · 581 citations
6. The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
7. PaLI: A Jointly-Scaled Multilingual Language-Image ModelarXiv:2209.06794Xi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 371 citations
8. UL2: Unifying Language Learning ParadigmsarXiv:2205.05131Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 347 citations
9. Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defenseConference on Neural Information Processing Systems (NeurIPS)Kalpesh Krishna, Yixiao Song, Marzena Karpinska, et al.2023 · 310 citations
10. Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelarXiv:2402.07827Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 253 citations
11. Translation between Molecules and Natural LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Carl Edwards, Tuan Lai, Kevin Ros, et al.2022 · 238 citations
12. SODA: Million-scale Dialogue Distillation with Social Commonsense ContextualizationConference on Empirical Methods in Natural Language Processing (EMNLP)Hyunwoo Kim, Jack Hessel, Liwei Jiang, et al.2023 · 202 citations
13. MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and TextConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Hexiang Hu, Xi Chen, et al.2022 · 199 citations
14. Generative Verifiers: Reward Modeling as Next-Token PredictionarXiv:2408.15240Lunjun Zhang, Arian Hosseini, Hritik Bansal, et al.2024 · 152 citations
15. TALM: Tool Augmented Language ModelsarXiv:2205.12255Aaron Parisi, Yao Zhao, Noah Fiedel2022 · 149 citations
16. SLiC-HF: Sequence Likelihood Calibration with Human FeedbackarXiv:2305.10425Yao Zhao, Rishabh Joshi, Tianqi Liu, et al.2023 · 141 citations
17. A Real-World WebAgent with Planning, Long Context Understanding, and Program SynthesisarXiv:2307.12856Izzeddin Gur, Hiroki Furuta, Austin Huang, et al.2023 · 120 citations
18. MetricX-23: The Google Submission to the WMT 2023 Metrics Shared TaskConference on Machine Translation (WMT)Juraj Juraska, Mara Finkelstein, Daniel Deutsch, et al.2023 · 118 citations
19. A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & ToxicityarXiv:2305.13169Shayne Longpre, Gregory Yauney, Emily Reif, et al.2023 · 104 citations
20. Sparse Upcycling: Training Mixture-of-Experts from Dense CheckpointsarXiv:2212.05055Aran Komatsuzaki, Joan Puigcerver, James Lee-Thorp, et al.2022 · 98 citations
21. DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Ella Neeman, Roee Aharoni, Or Honovich, et al.2023 · 85 citations
22. CoLT5: Faster Long-Range Transformers with Conditional ComputationConference on Empirical Methods in Natural Language Processing (EMNLP)Joshua Ainslie, Tao Lei, Michiel de Jong, et al.2023 · 84 citations
23. Factually Consistent Summarization via Reinforcement Learning with Textual Entailment FeedbackAnnual Meeting of the Association for Computational Linguistics (ACL)Paul Roit, Johan Ferret, Lior Shani, et al.2023 · 70 citations
24. Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction TuningarXiv:2309.05444Ted Zadouri, Ahmet Ustun, Arash Ahmadian, et al.2023 · 69 citations
25. On the Effects of Data Scale on UI Control AgentsConference on Neural Information Processing Systems (NeurIPS)Wei Li, William Bishop, Alice Li, et al.2024 · 67 citations
26. Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
27. PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment RecognitionFindings of the Association for Computational LinguisticsSihao Chen, Senaka Buthpitiya, Alex Fabrikant, et al.2023 · 31 citations
28. MYTE: Morphology-Driven Byte Encoding for Better and Fairer Multilingual Language ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Tomasz Limisiewicz, Terra Blevins, Hila Gonen, et al.2024 · 30 citations
29. ELQA: A Corpus of Metalinguistic Questions and Answers about EnglishAnnual Meeting of the Association for Computational Linguistics (ACL)Shabnam Behzad, Keisuke Sakaguchi, Nathan Schneider, et al.2023 · 12 citations
30. On Reference (In-)Determinacy in Natural Language InferenceFindings of the Association for Computational LinguisticsSihao Chen, Chaitanya Malaviya, Alex Fabrikant, et al.2025 · 1 citation

54 more papers of our library cite it; they have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/roberts-2022-scaling-up-models-data-texttt/cited-by/