Who cites «Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?»
- Efficient Transformers: A SurveyYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,513 citations
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemMirac Suzgun, Nathan Scales, Nathanael Schärli, et al.2023 · 1,094 citations
- Reproducible scaling laws for contrastive language-image learningMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 750 citations
- BloombergGPT: A Large Language Model for FinanceShijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 608 citations
- Galactica: A Large Language Model for ScienceRoss Taylor, Marcin Kardas, Guillem Cucurull, et al.2022 · 558 citations
- Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
- Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language ModelsMosh Levy, Alon Jacoby, Yoav Goldberg2024 · 212 citations
- Ring Attention with Blockwise Transformers for Near-Infinite ContextHao Liu, Matei Zaharia, Pieter Abbeel2023 · 207 citations
- Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling LawsNikhil Sardana, Jacob Portes, Sasha Doubov, et al.2024 · 47 citations
- Scaling Laws with Vocabulary: Larger Models Deserve Larger VocabulariesChaofan Tao, Qian Liu, Longxu Dou, et al.2024 · 42 citations
- Transcending Scaling Laws with 0.1% Extra ComputeYi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformanceYangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 28 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/tay-2023-scaling-laws-vs-model-architectures/cited-by/