🔗 Who cites «Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training»

42 papers of our library cite it (of the 149,439 whose bibliographies we read) · 7 with a page here, the most cited first · ← back to «Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training»

1. Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
2. Personal LLM Agents: Insights and Survey about the Capability, Efficiency and SecurityarXiv:2401.05459Yuanchun Li, Hao Wen, Weijun Wang, et al.2024 · 100 citations
3. SOUL: Unlocking the Power of Second-Order Optimization for LLM UnlearningConference on Empirical Methods in Natural Language Processing (EMNLP)Jinghan Jia, Yihua Zhang, Yimeng Zhang, et al.2024 · 46 citations
4. A Survey of Small Language ModelsarXiv:2410.20011Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.2024 · 31 citations
5. No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language ModelsarXiv:2307.06440Jean Kaddour, Oscar Key, Piotr Nawrot, et al.2023 · 30 citations
6. MiniPLM: Knowledge Distillation for Pre-Training Language ModelsarXiv:2410.17215Yuxian Gu, Hao Zhou, Fandong Meng, et al.2024 · 12 citations
7. HTMuon: Improving Muon via Heavy-Tailed Spectral CorrectionFindings of the Association for Computational LinguisticsTianyu Pang, Yujie Fang, Zihang Liu, et al.2026 · 2 citations

35 more papers of our library cite it; they have no page here yet.

This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2023-sophia-scalable-stochastic-second-order/cited-by/