Who cites «Transformers learn to implement preconditioned gradient descent for in-context learning»
- A Survey on In-context LearningarXiv:2301.00234Qingxiu Dong, Lei Li, Damai Dai, et al.2023 · 978 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning TasksarXiv:2402.04248Jongho Park, Jaeseung Park, Zheyang Xiong, et al.2024 · 41 citations
- Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math ProblemsarXiv:2408.16293Tian Ye, Zicheng Xu, Yuanzhi Li, et al.2024 · 31 citations
- One Step of Gradient Descent is Provably the Optimal In-Context Learner with One Layer of Linear Self-AttentionarXiv:2307.03576Arvind Mahankali, Tatsunori B. Hashimoto, Tengyu Ma2023 · 22 citations
- Understanding Emergent In-Context Learning from a Kernel Regression PerspectivearXiv:2305.12766Chi Han, Ziqi Wang, Han Zhao, et al.2023 · 21 citations
- Transformers Learn to Achieve Second-Order Convergence Rates for In-Context Linear RegressionConference on Neural Information Processing Systems (NeurIPS)Deqing Fu, Tian-Qi Chen, Robin Jia, et al.2023 · 14 citations
- Linear attention is (maybe) all you need (to understand transformer optimization)arXiv:2310.01082Kwangjun Ahn, Xiang Cheng, Minhak Song, et al.2023 · 10 citations
- Learning to (Learn at Test Time)arXiv:2310.13807Yu Sun, Xinhao Li, Karan Dalal, et al.2023 · 6 citations
- Label Words as Local Task Vectors in In-Context LearningFindings of the Association for Computational LinguisticsBowen Zheng, Ming Ma, Zhongqiao Lin, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/ahn-2023-transformers-learn-implement-preconditioned-gradient/cited-by/