Who cites «Linear attention is (maybe) all you need (to understand transformer optimization)»
- Transformers learn to implement preconditioned gradient descent for in-context learningConference on Neural Information Processing Systems (NeurIPS)Kwangjun Ahn, Xiang Cheng, Hadi Daneshmand, et al.2023 · 37 citations
- Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic TasksarXiv:2406.01895Mahdi Sabbaghi, George Pappas, Hamed Hassani, et al.2024 · 5 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/ahn-2023-linear-attention-maybe-all-need/cited-by/