Who cites Peter Izsak
- Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,246 citations
- Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,556 citations
- Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,430 citations
- Phi-4 Technical ReportarXiv:2412.08905Marah Abdin, Jyoti Aneja, Harkirat Behl, et al.2024 · 502 citations
- The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
- Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferencearXiv:2412.13663Benjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 358 citations
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
- Jamba: A Hybrid Transformer-Mamba Language ModelarXiv:2403.19887Opher Lieber, Barak Lenz, Hofit Bata, et al.2024 · 159 citations
- LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context MultitasksarXiv:2412.15204Yushi Bai, Shangqing Tu, Jiajie Zhang, et al.2024 · 135 citations
- The Impact of Positional Encoding on Length Generalization in TransformersConference on Neural Information Processing Systems (NeurIPS)Amirhossein Kazemnejad, Inkit Padhi, Karthikeyan Natesan Ramamurthy, et al.2023 · 134 citations
- GLM-5: from Vibe Coding to Agentic EngineeringarXiv:2602.15763Aohan Zeng, Xin Lv, Zhenyu Hou, et al.2026 · 95 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- Landmark Attention: Random-Access Infinite Context Length for TransformersarXiv:2305.16300Amirkeivan Mohtashami, Martin Jaggi2023 · 88 citations
- Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at ScaleTransactions of the Association for Computational Linguistics (TACL)Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, et al.2022 · 72 citations
- Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-trainingarXiv:2305.14342Hong Liu, Zhiyuan Li, David Hall, et al.2023 · 70 citations
- PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise TrainingarXiv:2309.10400Dawei Zhu, Nan Yang, Liang Wang, et al.2023 · 52 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- Lost in Translation: Large Language Models in Non-English Content AnalysisarXiv:2306.07377Gabriel Nicholas, Aliya Bhatia2023 · 45 citations
- The MiniPile Challenge for Data-Efficient Language ModelsarXiv:2304.08442Jean Kaddour2023 · 41 citations
- Chinese Idiom ParaphrasingTransactions of the Association for Computational Linguistics (TACL)Jipeng Qiang, Yang Li, Chaowei Zhang, et al.2023 · 31 citations
- No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language ModelsarXiv:2307.06440Jean Kaddour, Oscar Key, Piotr Nawrot, et al.2023 · 30 citations
- Transformers Can Achieve Length Generalization But Not RobustlyarXiv:2402.09371Yongchao Zhou, Uri Alon, Xinyun Chen, et al.2024 · 29 citations
- Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and PerformancearXiv:2507.22448Jingwei Zuo, Maksim Velikanov, Ilyas Chahed, et al.2025 · 15 citations
- Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhisong Zhang, Yan Wang, Xinting Huang, et al.2025 · 14 citations
- POSITION BIAS MITIGATES POSITION BIAS: Mitigate Position Bias Through Inter-Position Knowledge DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Yifei Wang, Feng Xiong, Yong Wang, et al.2025 · 13 citations
- MDCure: A Scalable Pipeline for Multi-Document Instruction-FollowingAnnual Meeting of the Association for Computational Linguistics (ACL)Gabrielle Kaili-May Liu, Bowen Shi, Avi Caciularu, et al.2025 · 11 citations
- The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMsFindings of the Association for Computational LinguisticsPiotr Nawrot, Jianing Li, Renjie Huang, et al.2026 · 10 citations
- Explicit Morphological Knowledge Improves Pre-training of Language Models for HebrewEylon Gueta, Omer Goldman, Reut Tsarfaty2023 · 7 citations
- How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLPAnnual Meeting of the Association for Computational Linguistics (ACL)Kushal Tatariya, Artur Kulmizev, Wessel Poelman, et al.2026 · 6 citations
- From Storage to Experience: A Survey on the Evolution of LLM Agent Memory MechanismsFindings of the Association for Computational LinguisticsJinghao Luo, Yuchen Tian, Chuxue Cao, et al.2026 · 3 citations
- Character-aware Transformers Learn an Irregular Morphological Pattern Yet None Generalize Like HumansWorkshop on Cognitive Modeling and Computational Linguistics (CMCL)Akhilesh Kakolu Ramarao, Kevin Tang, Dinah Baer-Henney2026
- Data Foundations of Long-Context Language Models: A SurveyTransactions of the Association for Computational Linguistics (TACL)Zechen Sun, Yuyang Sun, Zhaochen Su, et al.2026
- Position Encoding with Random Float Sampling Enhances Length Generalization of TransformersFindings of the Association for Computational LinguisticsAtsushi Shimizu, Shohei Taniguchi, Yutaka Matsuo2026
- RRAtention: Dynamic Block Sparse Attention via Per-Head Round-Robin Shifts for Long-Context InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Siran Liu, Guoxia Wang, Sa Wang, et al.2026
- SCOPE: Boosting LLM Efficiency with Scoped Position EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Qingguo Qi, Hongyang Chen, Zhao Li2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/peter-izsak/cited-by/