Who cites Chiyuan Zhang
- Llama 2: Open Foundation and Fine-Tuned Chat ModelsarXiv:2307.09288Hugo Touvron, Louis Martin, Kevin Stone, et al.2023 · 9,669 citations
- The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
- Survey of Hallucination in Natural Language GenerationACM Computing SurveysZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,974 citations
- mixup: Beyond Empirical Risk MinimizationarXiv:1710.09412Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, et al.2017 · 4,928 citations
- PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
- A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information SystemsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,231 citations
- On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- Emergent Abilities of Large Language ModelsarXiv:2206.07682Jason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,269 citations
- AllenNLP: A Deep Semantic Natural Language Processing PlatformarXiv:1803.07640Matt Gardner, Joel Grus, Mark Neumann, et al.2018 · 1,819 citations
- Multitask Prompted Training Enables Zero-Shot Task GeneralizationarXiv:2110.08207Victor Sanh, Albert Webson, Colin Raffel, et al.2021 · 1,612 citations
- TVM: An Automated End-to-End Optimizing Compiler for Deep LearningarXiv:1802.04799Tianqi Chen, Thierry Moreau, Ziheng Jiang, et al.2018 · 1,384 citations
- A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
- The Rise and Potential of Large Language Model Based Agents: A SurveyScience China Information SciencesZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,272 citations
- A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the UglyarXiv:2312.02003Yifan Yao, Jinhao Duan, Kaidi Xu, et al.2023 · 1,186 citations
- Privacy Risk in Machine Learning: Analyzing the Connection to OverfittingarXiv:1709.01604Samuel Yeom, Irene Giacomelli, Matt Fredrikson, et al.2017 · 1,036 citations
- PaLM 2 Technical ReportarXiv:2305.10403Rohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 1,000 citations
- Extracting Training Data from Large Language ModelsarXiv:2012.07805Nicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 955 citations
- GPT-NeoX-20B: An Open-Source Autoregressive Language ModelBigScience Episode – Workshop on Challenges & Perspectives in Creating Large Language ModelsSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 831 citations
- Triton: An Intermediate Language and Compiler for Tiled Neural Network ComputationsMAPL 2019Philippe Tillet, H. T. Kung, David Cox2019 · 729 citations
- The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural NetworksarXiv:1802.08232Nicholas Carlini, Chang Liu, Ulfar Erlingsson, et al.2018 · 692 citations
- BloombergGPT: A Large Language Model for FinancearXiv:2303.17564Shijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 618 citations
- Text Embeddings by Weakly-Supervised Contrastive Pre-trainingarXiv:2212.03533Liang Wang, Nan Yang, Xiaolong Huang, et al.2022 · 598 citations
- Galactica: A Large Language Model for SciencearXiv:2211.09085Ross Taylor, Marcin Kardas, Guillem Cucurull, et al.2022 · 570 citations
- Deep Learning Scaling is Predictable, EmpiricallyarXiv:1712.00409Joel Hestness, Sharan Narang, Newsha Ardalani, et al.2017 · 518 citations
- DyNet: The Dynamic Neural Network ToolkitarXiv:1701.03980Graham Neubig, Chris Dyer, Yoav Goldberg, et al.2017 · 489 citations
- Graph-to-Sequence Learning using Gated Graph Neural NetworksAnnual Meeting of the Association for Computational Linguistics (ACL)Daniel Beck, Gholamreza Haffari, Trevor Cohn2018 · 459 citations
- The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
- The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleConference on Neural Information Processing Systems (NeurIPS)Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.2024 · 434 citations
- Security and Privacy Challenges of Large Language Models: A SurveyACM Computing SurveysBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 424 citations
- Invariant Risk MinimizationarXiv:1907.02893Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, et al.2019 · 420 citations
- Large Language Models Struggle to Learn Long-Tail KnowledgearXiv:2211.08411Nikhil Kandpal, Haikang Deng, Adam Roberts, et al.2022 · 366 citations
- Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!arXiv:2310.03693Xiangyu Qi, Yi Zeng, Tinghao Xie, et al.2023 · 355 citations
- TimeLMs: Diachronic Language Models from TwitterAnnual Meeting of the Association for Computational Linguistics (ACL)Daniel Loureiro, Francesco Barbieri, Leonardo Neves, et al.2022 · 331 citations
- Scaling Laws for Reward Model OveroptimizationarXiv:2210.10760Leo Gao, John Schulman, Jacob Hilton2022 · 323 citations
- Hallucination is Inevitable: An Innate Limitation of Large Language ModelsarXiv:2401.11817Ziwei Xu, Sanjay Jain, Mohan Kankanhalli2024 · 312 citations
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- An Explanation of In-context Learning as Implicit Bayesian InferencearXiv:2111.02080Sang Michael Xie, Aditi Raghunathan, Percy Liang, et al.2021 · 286 citations
- RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
- DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT ModelsConference on Neural Information Processing Systems (NeurIPS)Boxin Wang, Weixin Chen, Hengzhi Pei, et al.2023 · 259 citations
- NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each BenchmarkFindings of the Association for Computational LinguisticsOscar Sainz, Jon Campos, Iker García-Ferrero, et al.2023 · 250 citations
- The Curious Case of Hallucinations in Neural Machine TranslationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Vikas Raunak, Arul Menezes, Marcin Junczys-Dowmunt2021 · 241 citations
- Beyond neural scaling laws: beating power law scaling via data pruningConference on Neural Information Processing Systems (NeurIPS)Ben Sorscher, Robert Geirhos, Shashank Shekhar, et al.2022 · 231 citations
- Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentarXiv:2308.05374Yang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 223 citations
- MADLAD-400: A Multilingual And Document-Level Large Audited DatasetConference on Neural Information Processing Systems (NeurIPS)Sneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 213 citations
- Scalable Extraction of Training Data from (Production) Language ModelsarXiv:2311.17035Milad Nasr, Nicholas Carlini, Jonathan Hayase, et al.2023 · 211 citations
- Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingarXiv:2202.04538Yu Meng, Jiaxin Huang, Yu Zhang, et al.2022 · 210 citations
- OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsConference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 197 citations
- DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
- Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.2022 · 190 citations
- CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesLanguage Resources and Evaluation Conference (LREC)Thuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 181 citations
- LESS: Selecting Influential Data for Targeted Instruction TuningarXiv:2402.04333Mengzhou Xia, Sadhika Malladi, Suchin Gururangan, et al.2024 · 178 citations
- Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language ModelsScience China Information SciencesQiguang Chen, Libo Qin, Jinhao Liu, et al.2025 · 176 citations
- Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMsConference of the European Chapter of the Association for Computational Linguistics (EACL)Simone Balloccu, Patrícia Schmidtová, Mateusz Lango, et al.2024 · 174 citations
- Seamless: Multilingual Expressive and Streaming Speech TranslationarXiv:2312.05187Seamless Communication, Loic Barrault, Yu-An Chung, et al.2023 · 172 citations
- Deduplicating Training Data Mitigates Privacy Risks in Language ModelsarXiv:2202.06539Nikhil Kandpal, Eric Wallace, Colin Raffel2022 · 172 citations
- Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-SpecificityarXiv:2310.07521Cunxiang Wang, Xiaoze Liu, Yuanhao Yue, et al.2023 · 171 citations
- Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4Conference on Empirical Methods in Natural Language Processing (EMNLP)Kent K. Chang, Mackenzie Cramer, Sandeep Soni, et al.2023 · 169 citations
- Impact of Pretraining Term Frequencies on Few-Shot Numerical ReasoningFindings of the Association for Computational LinguisticsYasaman Razeghi, Robert L Logan IV, Matt Gardner, et al.2022 · 165 citations
- Towards a Cleaner Document-Oriented Multilingual Crawled CorpusLanguage Resources and Evaluation Conference (LREC)Julien Abadji, Pedro Ortiz Suarez, Laurent Romary, et al.2022 · 156 citations
- The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual DatasetarXiv:2303.03915Hugo Laurençon, Lucile Saulnier, Thomas Wang, et al.2023 · 150 citations
- Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine TranslationConference of the European Chapter of the Association for Computational Linguistics (EACL)Nuno M. Guerreiro, Elena Voita, André Martins2023 · 149 citations
- Language Model Behavior: A Comprehensive SurveyComputational LinguisticsTyler A. Chang, Benjamin K. Bergen2024 · 148 citations
- Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
- A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence GenerationarXiv:2307.03987Neeraj Varshney; Wenlin Yao; Hongming Zhang; Jianshu Chen;, Dong Yu2023 · 143 citations
- Knowledge Unlearning for Mitigating Privacy Risks in Language ModelsarXiv:2210.01504Joel Jang, Dongkeun Yoon, Sohee Yang, et al.2022 · 131 citations
- Olmo 3arXiv:2512.13961Team Olmo: Allyson Ettinger, Amanda Bertsch, Bailey Kuehl, et al.2025 · 130 citations
- Fanar: An Arabic-Centric Multimodal Generative AI PlatformarXiv:2501.13944Fanar Team: Ummar Abbas, Mohammad Shahmeer Ahmad, Firoj Alam, et al.2025 · 127 citations
- Performance Impact Caused by Hidden Bias of Training Data for Recognizing Textual EntailmentLanguage Resources and Evaluation Conference (LREC)Masatoshi Tsuchiya2018 · 126 citations
- Unlearn What You Want to Forget: Efficient Unlearning for LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Jiaao Chen, Diyi Yang2023 · 124 citations
- Online normalizer calculation for softmaxarXiv 2018 (NVIDIA)Maxim Milakov, Natalia Gimelshein2018 · 123 citations
- OpenThoughts: Data Recipes for Reasoning ModelsarXiv:2506.04178Etash Guha, Ryan Marten, Sedrick Keh, et al.2025 · 122 citations
- How Much Do Language Models Copy From Their Training Data? Evaluating Linguistic Novelty in Text Generation Using RAVENTransactions of the Association for Computational Linguistics (TACL)R. Thomas McCoy, Paul Smolensky, Tal Linzen, et al.2023 · 117 citations
- RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text DetectorsAnnual Meeting of the Association for Computational Linguistics (ACL)Liam Dugan, Alyssa Hwang, Filip Trhlík, et al.2024 · 110 citations
- Copyright Violations and Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Antonia Karamolegkou, Jiaang Li, Li Zhou, et al.2023 · 109 citations
- SemDeDup: Data-efficient learning at web-scale through semantic deduplicationarXiv:2303.09540Amro Abbas, Kushal Tirumala, Dániel Simig, et al.2023 · 108 citations
- Understanding Learning Dynamics Of Language Models with SVCCAConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Naomi Saphra, Adam Lopez2019 · 107 citations
- Logic-RL: Unleashing LLM Reasoning with Rule-Based Reinforcement LearningarXiv:2502.14768Tian Xie, Zitian Gao, Qingnan Ren, et al.2025 · 104 citations
- Rethinking Benchmark and Contamination for Language Models with Rephrased SamplesarXiv:2311.04850Shuo Yang, Wei-Lin Chiang, Lianmin Zheng, et al.2023 · 103 citations
- FineWeb2: One Pipeline to Scale Them All — Adapting Pre-Training Data Processing to Every LanguagearXiv:2506.20920Guilherme Penedo, Hynek Kydliček, Vinko Sabolčec, et al.2025 · 99 citations
- A Survey on Data Selection for Language ModelsarXiv:2402.16827Alon Albalak, Yanai Elazar, Sang Michael Xie, et al.2024 · 95 citations
- Skywork: A More Open Bilingual Foundation ModelarXiv:2310.19341Tianwen Wei, Liang Zhao, Lichang Zhang, et al.2023 · 91 citations
- Scaling Laws and Interpretability of Learning from Repeated DataarXiv:2205.10487Danny Hernandez, Tom Brown, Tom Conerly, et al.2022 · 91 citations
- Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable SurveyConference of the European Chapter of the Association for Computational Linguistics (EACL)Sachin Kumar, Vidhisha Balachandran, Lucille Njoo, et al.2023 · 90 citations
- When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP)Tyler A. Chang, Catherine Arnett, Zhuowen Tu, et al.2024 · 87 citations
- OpenCoder: The Open Cookbook for Top-Tier Code Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Siming Huang, Tianhao Cheng, Jason Klein Liu, et al.2025 · 81 citations
- D4: Improving LLM Pretraining via Document De-Duplication and DiversificationConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Daniel Simig, Armen Aghajanyan, et al.2023 · 81 citations
- Are Pretrained Language Models Symbolic Reasoners over Knowledge?Conference on Computational Natural Language Learning (CoNLL)Nora Kassner, Benno Krojer, Hinrich Schütze2020 · 81 citations
- What Context Features Can Transformer Language Models Use?Annual Meeting of the Association for Computational Linguistics (ACL)Joe O'Connor, Jacob Andreas2021 · 77 citations
- ReLoRA: High-Rank Training Through Low-Rank UpdatesarXiv:2307.05695Vladislav Lialin, Namrata Shivagunde, Sherin Muckatira, et al.2023 · 74 citations
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
- RNNs can generate bounded hierarchical languages with optimal memoryConference on Empirical Methods in Natural Language Processing (EMNLP)John Hewitt, Michael Hahn, Surya Ganguli, et al.2020 · 65 citations
- Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion TokensarXiv:2401.17377Jiacheng Liu, Sewon Min, Luke Zettlemoyer, et al.2024 · 62 citations
- Understanding Transformer Memorization Recall Through IdiomsConference of the European Chapter of the Association for Computational Linguistics (EACL)Adi Haviv, Ido Cohen, Jacob Gidron, et al.2023 · 62 citations
- MiniMax-01: Scaling Foundation Models with Lightning AttentionarXiv:2501.08313MiniMax, Aonian Li, Bangwei Gong, et al.2025 · 50 citations
- Future Lens: Anticipating Subsequent Tokens from a Single Hidden StateConference on Computational Natural Language Learning (CoNLL)Koyena Pal, Jiuding Sun, Andrew Yuan, et al.2023 · 49 citations
- IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL)Mohammed Safi Ur Rahman Khan, Priyam Mehta, Ananth Sankar, et al.2024 · 48 citations
- “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training DataConference of the European Chapter of the Association for Computational Linguistics (EACL)Orion Weller, Marc Marone, Nathaniel Weir, et al.2024 · 46 citations
- AlGhafa Evaluation Benchmark for Arabic Language ModelsArabic Natural Language Processing Conference (ArabicNLP)Ebtesam Almazrouei, Ruxandra Cojocaru, Michele Baldo, et al.2023 · 46 citations
- On Memorization of Large Language Models in Logical ReasoningInternational Joint Conference on Natural Language Processing (IJCNLP)Chulin Xie, Yangsibo Huang, Chiyuan Zhang, et al.2025 · 45 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/chiyuan-zhang/cited-by/