Elamur Research⌕
☰
home / papers / The Curious Case of Neural Text Degeneration / cited by

Who cites «The Curious Case of Neural Text Degeneration»

1,581 papers of our library cite it (of the 149,439 whose bibliographies we read) · 343 with a page here, the most cited first · page 1 of 4 · 1–100 · ← back to «The Curious Case of Neural Text Degeneration»

1 2 3 4

  1. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
  2. Llama 2: Open Foundation and Fine-Tuned Chat ModelsarXiv:2307.09288Hugo Touvron, Louis Martin, Kevin Stone, et al.2023 · 9,669 citations
  3. Survey of Hallucination in Natural Language GenerationACM Computing SurveysZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,974 citations
  4. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsACM Transactions on Information SystemsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,231 citations
  5. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  6. Self-Consistency Improves Chain of Thought Reasoning in Language ModelsarXiv:2203.11171Xuezhi Wang, Jason Wei, Dale Schuurmans, et al.2022 · 3,121 citations
  7. QLoRA: Efficient Finetuning of Quantized LLMsConference on Neural Information Processing Systems (NeurIPS)Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, et al.2023 · 2,929 citations
  8. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
  9. Evaluating Large Language Models Trained on CodearXiv:2107.03374Mark Chen, Jerry Tworek, Heewoo Jun, et al.2021 · 2,659 citations
  10. On Faithfulness and Factuality in Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Joshua Maynez, Shashi Narayan, Bernd Bohnet, et al.2020 · 1,857 citations
  11. OPT: Open Pre-trained Transformer Language ModelsarXiv:2205.01068Susan Zhang, Stephen Roller, Naman Goyal, et al.2022 · 1,755 citations
  12. Competition-Level Code Generation with AlphaCodeScienceYujia Li, David Choi, Junyoung Chung, et al.2022 · 1,564 citations
  13. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationarXiv:2201.12086Junnan Li, Dongxu Li, Caiming Xiong, et al.2022 · 1,523 citations
  14. Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained AspectsConference on Empirical Methods in Natural Language Processing (EMNLP)Jianmo Ni, Jiacheng Li, Julian McAuley2019 · 1,435 citations
  15. Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,430 citations
  16. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsFindings of the Association for Computational LinguisticsSamuel Gehman, Suchin Gururangan, Maarten Sap, et al.2020 · 1,306 citations
  17. CTRL: A Conditional Transformer Language Model for Controllable GenerationarXiv:1909.05858Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.2019 · 1,291 citations
  18. Recipes for Building an Open-Domain ChatbotConference of the European Chapter of the Association for Computational Linguistics (EACL)Stephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,214 citations
  19. Prompt Programming for Large Language Models: Beyond the Few-Shot ParadigmExtended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA)Laria Reynolds, Kyle McDonell2021 · 1,121 citations
  20. Solving Quantitative Reasoning Problems with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Aitor Lewkowycz, Anders Andreassen, David Dohan, et al.2022 · 992 citations
  21. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsComputational LinguisticsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 977 citations
  22. Extracting Training Data from Large Language ModelsarXiv:2012.07805Nicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 955 citations
  23. Calibrate Before Use: Improving Few-Shot Performance of Language ModelsarXiv:2102.09690Tony Z. Zhao, Eric Wallace, Shi Feng, et al.2021 · 825 citations
  24. ProgPrompt: Generating Situated Robot Task Plans using Large Language ModelsarXiv:2209.11302Ishika Singh, Valts Blukis, Arsalan Mousavian, et al.2022 · 735 citations
  25. Red Teaming Language Models with Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ethan Perez, Saffron Huang, Francis Song, et al.2022 · 700 citations
  26. Efficient Content-Based Sparse Attention with Routing TransformersTransactions of the Association for Computational Linguistics (TACL)Aurko Roy, Mohammad Saffar, Ashish Vaswani, et al.2020 · 677 citations
  27. Towards a Human-like Open-Domain ChatbotarXiv:2001.09977Daniel Adiwardana, Minh-Thang Luong, David R. So, et al.2020 · 592 citations
  28. Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought PromptingConference on Neural Information Processing Systems (NeurIPS)Miles Turpin, Julian Michael, Ethan Perez, et al.2023 · 586 citations
  29. Plug and Play Language Models: A Simple Approach to Controlled Text GenerationarXiv:1912.02164Sumanth Dathathri, Andrea Madotto, Janice Lan, et al.2019 · 578 citations
  30. Release Strategies and the Social Impacts of Language ModelsarXiv:1908.09203Irene Solaiman, Miles Brundage, Jack Clark, et al.2019 · 554 citations
  31. Unleashing the potential of prompt engineering for large language modelsarXiv:2310.14735 · Patterns 6(6) 101,260 (2025)Banghao Chen, Zhaofeng Zhang, Nicolas Langrene, et al.2023 · 536 citations
  32. Neural Text Generation with Unlikelihood TrainingarXiv:1908.04319Sean Welleck, Ilia Kulikov, Stephen Roller, et al.2019 · 513 citations
  33. Enabling Large Language Models to Generate Text with CitationsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Howard Yen, Jiatong Yu, et al.2023 · 485 citations
  34. Defending Against Neural Fake NewsarXiv:1905.12616Rowan Zellers, Ari Holtzman, Hannah Rashkin, et al.2019 · 478 citations
  35. Data Augmentation using Pre-trained Transformer ModelsarXiv:2003.02245Varun Kumar, Ashutosh Choudhary, Eunah Cho2020 · 474 citations
  36. Ethical and social risks of harm from Language ModelsarXiv:2112.04359Laura Weidinger, John Mellor, Maribeth Rauh, et al.2021 · 456 citations
  37. GeDi: Generative Discriminator Guided Sequence GenerationFindings of the Association for Computational LinguisticsBen Krause, Akhilesh Deepak Gotmare, Bryan McCann, et al.2021 · 449 citations
  38. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied AgentsarXiv:2201.07207Wenlong Huang, Pieter Abbeel, Deepak Pathak, et al.2022 · 443 citations
  39. Diffusion-LM Improves Controllable Text GenerationarXiv:2205.14217Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, et al.2022 · 440 citations
  40. Experience Grounds LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Yonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 439 citations
  41. Automatic Detection of Generated Text is Easiest when Humans are FooledAnnual Meeting of the Association for Computational Linguistics (ACL)Daphne Ippolito, Daniel Duckworth, Chris Callison-Burch, et al.2019 · 411 citations
  42. DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-ExpertsAnnual Meeting of the Association for Computational Linguistics (ACL)Alisa Liu, Maarten Sap, Ximing Lu, et al.2021 · 409 citations
  43. A Simple Language Model for Task-Oriented DialoguearXiv:2005.00796Ehsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, et al.2020 · 399 citations
  44. Retrieval Augmentation Reduces Hallucination in ConversationarXiv:2104.07567Kurt Shuster, Spencer Poff, Moya Chen, et al.2021 · 392 citations
  45. Towards Emotional Support Dialog SystemsAnnual Meeting of the Association for Computational Linguistics (ACL)Siyang Liu, Chujie Zheng, Orianna Demasi, et al.2021 · 392 citations
  46. Evaluation of Text Generation: A SurveyarXiv:2006.14799Asli Celikyilmaz, Elizabeth Clark, Jianfeng Gao2020 · 388 citations
  47. A Survey on Large Language Models for Code GenerationACM Transactions on Software Engineering and MethodologyJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 367 citations
  48. Unnatural Instructions: Tuning Language Models with (Almost) No Human LaborAnnual Meeting of the Association for Computational Linguistics (ACL)Or Honovich, Thomas Scialom, Omer Levy, et al.2023 · 366 citations
  49. Improving alignment of dialogue agents via targeted human judgementsarXiv:2209.14375Amelia Glaese, Nat McAleese, Maja Trębacz, et al.2022 · 362 citations
  50. QuestEval: Summarization Asks for Fact-based EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Thomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, et al.2021 · 359 citations
  51. FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Esin Durmus, He He, Mona Diab2020 · 359 citations
  52. Toxicity in chatgpt: Analyzing persona-assigned language modelsFindings of the Association for Computational LinguisticsAmeet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, et al.2023 · 353 citations
  53. Reformulating Unsupervised Style Transfer as Paraphrase GenerationKalpesh Krishna, John Wieting, Mohit Iyyer2020 · 350 citations
  54. Symbolic Knowledge Distillation: from General Language Models to Commonsense ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Peter West, Chandra Bhagavatula, Jack Hessel, et al.2022 · 349 citations
  55. Compressive Transformers for Long-Range Sequence ModellingarXiv:1911.05507Jack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, et al.2019 · 340 citations
  56. Discovering Language Model Behaviors with Model-Written EvaluationsarXiv:2212.09251Ethan Perez, Sam Ringer, Kamilė Lukošiūtė, et al.2022 · 328 citations
  57. WANLI: Worker and AI Collaboration for Natural Language Inference Dataset CreationarXiv:2201.05955Alisa Liu, Swabha Swayamdipta, Noah A. Smith, et al.2022 · 317 citations
  58. Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defenseConference on Neural Information Processing Systems (NeurIPS)Kalpesh Krishna, Yixiao Song, Marzena Karpinska, et al.2023 · 310 citations
  59. Chain-of-Verification Reduces Hallucination in Large Language ModelsarXiv:2309.11495Shehzaad Dhuliawala, Mojtaba Komeili, Jing Xu, et al.2023 · 305 citations
  60. Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
  61. Baize: An Open-Source Chat Model with Parameter-Efficient Tuning on Self-Chat DataConference on Empirical Methods in Natural Language Processing (EMNLP)Canwen Xu, Daya Guo, Nan Duan, et al.2023 · 296 citations
  62. Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Tal Schuster, Adam Fisch, Regina Barzilay2021 · 290 citations
  63. Llemma: An Open Language Model For MathematicsarXiv:2310.10631Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 286 citations
  64. An Explanation of In-context Learning as Implicit Bayesian InferencearXiv:2111.02080Sang Michael Xie, Aditi Raghunathan, Percy Liang, et al.2021 · 286 citations
  65. USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Shikib Mehri, Maxine Eskenazi2020 · 286 citations
  66. Generate rather than Retrieve: Large Language Models are Strong Context GeneratorsarXiv:2209.10063Wenhao Yu, Dan Iter, Shuohang Wang, et al.2022 · 281 citations
  67. Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding HeadsarXiv:2401.10774Tianle Cai, Yuhong Li, Zhengyang Geng, et al.2024 · 278 citations
  68. A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future DirectionsComputational LinguisticsJunchao Wu, Shu Yang, Runzhe Zhan, et al.2025 · 277 citations
  69. Surface Form Competition: Why the Highest Probability Answer Isn't Always RightConference on Empirical Methods in Natural Language Processing (EMNLP)Ari Holtzman, Peter West, Vered Shwartz, et al.2021 · 277 citations
  70. GPT3Mix: Leveraging Large-scale Language Models for Text AugmentationFindings of the Association for Computational LinguisticsKang Min Yoo, Dongju Park, Jaewook Kang, et al.2021 · 270 citations
  71. Large Language Models Are Zero-Shot Time Series ForecastersConference on Neural Information Processing Systems (NeurIPS)Nate Gruver, Marc Finzi, Shikai Qiu, et al.2023 · 268 citations
  72. Results of WMT22 Metrics Shared Task: Stop Using BLEU – Neural Metrics Are Better and More RobustMarkus Freitag, Ricardo Rei, Nitika Mathur, et al.2022 · 265 citations
  73. Measuring Faithfulness in Chain-of-Thought ReasoningarXiv:2307.13702Tamera Lanham, Anna Chen, Ansh Radhakrishnan, et al.2023 · 262 citations
  74. RedPajama: an Open Dataset for Training Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Maurice Weber, Daniel Fu, Quentin Anthony, et al.2024 · 260 citations
  75. CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP)Shuyang Cao, Lu Wang2021 · 260 citations
  76. DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT ModelsConference on Neural Information Processing Systems (NeurIPS)Boxin Wang, Weixin Chen, Hengzhi Pei, et al.2023 · 259 citations
  77. Societal Biases in Language Generation: Progress and ChallengesAnnual Meeting of the Association for Computational Linguistics (ACL)Emily Sheng, Kai-Wei Chang, Prem Natarajan, et al.2021 · 257 citations
  78. Contrastive Decoding: Open-ended Text Generation as OptimizationarXiv:2210.15097Xiang Lisa Li, Ari Holtzman, Daniel Fried, et al.2022 · 254 citations
  79. Generating Datasets with Pretrained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Timo Schick, Hinrich Schutze2021 · 254 citations
  80. Aya Model: An Instruction Finetuned Open-Access Multilingual Language ModelarXiv:2402.07827Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong, et al.2024 · 253 citations
  81. RAFT: Reward rAnked FineTuning for Generative Foundation Model AlignmentarXiv:2304.06767Hanze Dong, Wei Xiong, Deepanshu Goyal, et al.2023 · 252 citations
  82. MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence FrontiersarXiv:2102.01454Krishna Pillutla, Swabha Swayamdipta, Rowan Zellers, et al.2021 · 251 citations
  83. Trusting Your Evidence: Hallucinate Less with Context-aware DecodingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Weijia Shi, Xiaochuang Han, Mike Lewis, et al.2024 · 249 citations
  84. Automatic Detection of Machine Generated Text: A Critical SurveyInternational Conference on Computational Linguistics (COLING)Ganesh Jawahar, Muhammad Abdul-Mageed, Laks Lakshmanan V.S.2020 · 247 citations
  85. ZeroGen: Efficient Zero-shot Learning via Dataset GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Jiacheng Ye, Jiahui Gao, Qintong Li, et al.2022 · 245 citations
  86. BlenderBot 3: a deployed conversational agent that continually learns to responsibly engagearXiv:2208.03188Kurt Shuster, Jing Xu, Mojtaba Komeili, et al.2022 · 241 citations
  87. Visual Adversarial Examples Jailbreak Aligned Large Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceXiangyu Qi, Kaixuan Huang, Ashwinee Panda, et al.2023 · 240 citations
  88. FUDGE: Controlled Text Generation With Future DiscriminatorsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kevin Yang, Dan Klein2021 · 239 citations
  89. OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-AllocationIEEE Computer Society Conference on Computer Vision and Pattern RecognitionQidong Huang, Xiaoyi Dong, Pan Zhang, et al.2023 · 238 citations
  90. Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human SupervisionConference on Neural Information Processing Systems (NeurIPS)Zhiqing Sun, Yikang Shen, Qinhong Zhou, et al.2023 · 236 citations
  91. Hurdles to Progress in Long-form Question AnsweringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kalpesh Krishna, Aurko Roy, Mohit Iyyer2021 · 233 citations
  92. End-to-End Neural Pipeline for Goal-Oriented Dialogue Systems using GPT-2Annual Meeting of the Association for Computational Linguistics (ACL)Donghoon Ham, Jeong-Gwan Lee, Youngsoo Jang, et al.2020 · 230 citations
  93. Tower: An Open Multilingual Large Language Model for Translation-Related TasksarXiv:2402.17733Duarte M. Alves, Jose Pombal, Nuno M. Guerreiro, et al.2024 · 227 citations
  94. How Language Model Hallucinations Can SnowballarXiv:2305.13534Muru Zhang, Ofir Press, William Merrill, et al.2023 · 226 citations
  95. Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentarXiv:2308.05374Yang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 223 citations
  96. Med-HALT: Medical Domain Hallucination Test for Large Language ModelsConference on Computational Natural Language Learning (CoNLL)Ankit Pal, Logesh Kumar Umapathi, Malaikannan Sankarasubbu2023 · 221 citations
  97. Maieutic Prompting: Logically Consistent Reasoning with Recursive ExplanationsConference on Empirical Methods in Natural Language Processing (EMNLP)Jaehun Jung, Lianhui Qin, Sean Welleck, et al.2022 · 219 citations
  98. Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood TrainingAnnual Meeting of the Association for Computational Linguistics (ACL)Margaret Li, Stephen Roller, Ilia Kulikov, et al.2020 · 217 citations
  99. Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?arXiv:2504.13837 · NeurIPS 2025 Oral; ICML 2025 AI4MATH workshop best paperYang Yue, Zhiqi Chen, Rui Lu, et al.2025 · 216 citations
  100. TinyStories: How Small Can Language Models Be and Still Speak Coherent English?Ronen Eldan, Yuanzhi Li2023 · 213 citations

1 2 3 4

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/holtzman-2019-curious-case-neural-text-degeneration/cited-by/