Elamur Research⌕
☰
home / authors / Danqi Chen / all works

Danqi Chen — all works

114 works · page 1 of 2 · 1–100 · ← Danqi Chen

1 2

  1. RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
  2. Dense Passage Retrieval for Open-Domain Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Vladimir Karpukhin, Barlas Oguz, Sewon Min, et al.2020 · 5,421 citations
  3. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,942 citations
  4. SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics (TACL)Mandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,616 citations
  5. A Fast and Accurate Dependency Parser using Neural NetworksDanqi Chen, Christopher ManningEnglish · 2,314 citations
  6. Reading Wikipedia to Answer Open-Domain QuestionsAnnual Meeting of the Association for Computational Linguistics (ACL)Danqi Chen, Adam Fisch, Jason Weston, et al.2017 · 2,283 citations
  7. Making Pre-trained Language Models Better Few-shot LearnersAnnual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Adam Fisch, Danqi Chen2021 · 1,987 citations
  8. Reasoning With Neural Tensor Networks for Knowledge Base CompletionConference on Neural Information Processing Systems (NeurIPS)Richard Socher, Danqi Chen, Christopher D. Manning, et al.2013 · 1,810 citations
  9. CoQA: A Conversational Question Answering ChallengeTransactions of the Association for Computational Linguistics (TACL)Siva Reddy, Danqi Chen, Christopher D. Manning2019 · 1,555 citations
  10. Observed versus latent features for knowledge base and text inferenceWorkshop on Continuous Vector Space Models and their CompositionalityKristina Toutanova, Danqi Chen2015 · 1,243 citations
  11. Position-aware Attention and Supervised Data Improve Slot Filling ↗Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · no summary yetYuhao Zhang et al.2017 · 1,169 citations
  12. Representing Text for Joint Embedding of Text and Knowledge BasesConference on Empirical Methods in Natural Language Processing (EMNLP)Kristina Toutanova, Danqi Chen, Patrick Pantel, et al.2015 · 907 citations
  13. A Thorough Examination of the CNN/Daily Mail Reading Comprehension TaskAnnual Meeting of the Association for Computational Linguistics (ACL)Danqi Chen, Jason Bolton, Christopher D. Manning2016 · 699 citations
  14. A Frustratingly Easy Approach for Entity and Relation ExtractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Danqi Chen2020 · 631 citations
  15. Enabling Large Language Models to Generate Text with CitationsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Howard Yen, Jiatong Yu, et al.2023 · 485 citations
  16. Factual Probing Is [MASK]: Learning vs. Learning to RecallConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Dan Friedman, Danqi Chen2021 · 415 citations
  17. MRQA 2019 Shared Task: Evaluating Generalization in Reading ComprehensionWorkshop on Machine Reading for Question AnsweringAdam Fisch, Alon Talmor, Robin Jia, et al.2019 · 381 citations
  18. SimPO: Simple Preference Optimization with a Reference-Free Reward ↗arXiv:2405.14734 · no summary yetYu Meng, Mengzhou Xia, Danqi Chen2024 · 340 citations
  19. A Discrete Hard EM Approach for Weakly Supervised Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Sewon Min, Danqi Chen, Hannaneh Hajishirzi, et al.2019 · 237 citations
  20. Detecting Pretraining Data from Large Language Models ↗arXiv:2310.16789 · no summary yetWeijia Shi et al.2023 · 224 citations
  21. Structured Pruning Learns Compact and Accurate ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 221 citations
  22. Should You Mask 15% in Masked Language Modeling? ↗Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics · no summary yetAlexander Wettig et al.2023 · 217 citations
  23. Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning ↗arXiv:2310.06694 · no summary yetMengzhou Xia et al.2023 · 201 citations
  24. MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetZexuan Zhong et al.2023 · 199 citations
  25. Adapting Language Models to Compress ContextsConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 182 citations
  26. LESS: Selecting Influential Data for Targeted Instruction TuningarXiv:2402.04333Mengzhou Xia, Sadhika Malladi, Suchin Gururangan, et al.2024 · 178 citations
  27. Catastrophic Jailbreak of Open-source LLMs via Exploiting GenerationarXiv:2310.06987Yangsibo Huang, Samyak Gupta, Mengzhou Xia, et al.2023 · 169 citations
  28. Simple Entity-Centric Questions Challenge Dense RetrieversConference on Empirical Methods in Natural Language Processing (EMNLP)Christopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, et al.2021 · 169 citations
  29. Evaluating Large Language Models at Evaluating Instruction Following ↗arXiv:2310.07641 · no summary yetZhiyuan Zeng et al.2023 · 163 citations
  30. Fine-Tuning Language Models with Just Forward Passes ↗arXiv:2305.17333 · no summary yetSadhika Malladi et al.2023 · 153 citations
  31. Retrieval-based Language Models and ApplicationsAnnual Meeting of the Association for Computational Linguistics (ACL)Akari Asai, Sewon Min, Zexuan Zhong, et al.2023 · 141 citations
  32. Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering ↗arXiv:1911.03868 · no summary yetSewon Min et al.2019 · 133 citations
  33. Open-Domain Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Danqi Chen, Wen-tau Yih2020 · 129 citations
  34. Learning Dense Representations of Phrases at ScaleAnnual Meeting of the Association for Computational Linguistics (ACL)Jinhyuk Lee, Mujeen Sung, Jaewoo Kang, et al.2021 · 126 citations
  35. Training Language Models with Memory Augmentation ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetZexuan Zhong, Tao Lei, Danqi Chen2022 · 120 citations
  36. CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs ↗arXiv:2406.18521 · no summary yetZirui Wang et al.2024 · 119 citations
  37. NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned ↗arXiv (Cornell University) · no summary yetSewon Min et al.2021 · 108 citations
  38. What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task LearningFindings of the Association for Computational LinguisticsJane Pan, Tianyu Gao, Howard Chen, et al.2023 · 102 citations
  39. How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
  40. Foundational Challenges in Assuring Alignment and Safety of Large Language Models ↗arXiv:2404.09932 · no summary yetUsman Anwar et al.2024 · 87 citations
  41. SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal ↗arXiv:2406.14598 · no summary yetTinghao Xie et al.2024 · 87 citations
  42. Goedel-Prover: A Frontier Model for Open-Source Automated Theorem Proving ↗arXiv:2502.07640 · no summary yetYong Lin et al.2025 · 84 citations
  43. QuRating: Selecting High-Quality Data for Training Language Models ↗arXiv:2402.09739 · no summary yetAlexander Wettig et al.2024 · 74 citations
  44. Learning New Facts From Knowledge Bases With Neural Tensor Networks and Semantic Word Vectors ↗arXiv (Cornell University) · no summary yetDanqi Chen et al.2013 · 72 citations
  45. Beyond ten blue links ↗ACM International Conference on Web Search and Data Mining (WSDM) · no summary yetDanqi Chen et al.2012 · 71 citations
  46. Poisoning Retrieval Corpora by Injecting Adversarial Passages ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetZexuan Zhong et al.2023 · 70 citations
  47. Generating Natural Language Proofs with Verifier-Guided Search ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetKaiyu Yang, Jia Deng, Danqi Chen2022 · 70 citations
  48. Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction ↗arXiv:2508.03613 · no summary yetYong Lin et al.2025 · 67 citations
  49. TextHide: Tackling Data Privacy in Language Understanding Tasks ↗Findings of the Association for Computational Linguistics: EMNLP 2020 · no summary yetYangsibo Huang et al.2020 · 62 citations
  50. Training Trajectories of Language Models Across Scales ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetMengzhou Xia et al.2023 · 60 citations
  51. Can Rationalization Improve Robustness? ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetHoward Chen et al.2022 · 59 citations
  52. HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly ↗arXiv:2410.02694 · no summary yetHoward Yen et al.2024 · 55 citations
  53. Phrase Retrieval Learns Passage Retrieval, Too ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetJinhyuk Lee, Alexander Wettig, Danqi Chen2021 · 54 citations
  54. Recovering Private Text in Federated Learning of Language Models ↗neural information processing systems · no summary yetSamyak Gupta et al.2022 · 52 citations
  55. Bootstrapped Self Training for Knowledge Base Population. ↗Theory and applications of categories · no summary yetGabor Angeli et al.2015 · 47 citations
  56. Reliable, Adaptable, and Attributable Language Models with RetrievalarXiv:2403.03187Akari Asai, Zexuan Zhong, Danqi Chen, et al.2024 · 45 citations
  57. Long-Context Language Modeling with Parallel Context EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Howard Yen, Tianyu Gao, Danqi Chen2024 · 44 citations
  58. Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetChenglei Si et al.2023 · 42 citations
  59. LitSearch: A Retrieval Benchmark for Scientific Literature SearchConference on Empirical Methods in Natural Language Processing (EMNLP)Anirudh Ajith, Mengzhou Xia, Alexis Chevalier, et al.2024 · 39 citations
  60. Certifiably Robust RAG against Retrieval Corruption ↗IEEE Conference on Secure and Trustworthy Machine Learning (SaTML) · no summary yetChong Xiang et al.2024 · 39 citations
  61. Privacy Implications of Retrieval-Based Language Models ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetYangsibo Huang et al.2023 · 38 citations
  62. MABEL: Attenuating Gender Bias using Textual Entailment Data ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetJacqueline He et al.2022 · 38 citations
  63. Enabling GPTs for Expert-Level Environmental Engineering Question Answering ↗Environmental Science & Technology Letters · no summary yetJun‐Jie Zhu et al.2024 · 34 citations
  64. Ditch the Gold Standard: Re-evaluating Conversational Question Answering ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetHuihan Li et al.2022 · 32 citations
  65. The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning ↗neural information processing systems · no summary yetXinyu Zhu et al.2025 · 30 citations
  66. Single-dataset Experts for Multi-dataset Question Answering ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetDan Friedman, Ben Dodge, Danqi Chen2021 · 29 citations
  67. Organize the Web: Constructing Domains Enhances Pre-Training Data Curation ↗ICML 2025 · no summary yetAlexander Wettig et al.2025 · 28 citations
  68. Learning Transformer Programs ↗arXiv:2306.01128 · no summary yetDan Friedman, Alexander Wettig, Danqi Chen2023 · 28 citations
  69. C-STS: Conditional Semantic Textual Similarity ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetAmeet Deshpande et al.2023 · 25 citations
  70. Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetMozes van de Kar et al.2022 · 24 citations
  71. Finding Transformer Circuits With Edge Pruning ↗neural information processing systems · no summary yetAdithya Bhaskar et al.2024 · 23 citations
  72. A Kernel-Based View of Language Model Fine-Tuning ↗arXiv (Cornell University) · no summary yetSadhika Malladi et al.2022 · 22 citations
  73. Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting ↗arXiv (Cornell University) · no summary yetHoward Chen et al.2025 · 21 citations
  74. Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetMengzhou Xia et al.2022 · 21 citations
  75. LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation ↗arXiv (Cornell University) · no summary yetXi Ye et al.2025 · 18 citations
  76. Finding Dataset Shortcuts with Grammar Induction ↗Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing · no summary yetDan Friedman, Alexander Wettig, Danqi Chen2022 · 18 citations
  77. Non-Parametric Few-Shot Learning for Word Sense Disambiguation ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetHoward Chen, Mengzhou Xia, Danqi Chen2021 · 16 citations
  78. Self-Distillation Zero: Self-Revision Turns Binary Rewards into Dense Supervision ↗arXiv (Cornell University) · no summary yetYinghui He et al.2026 · 14 citations
  79. Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization ↗arXiv (Cornell University) · no summary yetNoam Razin et al.2024 · 14 citations
  80. Lory: Fully Differentiable Mixture-of-Experts for Autoregressive Language Model Pre-training ↗arXiv (Cornell University) · no summary yetZexuan Zhong et al.2024 · 13 citations
  81. Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking ↗Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing · no summary yetWuwei Zhang et al.2025 · 11 citations
  82. Continual Memorization of Factoids in Language Models ↗arXiv (Cornell University) · no summary yetHoward Chen et al.2024 · 11 citations
  83. Controllable Text Generation with Language Constraints ↗arXiv (Cornell University) · no summary yetHoward Chen et al.2022 · 11 citations
  84. Metadata Conditioning Accelerates Language Model Pre-training ↗Qeios · no summary yetTianyu Gao et al.2025 · 9 citations
  85. Fantastic Copyrighted Beasts and How (Not) to Generate Them ↗arXiv (Cornell University) · no summary yetLuxi He et al.2024 · 9 citations
  86. Interpretability Illusions in the Generalization of Simplified Models ↗arXiv (Cornell University) · no summary yetDan Friedman et al.2023 · 9 citations
  87. Stanford at TAC KBP 2016: Sealing Pipeline Leaks and Understanding Chinese. ↗Theory and applications of categories · no summary yetYuhao Zhang et al.2016 · 9 citations
  88. The Heuristic Core: Understanding Subnetwork Generalization in Pretrained Language Models ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetAdithya Bhaskar, Dan Friedman, Danqi Chen2024 · 8 citations
  89. Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs? ↗arXiv (Cornell University) · no summary yetBhaskar, Adithya et al.2025 · 6 citations
  90. Language Models that Think, Chat Better ↗arXiv (Cornell University) · no summary yetAdithya Bhaskar, Ye, Xi, Danqi Chen2025 · 6 citations
  91. De-anonymizing social networks ↗no summary yetDanqi Chen, Botao Hu, Shuo Xie2012 · 6 citations
  92. Improving Language Understanding from Screenshots ↗arXiv (Cornell University) · no summary yetTianyu Gao et al.2024 · 5 citations
  93. Optimizing Test-Time Query Representations for Dense Retrieval ↗Findings of the Association for Computational Linguistics: ACL 2023 · no summary yetMujeen Sung et al.2023 · 5 citations
  94. MoQA: Benchmarking Multi-Type Open-Domain Question Answering ↗Proceedings of the Third DialDoc Workshop on Document-grounded Dialogue and Conversational Question Answering · no summary yetHoward Yen et al.2023 · 5 citations
  95. Lost in the Maze: Overcoming Context Limitations in Long-Horizon Agentic Search ↗arXiv (Cornell University) · no summary yetYen, Howard et al.2025 · 4 citations
  96. Precise Information Control in Long-Form Text Generation ↗neural information processing systems · no summary yetJacqueline He et al.2025 · 3 citations
  97. Statutory Construction and Interpretation for Artificial Intelligence ↗arXiv:2509.01186 · no summary yetLuxi He et al.2025 · 3 citations
  98. AI Risk Management Should Incorporate Both Safety and Security ↗arXiv (Cornell University) · no summary yetXiangyu Qi et al.2024 · 3 citations
  99. TAC Relation Extraction Dataset ↗Americanae (AECID Library) · no summary yetZhong, Victor et al.2018 · 3 citations
  100. Goedel-Architect: Streamlining Formal Theorem Proving with Blueprint Generation and Refinement ↗arXiv:2606.06468 · no summary yetJui-Hui Chung et al.2026 · 2 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/danqi-chen/works/