🔬 Works of Allen Institute for Artificial Intelligence

169 works · page 1 of 2 · the most cited first · ← Allen Institute for Artificial Intelligence

1 2 next →

1. SciBERT: A Pretrained Language Model for Scientific TextIz Beltagy, Kyle Lo, Arman Cohan2019 · 3,548 citations
2. TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading ComprehensionMandar Joshi, Eunsol Choi, Daniel Weld, et al.2017 · 3,204 citations
3. SpanBERT: Improving Pre-training by Representing and Predicting SpansMandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,580 citations
4. VisualBERT: A Simple and Performant Baseline for Vision and LanguageLiunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,510 citations
5. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?Sewon Min, Xinxi Lyu, Ari Holtzman, et al.2022 · 1,423 citations
6. COMET: Commonsense Transformers for Automatic Knowledge Graph ConstructionAntoine Bosselut, Hannah Rashkin, Maarten Sap, et al.2019 · 1,282 citations
7. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsSamuel Gehman, Suchin Gururangan, Maarten Sap, et al.2020 · 1,277 citations
8. End-to-end Neural Coreference ResolutionKenton Lee, Luheng He, Mike Lewis, et al.2017 · 1,277 citations
9. PIQA: Reasoning about Physical Commonsense in Natural LanguageYonatan Bisk, Rowan Zellers, Ronan Le Bras, et al.2019 · 1,218 citations
10. Gender Bias in Coreference Resolution: Evaluation and Debiasing MethodsJieyu Zhao, Tianlu Wang, Mark Yatskar, et al.2018 · 1,186 citations
11. The Risk of Racial Bias in Hate Speech DetectionMaarten Sap, Dallas Card, Saadia Gabriel, et al.2019 · 1,148 citations
12. QuAC: Question Answering in ContextEunsol Choi, He He, Mohit Iyyer, et al.2018 · 1,057 citations
13. Linguistic Knowledge and Transferability of Contextual RepresentationsNelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,011 citations
14. FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text GenerationSewon Min, Kalpesh Krishna, Xinxi Lyu, et al.2023 · 970 citations
15. Adversarial Example Generation with Syntactically Controlled Paraphrase NetworksMohit Iyyer, John Wieting, Kevin Gimpel, et al.2018 · 936 citations
16. Is Attention Interpretable?Sofia Serrano, Noah A. Smith2019 · 885 citations
17. UNIFIEDQA: Crossing Format Boundaries with a Single QA SystemDaniel Khashabi, Sewon Min, Tushar Khot, et al.2020 · 843 citations
18. Entity, Relation, and Event Extraction with Contextualized Span RepresentationsDavid Wadden, Ulme Wennberg, Yi Luan, et al.2019 · 818 citations
19. Semi-supervised sequence tagging with bidirectional language modelsMatthew E. Peters, Waleed Ammar, Chandra Bhagavatula, et al.2017 · 786 citations
20. Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?Alon Jacovi, Yoav Goldberg2020 · 747 citations
21. ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday TasksMohit Shridhar; Jesse Thomason; Daniel Gordon; Yonatan Bisk; Winson Han; Roozbeh Mottaghi; Luke Zettlemoyer;, Dieter Fox2019 · 724 citations
22. Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsHarsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.2022 · 711 citations
23. Fact or Fiction: Verifying Scientific ClaimsDavid Wadden, Shanchuan Lin, Kyle Lo, et al.2020 · 706 citations
24. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, et al.2020 · 690 citations
25. CORD-19: The COVID-19 Open Research DatasetLucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, et al.2020 · 685 citations
26. Deep Semantic Role Labeling: What Works and What's NextLuheng He, Kenton Lee, Mike Lewis, et al.2017 · 589 citations
27. Evaluating Gender Bias in Machine TranslationGabriel Stanovsky, Noah A. Smith, Luke Zettlemoyer2019 · 588 citations
28. Dissecting Contextual Word Embeddings: Architecture and RepresentationMatthew E. Peters, Mark Neumann, Luke Zettlemoyer, et al.2018 · 585 citations
29. s1: Simple test-time scalingNiklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 584 citations
30. ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech DetectionThomas Hartvigsen, Saadia Gabriel, Hamid Palangi, et al.2022 · 571 citations
31. Simple and Effective Multi-Paragraph Reading ComprehensionChristopher Clark, Matt Gardner2017 · 556 citations
32. Cosmos QA: Machine Reading Comprehension with Contextual Commonsense ReasoningLifu Huang, Ronan Le Bras, Chandra Bhagavatula, et al.2019 · 536 citations
33. Learning to Solve Arithmetic Word Problems with Verb CategorizationMohammad Javad Hosseini, Hannaneh Hajishirzi, Oren Etzioni, et al.2014 · 513 citations
34. Crowdsourcing Multiple Choice Science QuestionsJohannes Welbl, Nelson F. Liu, Matt Gardner2017 · 513 citations
35. Assessing BERT's Syntactic AbilitiesYoav Goldberg2019 · 509 citations
36. Gender Bias in Contextualized Word EmbeddingsJieyu Zhao, Tianlu Wang, Mark Yatskar, et al.2019 · 503 citations
37. A-OKVQA: A Benchmark for Visual Question Answering using World KnowledgeDustin Schwenk, Apoorv Khandelwal, Christopher Clark, et al.2022 · 490 citations
38. BERT for Coreference Resolution: Baselines and AnalysisMandar Joshi, Omer Levy, Luke Zettlemoyer, et al.2019 · 488 citations
39. Null It Out: Guarding Protected Attributes by Iterative Nullspace ProjectionShauli Ravfogel, Yanai Elazar, Hila Gonen, et al.2020 · 480 citations
40. Defending Against Neural Fake NewsRowan Zellers, Ari Holtzman, Hannah Rashkin, et al.2019 · 461 citations
41. Quality at a Glance: An Audit of Web-Crawled Multilingual DatasetsJulia Kreutzer, Isaac Caswell, Lisa Wang, et al.2021 · 447 citations
42. oLMpics — On what Language Model Pre-training CapturesAlon Talmor, Yanai Elazar, Yoav Goldberg, et al.2019 · 432 citations
43. Deep Communicating Agents for Abstractive SummarizationAsli Celikyilmaz, Antoine Bosselut, Xiaodong He, et al.2018 · 431 citations
44. A general framework for information extraction using dynamic span graphsYi Luan, Dave Wadden, Luheng He, et al.2019 · 427 citations
45. Neural AMR: Sequence-to-Sequence Models for Parsing and GenerationIoannis Konstas, Srinivasan Iyer, Mark Yatskar, et al.2017 · 425 citations
46. UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language ModelsTianbao Xie, Chen Henry Wu, Peng Shi, et al.2022 · 405 citations
47. DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-ExpertsAlisa Liu, Maarten Sap, Ximing Lu, et al.2021 · 399 citations
48. Construction of the Literature Graph in Semantic ScholarWaleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, et al.2018 · 397 citations
49. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsElad Ben-Zaken, Shauli Ravfogel, Yoav Goldberg2021 · 388 citations
50. ♫ MuSiQue: Multihop Questions via Single-hop Question CompositionHarsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.2022 · 384 citations
51. Tulu 3: Pushing Frontiers in Open Language Model Post-TrainingNathan Lambert, Jacob Morrison, Valentina Pyatkin, et al.2024 · 379 citations
52. Transformers as Soft Reasoners over LanguagePeter Clark, Oyvind Tafjord, Kyle Richardson2020 · 375 citations
53. MRQA 2019 Shared Task: Evaluating Generalization in Reading ComprehensionAdam Fisch, Alon Talmor, Robin Jia, et al.2019 · 375 citations
54. Editing Models with Task ArithmeticGabriel Ilharco, Marco Tulio Ribeiro, Mitchell Wortsman, et al.2022 · 374 citations
55. Green AIRoy Schwartz, Jesse Dodge, Noah A. Smith, et al.2019 · 370 citations
56. Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language DetectionMaarten Sap, Swabha Swayamdipta, Laura Vianna, et al.2022 · 364 citations
57. Adversarial Removal of Demographic Attributes from Text DataYanai Elazar, Yoav Goldberg2018 · 357 citations
58. Do NLP Models Know Numbers? Probing Numeracy in EmbeddingsEric Wallace, Yizhong Wang, Sujian Li, et al.2019 · 348 citations
59. Toxicity in chatgpt: Analyzing persona-assigned language modelsAmeet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, et al.2023 · 344 citations
60. Complexity-Based Prompting for Multi-Step ReasoningYao Fu, Hao Peng, Ashish Sabharwal, et al.2022 · 343 citations
61. Symbolic Knowledge Distillation: from General Language Models to Commonsense ModelsPeter West, Chandra Bhagavatula, Jack Hessel, et al.2022 · 343 citations
62. Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary SpaceMor Geva, Avi Caciularu, Kevin Ro Wang, et al.2022 · 342 citations
63. DREAM: A Challenge Data Set and Models for Dialogue-Based Reading ComprehensionKai Sun, Dian Yu, Jianshu Chen, et al.2019 · 331 citations
64. ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural LanguageOyvind Tafjord, Bhavana Dalvi, Peter Clark2021 · 331 citations
65. Unsupervised Domain Clusters in Pretrained Language ModelsRoee Aharoni, Yoav Goldberg2020 · 326 citations
66. LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative FusionDongfu Jiang, Xiang Ren, Bill Yuchen Lin2023 · 314 citations
67. WANLI: Worker and AI Collaboration for Natural Language Inference Dataset CreationAlisa Liu, Swabha Swayamdipta, Noah A. Smith, et al.2022 · 312 citations
68. Multi-hop Reading Comprehension through Question Decomposition and RescoringSewon Min, Victor Zhong, Luke Zettlemoyer, et al.2019 · 306 citations
69. Abductive Commonsense ReasoningChandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, et al.2019 · 301 citations
70. Learning to Write with Cooperative DiscriminatorsAri Holtzman, Jan Buys, Maxwell Forbes, et al.2018 · 301 citations
71. S2ORC: The Semantic Scholar Open Research CorpusKyle Lo, Lucy Lu Wang, Mark Neumann, et al.2019 · 297 citations
72. Structural Scaffolds for Citation Intent Classification in Scientific PublicationsArman Cohan, Waleed Ammar, Madeleine van Zuylen, et al.2019 · 287 citations
73. Metaphor as a Medium for Emotion: An Empirical StudySaif Mohammad, Ekaterina Shutova, Peter Turney2016 · 285 citations
74. A Dataset of Peer Reviews (PeerRead): Collection, Insights and NLP ApplicationsDongyeop Kang, Waleed Ammar, Bhavana Dalvi, et al.2018 · 274 citations
75. Representing Schema Structure with Graph Neural Networks for Text-to-SQL ParsingBen Bogin, Jonathan Berant, Matt Gardner2019 · 272 citations
76. Surface Form Competition: Why the Highest Probability Answer Isn't Always RightAri Holtzman, Peter West, Vered Shwartz, et al.2021 · 271 citations
77. Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving ModelsTongshuang Wu, Marco Tulio Ribeiro, Jeffrey Heer, et al.2021 · 271 citations
78. Injecting Numerical Reasoning Skills into Language ModelsMor Geva, Ankit Gupta, Jonathan Berant2020 · 268 citations
79. TLDR: Extreme Summarization of Scientific DocumentsIsabel Cachola, Kyle Lo, Arman Cohan, et al.2020 · 260 citations
80. Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential ReasoningPradeep Dasigi, Nelson F. Liu, Ana Marasovic, et al.2019 · 256 citations
81. The Multilingual Amazon Reviews CorpusPhillip Keung, Yichao Lu, György Szarvas, et al.2020 · 255 citations
82. Neural Cross-Lingual Named Entity Recognition with Minimal ResourcesJiateng Xie, Zhilin Yang, Graham Neubig, et al.2018 · 247 citations
83. MAUVE: Measuring the Gap Between Neural Text and Human Text using Divergence FrontiersKrishna Pillutla, Swabha Swayamdipta, Rowan Zellers, et al.2021 · 243 citations
84. Amnesic Probing: Behavioral Explanation with Amnesic CounterfactualsYanai Elazar, Shauli Ravfogel, Alon Jacovi, et al.2021 · 241 citations
85. Noisy Channel Language Model Prompting for Few-Shot Text ClassificationSewon Min, Mike Lewis, Hannaneh Hajishirzi, et al.2021 · 238 citations
86. Reframing Instructional Prompts to GPTk's LanguageSwaroop Mishra, Daniel Khashabi, Chitta Baral, et al.2022 · 236 citations
87. COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsJena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, et al.2020 · 235 citations
88. MultiQA: An Empirical Investigation of Generalization and Transfer in Reading ComprehensionAlon Talmor, Jonathan Berant2019 · 234 citations
89. Evaluating Open-Domain Question Answering in the Era of Large Language ModelsEhsan Kamalloo, Nouha Dziri, Charles Clarke, et al.2023 · 233 citations
90. A Discrete Hard EM Approach for Weakly Supervised Question AnsweringSewon Min, Danqi Chen, Hannaneh Hajishirzi, et al.2019 · 233 citations
91. Compositional Questions Do Not Necessitate Multi-hop ReasoningSewon Min, Eric Wallace, Sameer Singh, et al.2019 · 231 citations
92. Specializing Smaller Language Models towards Multi-Step ReasoningYao Fu, Hao Peng, Litu Ou, et al.2023 · 222 citations
93. How Language Model Hallucinations Can SnowballMuru Zhang, Ofir Press, William Merrill, et al.2023 · 221 citations
94. Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language ModelsSeungone Kim, Juyoung Suk, Shayne Longpre, et al.2024 · 220 citations
95. Break It Down: A Question Understanding BenchmarkTomer Wolfson, Mor Geva, Ankit Gupta, et al.2020 · 218 citations
96. SciREX: A Challenge Dataset for Document-Level Information ExtractionSarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, et al.2020 · 217 citations
97. Real-Time Open-Domain Question Answering with Dense-Sparse Phrase IndexMinjoon Seo, Jinhyuk Lee, Tom Kwiatkowski, et al.2019 · 216 citations
98. Measuring Association Between Labels and Free-Text RationalesSarah Wiegreffe, Ana Marasović, Noah A. Smith2021 · 215 citations
99. Maieutic Prompting: Logically Consistent Reasoning with Recursive ExplanationsJaehun Jung, Lianhui Qin, Sean Welleck, et al.2022 · 213 citations
100. Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language ModelsMosh Levy, Alon Jacoby, Yoav Goldberg2024 · 212 citations

1 2 next →

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/labs/allen-institute-for-artificial-intelligence/works/