Who cites «Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference»
- Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 13,703 citations
- Language Models as Knowledge Bases?Conference on Empirical Methods in Natural Language Processing (EMNLP)Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.2019 · 2,992 citations
- SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsarXiv:1905.00537Alex Wang, Yada Pruksachatkun, Nikita Nangia, et al.2019 · 2,190 citations
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,703 citations
- Multitask Prompted Training Enables Zero-Shot Task GeneralizationarXiv:2110.08207Victor Sanh, Albert Webson, Colin Raffel, et al.2021 · 1,581 citations
- Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data EngineeringShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,549 citations
- Climbing towards NLU: On Meaning, Form, and Understanding in the Age of DataAnnual Meeting of the Association for Computational Linguistics (ACL)Emily M. Bender, Alexander Koller2020 · 1,375 citations
- BoolQ: Exploring the Surprising Difficulty of Natural Yes/No QuestionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Christopher Clark, Kenton Lee, Ming-Wei Chang, et al.2019 · 1,301 citations
- A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
- Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal2021 · 883 citations
- A Survey on Automated Fact-CheckingTransactions of the Association for Computational Linguistics (TACL)Zhijiang Guo, Michael Schlichtkrull, Andreas Vlachos2022 · 646 citations
- Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language ModelarXiv:2201.11990Shaden Smith, Mostofa Patwary, Brandon Norick, et al.2022 · 602 citations
- Inherent Disagreements in Human Textual InferencesEllie Pavlick, Tom Kwiatkowski2019 · 451 citations
- Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Tobias Falke, Leonardo F. R. Ribeiro, Prasetya Ajie Utama, et al.2019 · 444 citations
- Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot FlyAnnual Meeting of the Association for Computational Linguistics (ACL)Nora Kassner, Hinrich Schütze2020 · 431 citations
- Factual Probing Is [MASK]: Learning vs. Learning to RecallConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Dan Friedman, Danqi Chen2021 · 411 citations
- Do Prompt-Based Models Really Understand the Meaning of Their Prompts?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Albert Webson, Ellie Pavlick2022 · 398 citations
- FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Esin Durmus, He He, Mona Diab2020 · 352 citations
- WANLI: Worker and AI Collaboration for Natural Language Inference Dataset CreationarXiv:2201.05955Alisa Liu, Swabha Swayamdipta, Noah A. Smith, et al.2022 · 314 citations
- Gender Bias in Machine TranslationTransactions of the Association for Computational Linguistics (TACL)Beatrice Savoldi, Marco Gaido, Luisa Bentivogli, et al.2021 · 310 citations
- Discovering Language Model Behaviors with Model-Written EvaluationsarXiv:2212.09251Ethan Perez, Sam Ringer, Kamilė Lukošiūtė, et al.2022 · 307 citations
- Muppet: Massive Multi-task Representations with Pre-FinetuningConference on Empirical Methods in Natural Language Processing (EMNLP)Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, et al.2021 · 299 citations
- Towards Debiasing Fact Verification ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Tal Schuster, Darsh Shah, Yun Jie Serene Yeo, et al.2019 · 296 citations
- Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for LittleConference on Empirical Methods in Natural Language Processing (EMNLP)Koustuv Sinha, Robin Jia, Dieuwke Hupkes, et al.2021 · 292 citations
- Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Tal Schuster, Adam Fisch, Regina Barzilay2021 · 289 citations
- Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Tongshuang Wu, Marco Tulio Ribeiro, Jeffrey Heer, et al.2021 · 272 citations
- Unlearn Dataset Bias in Natural Language Inference by Fitting the ResidualWorkshop on Deep Learning Approaches for Low-Resource NLPHe He, Sheng Zha, Haohan Wang2019 · 254 citations
- An Empirical Survey of Data Augmentation for Limited Data Learning in NLPTransactions of the Association for Computational Linguistics (TACL)Jiaao Chen, Derek Tam, Colin Raffel, et al.2023 · 253 citations
- Measuring and Reducing Gendered Correlations in Pre-trained ModelsarXiv:2010.06032Kellie Webster, Xuezhi Wang, Ian Tenney, et al.2020 · 253 citations
- DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT ModelsConference on Neural Information Processing Systems (NeurIPS)Boxin Wang, Weixin Chen, Hengzhi Pei, et al.2023 · 246 citations
- CLUE: A Chinese Language Understanding Evaluation BenchmarkarXiv:2004.05986Liang Xu, Hai Hu, Xuanwei Zhang, et al.2020 · 243 citations
- What Happens To BERT Embeddings During Fine-tuning?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLPAmil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, et al.2020 · 218 citations
- Syntactic Data Augmentation Increases Robustness to Inference HeuristicsAnnual Meeting of the Association for Computational Linguistics (ACL)Junghyun Min, R. Thomas McCoy, Dipanjan Das, et al.2020 · 217 citations
- Measuring Association Between Labels and Free-Text RationalesConference on Empirical Methods in Natural Language Processing (EMNLP)Sarah Wiegreffe, Ana Marasović, Noah A. Smith2021 · 215 citations
- TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction TaskAnnual Meeting of the Association for Computational Linguistics (ACL)Christoph Alt, Aleksandra Gabryszak, Leonhard Hennig2020 · 213 citations
- Prompting GPT-3 To Be ReliablearXiv:2210.09150Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.2022 · 207 citations
- HateCheck: Functional Tests for Hate Speech Detection ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Paul Röttger, Bertie Vidgen, Dong Nguyen, et al.2021 · 203 citations
- Towards Faithful Model Explanation in NLP: A SurveyComputational LinguisticsQing Lyu, Marianna Apidianaki, Chris Callison-Burch2024 · 195 citations
- Explaining Black Box Predictions and Unveiling Data Artifacts through Influence FunctionsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaochuang Han, Byron C. Wallace, Yulia Tsvetkov2020 · 181 citations
- Translation Artifacts in Cross-lingual Transfer LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Mikel Artetxe, Gorka Labaka, Eneko Agirre2020 · 175 citations
- Impact of Pretraining Term Frequencies on Few-Shot Numerical ReasoningFindings of the Association for Computational LinguisticsYasaman Razeghi, Robert L Logan IV, Matt Gardner, et al.2022 · 162 citations
- Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionPaloma Jeretic, Alex Warstadt, Suvrat Bhooshan, et al.2020 · 161 citations
- Mind the Trade-off: Debiasing NLU Models without Degrading the In-distribution PerformanceAnnual Meeting of the Association for Computational Linguistics (ACL)Prasetya Ajie Utama, Nafise Sadat Moosavi, Iryna Gurevych2020 · 159 citations
- Measure and Improve Robustness in NLP Models: A SurveyConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Xuezhi Wang, Haohan Wang, Diyi Yang2022 · 148 citations
- Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and EvaluationFindings of the Association for Computational LinguisticsMarius Mosbach, Tiago Pimentel, Shauli Ravfogel, et al.2023 · 147 citations
- OCNLI: Original Chinese Natural Language InferencearXiv:2010.05444Hai Hu, Kyle Richardson, Liang Xu, et al.2020 · 147 citations
- Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge BasesAnnual Meeting of the Association for Computational Linguistics (ACL)Boxi Cao, Hongyu Lin, Xianpei Han, et al.2021 · 141 citations
- Probing the Probing Paradigm: Does Probing Accuracy Entail Task Relevance?Conference of the European Chapter of the Association for Computational Linguistics (EACL)Abhilasha Ravichander, Yonatan Belinkov, Eduard Hovy2021 · 141 citations
- Exploring Length Generalization in Large Language ModelsarXiv:2207.04901Cem Anil, Yuhuai Wu, Anders Andreassen, et al.2022 · 138 citations
- A fine-grained comparison of pragmatic language understanding in humans and language modelsJennifer Hu, Sammy Floyd, Olessia Jouravlev, et al.2023 · 136 citations
- FLUTE: Figurative Language Understanding through Textual ExplanationsConference on Empirical Methods in Natural Language Processing (EMNLP)Tuhin Chakrabarty, Arkadiy Saakyan, Debanjan Ghosh, et al.2022 · 132 citations
- UnNatural Language InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, et al.2021 · 132 citations
- Generalization in NLI: Ways (Not) To Go Beyond Simple HeuristicsWorkshop on Insights from Negative Results in NLPPrajjwal Bhargava, Aleksandr Drozd, Anna Rogers2021 · 127 citations
- WiCE: Real-World Entailment for Claims in WikipediaConference on Empirical Methods in Natural Language Processing (EMNLP)Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, et al.2023 · 109 citations
- End-to-End Bias Mitigation by Modelling Biases in CorporaAnnual Meeting of the Association for Computational Linguistics (ACL)Rabeeh Karimi Mahabadi, Yonatan Belinkov, James Henderson2020 · 107 citations
- Investigating Reasons for Disagreement in Natural Language InferenceTransactions of the Association for Computational Linguistics (TACL)Nan-Jiang Jiang, Marie-Catherine de Marneffe2022 · 104 citations
- Look at the First Sentence: Position Bias in Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Miyoung Ko, Jinhyuk Lee, Hyunjae Kim, et al.2020 · 102 citations
- Probing Natural Language Inference Models through Semantic FragmentsProceedings of the AAAI Conference on Artificial IntelligenceKyle Richardson, Hai Hu, Lawrence S. Moss, et al.2019 · 102 citations
- Evaluating Attribution in Dialogue Systems: The BEGIN BenchmarkTransactions of the Association for Computational Linguistics (TACL)Nouha Dziri, Hannah Rashkin, Tal Linzen, et al.2022 · 99 citations
- Generating Data to Mitigate Spurious Correlations in Natural Language Inference DatasetsAnnual Meeting of the Association for Computational Linguistics (ACL)Yuxiang Wu, Matt Gardner, Pontus Stenetorp, et al.2022 · 98 citations
- Understanding by Understanding Not: Modeling Negation in Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, et al.2021 · 98 citations
- Tailor: Generating and Perturbing Text with Semantic ControlsAnnual Meeting of the Association for Computational Linguistics (ACL)Alexis Ross, Tongshuang Wu, Hao Peng, et al.2022 · 93 citations
- LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mihir Parmar, Nisarg Patel, Neeraj Varshney, et al.2024 · 92 citations
- Language Generation Models Can Cause Harm: So What Can We Do About It? An Actionable SurveyConference of the European Chapter of the Association for Computational Linguistics (EACL)Sachin Kumar, Vidhisha Balachandran, Lucille Njoo, et al.2023 · 87 citations
- Diagnosing the First-Order Logical Reasoning Ability Through LogicNLIConference on Empirical Methods in Natural Language Processing (EMNLP)Jidong Tian, Yitian Li, Wenqing Chen, et al.2021 · 86 citations
- NL-Augmenter: A Framework for Task-Sensitive Natural Language AugmentationNorthern European Journal of Language TechnologyKaustubh Dhole, Varun Gangal, Sebastian Gehrmann, et al.2023 · 85 citations
- Are Pretrained Language Models Symbolic Reasoners over Knowledge?Conference on Computational Natural Language Learning (CoNLL)Nora Kassner, Benno Krojer, Hinrich Schütze2020 · 79 citations
- Evaluating BERT for natural language inference: A case study on the CommitmentBankConference on Empirical Methods in Natural Language Processing (EMNLP)Nanjiang Jiang, Marie-Catherine de Marneffe2019 · 72 citations
- Towards Robustifying NLI Models Against Lexical Dataset BiasesAnnual Meeting of the Association for Computational Linguistics (ACL)Xiang Zhou, Mohit Bansal2020 · 70 citations
- IMPLI: Investigating NLI Models' Performance on Figurative LanguageKevin Stowe, Prasetya Utama, Iryna Gurevych2022 · 68 citations
- VALUE: Understanding Dialect Disparity in NLUCaleb Ziems, Jiaao Chen, Camille Harris, et al.2022 · 65 citations
- How well do NLI models capture verb veridicality?Alexis Ross, Ellie Pavlick2019 · 61 citations
- ConjNLI: Natural Language Inference Over Conjunctive SentencesConference on Empirical Methods in Natural Language Processing (EMNLP)Swarnadeep Saha, Yixin Nie, Mohit Bansal2020 · 50 citations
- ANLIzing the Adversarial Natural Language Inference DatasetSociety for Computation in Linguistics (SCiL)Adina Williams, Tristan Thrush, Douwe Kiela2022 · 48 citations
- Pragmatic competence of pre-trained language models through the lens of discourse connectivesConference on Computational Natural Language Learning (CoNLL)Lalchand Pandia, Yan Cong, Allyson Ettinger2021 · 42 citations
- NOPE: A Corpus of Naturally-Occurring Presuppositions in EnglishAlicia Parrish, Sebastian Schuster, Alex Warstadt, et al.2021 · 40 citations
- Identifying inherent disagreement in natural language inferenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Xinliang Frederick Zhang, Marie-Catherine de Marneffe2021 · 38 citations
- An Empirical Study on Model-agnostic Debiasing Strategies for Robust Natural Language InferenceConference on Computational Natural Language Learning (CoNLL)Tianyu Liu, Xin Zheng, Xiaoan Ding, et al.2020 · 36 citations
- MedNLI Is Not Immune: Natural Language Inference Artifacts in the Clinical DomainAnnual Meeting of the Association for Computational Linguistics (ACL)Christine Herlihy, Rachel Rudinger2021 · 30 citations
- Context Matters: A Pragmatic Study of PLMs' Negation UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Reto Gubelmann, Siegfried Handschuh2022 · 28 citations
- Exploring Transitivity in Neural NLI Models through VeridicalityConference of the European Chapter of the Association for Computational Linguistics (EACL)Hitomi Yanaka, Koji Mineshima, Kentaro Inui2021 · 27 citations
- HypoNLI: Exploring the Artificial Patterns of Hypothesis-only Bias in Natural Language InferenceLanguage Resources and Evaluation Conference (LREC)Tianyu Liu, Xin Zheng, Baobao Chang, et al.2020 · 27 citations
- Not another Negation Benchmark: The NaN-NLI Test Suite for Sub-clausal NegationConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Hung Thinh Truong, Yulia Otmakhova, Timothy Baldwin, et al.2022 · 24 citations
- Beyond Leaderboards: A survey of methods for revealing weaknesses in Natural Language Inference data and modelsarXiv:2005.14709Viktor Schlegel, Goran Nenadic, Riza Batista-Navarro2020 · 24 citations
- MultiPragEval: Multilingual Pragmatic Evaluation of Large Language ModelsProceedings of the 2nd GenBench Workshop on Generalisation (Benchmarking) in NLPDojun Park, Jiwoo Lee, Seohyun Park, et al.2024 · 17 citations
- Adversarial Analysis of Natural Language Inference SystemsarXiv:1912.03441Tiffany Chien, Jugal Kalita2019 · 15 citations
- An Annotated Corpus of Reference Resolution for Interpreting Common GroundingProceedings of the AAAI Conference on Artificial IntelligenceTakuma Udagawa, Akiko Aizawa2019 · 14 citations
- Looking at the Overlooked: An Analysis on the Word-Overlap Bias in Natural Language InferenceConference on Empirical Methods in Natural Language Processing (EMNLP)Sara Rajaee, Yadollah Yaghoobzadeh, Mohammad Taher Pilehvar2022 · 13 citations
- Partial-input baselines show that NLI models can ignore context, but they don't.Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Neha Srikanth, Rachel Rudinger2022 · 13 citations
- Investigating the Performance of Transformer-Based NLI Models on Presuppositional InferencesInternational Conference on Computational Linguistics (COLING)Jad Kabbara, Jackie Chi Kit Cheung2022 · 12 citations
- Combining Event Semantics and Degree Semantics for Natural Language InferenceIzumi Haruta, Koji Mineshima, Daisuke Bekki2020 · 12 citations
- How Often Are Errors in Natural Language Reasoning Due to Paraphrastic Variability?Transactions of the Association for Computational Linguistics (TACL)Neha Srikanth, Marine Carpuat, Rachel Rudinger2024 · 10 citations
- How Fast can BERT Learn Simple Natural Language Inference?Conference of the European Chapter of the Association for Computational Linguistics (EACL)Yi-Chung Lin, Keh-Yih Su2021 · 10 citations
- Decomposing Natural Logic Inferences for Neural NLIBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLPJulia Rozanova, Deborah Ferreira, Mokanarangan Thayaparan, et al.2022 · 8 citations
- Simple but Challenging: Natural Language Inference Models Fail on Simple SentencesFindings of the Association for Computational LinguisticsCheng Luo, Wei Liu, Jieyu Lin, et al.2022 · 7 citations
- Annotation Difficulties in Natural Language InferenceBrazilian Symposium in Information and Human Language TechnologyAikaterini-Lida Kalouli, Livy Real, Annebeth Buis, et al.2021 · 5 citations
- A guide to the dataset explosion in QA, NLI, and commonsense reasoningAnna Rogers, Anna Rumshisky2020 · 4 citations
- Estonian WinoGrande Dataset: Comparative Analysis of LLM Performance on Human and Machine TranslationLanguage Resources and Evaluation Conference (LREC)Marii Ojastu, Hele-Andra Kuulmets, Aleksei Dorkin, et al.2026 · 3 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/mccoy-2019-right-wrong-reasons-diagnosing-syntactic/cited-by/