🧮 Reasoning
Logic, inference and step-by-step problem solving: entailment, commonsense, mathematics.
Papers (508)
- DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over ParagraphsDheeru Dua, Yizhong Wang, Pradeep Dasigi, et al.2019 · 943 citations
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesarXiv:2507.06261Gheorghe Comanici, Eric Bieber, Mike Schaekermann, et al.2025 · 906 citations
- Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal2021 · 883 citations
- A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and InteractivityarXiv:2302.04023Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, et al.2023 · 876 citations
- Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Conference on Empirical Methods in Natural Language Processing (EMNLP)Chengwei Qin, Aston Zhang, Zhuosheng Zhang, et al.2023 · 823 citations
- Reasoning about Entailment with Neural AttentionarXiv:1509.06664Tim Rocktaschel, Edward Grefenstette, Karl Moritz Hermann, et al.2015 · 791 citations
- Supervised Learning of Universal Sentence Representations from Natural Language Inference DataConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Conneau, Douwe Kiela, Holger Schwenk, et al.2017 · 784 citations
- Towards Reasoning in Large Language Models: A SurveyFindings of the Association for Computational LinguisticsJie Huang, Kevin Chen-Chuan Chang2023 · 778 citations
- ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningFindings of the Association for Computational LinguisticsAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 745 citations
- STaR: Bootstrapping Reasoning With ReasoningEric Zelikman, Yuhuai Wu, Jesse Mu, et al.2022 · 743 citations
- Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning StepsInternational Conference on Computational Linguistics (COLING)Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, et al.2020 · 735 citations
- Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step QuestionsAnnual Meeting of the Association for Computational Linguistics (ACL)Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.2022 · 711 citations
- Explain Yourself! Leveraging Language Models for Commonsense ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.2019 · 693 citations
- Automatic Chain of Thought Prompting in Large Language ModelsarXiv:2210.03493Zhuosheng Zhang, Aston Zhang, Mu Li, et al.2022 · 690 citations
- Social Bias Frames: Reasoning about Social and Power Implications of LanguageAnnual Meeting of the Association for Computational Linguistics (ACL)Maarten Sap, Saadia Gabriel, Lianhui Qin, et al.2020 · 681 citations
- A Corpus for Reasoning About Natural Language Grounded in Photographs (NLVR2)Alane Suhr, Stephanie Zhou, Ally Zhang, et al.2019 · 644 citations
- e-SNLI: Natural Language Inference with Natural Language ExplanationsarXiv:1812.01193Oana-Maria Camburu, Tim Rocktäschel, Thomas Lukasiewicz, et al.2018 · 613 citations
- A simple neural network module for relational reasoningarXiv:1706.01427Adam Santoro, David Raposo, David G. T. Barrett, et al.2017 · 593 citations
- Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought PromptingConference on Neural Information Processing Systems (NeurIPS)Miles Turpin, Julian Michael, Ethan Perez, et al.2023 · 568 citations
- Improving Factuality and Reasoning in Language Models through Multiagent DebatearXiv:2305.14325Yilun Du, Shuang Li, Antonio Torralba, et al.2023 · 565 citations
- Large Language Models Can Self-ImproveConference on Empirical Methods in Natural Language Processing (EMNLP)Jiaxin Huang, Shixiang Gu, Le Hou, et al.2023 · 563 citations
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsarXiv:2309.12284Longhui Yu, Weisen Jiang, Han Shi, et al.2023 · 556 citations
- gpt-oss-120b & gpt-oss-20b Model CardarXiv:2508.10925OpenAI: Sandhini Agarwal, Lama Ahmad, Jason Ai, et al.2025 · 555 citations
- Cosmos QA: Machine Reading Comprehension with Contextual Commonsense ReasoningLifu Huang, Ronan Le Bras, Chandra Bhagavatula, et al.2019 · 539 citations
- Towards AI-Complete Question Answering: A Set of Prerequisite Toy TasksJason Weston, Antoine Bordes, Sumit Chopra, et al.2015 · 537 citations
- MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Chaoyou Fu, Peixian Chen, Yunhang Shen, et al.2023 · 529 citations
- SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual EntailmentInternational Workshop on Semantic Evaluation (SemEval)Marco Marelli, Luisa Bentivogli, Marco Baroni, et al.2014 · 526 citations
- Breaking NLI Systems with Sentences that Require Simple Lexical InferencesMax Glockner, Vered Shwartz, Yoav Goldberg2018 · 517 citations
- FinQA: A Dataset of Numerical Reasoning over Financial DataConference on Empirical Methods in Natural Language Processing (EMNLP)Zhiyu Chen, Wenhu Chen, Charese Smiley, et al.2021 · 511 citations
- MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based FormalismsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Aida Amini, Saadia Gabriel, Shanchuan Lin, et al.2019 · 501 citations
- Learning Natural Language Inference with LSTMConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Shuohang Wang, Jing Jiang2016 · 495 citations
- Language Models are Multilingual Chain-of-Thought ReasonersarXiv:2210.03057Freda Shi, Mirac Suzgun, Markus Freitag, et al.2022 · 490 citations
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human AnnotationsAnnual Meeting of the Association for Computational Linguistics (ACL)Peiyi Wang, Lei Li, Zhihong Shao, et al.2024 · 482 citations
- Solving olympiad geometry without human demonstrationsNatureTrieu H. Trinh, Yuhuai Wu, Quoc V. Le, et al.2024 · 482 citations
- XCOPA: A Multilingual Dataset for Causal Commonsense ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Edoardo Maria Ponti, Goran Glavaš, Olga Majewska, et al.2020 · 465 citations
- OpenDialKG: Explainable Conversational Reasoning with Attention-based Walks over Knowledge GraphsAnnual Meeting of the Association for Computational Linguistics (ACL)Seungwhan Moon, Pararth Shah, Anuj Kumar, et al.2019 · 448 citations
- Mathematical Capabilities of ChatGPTConference on Neural Information Processing Systems (NeurIPS)Simon Frieder, Luca Pinchetti, Alexis Chevalier, et al.2023 · 446 citations
- Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Tobias Falke, Leonardo F. R. Ribeiro, Prasetya Ajie Utama, et al.2019 · 444 citations
- MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsarXiv:2310.02255Pan Lu, Hritik Bansal, Tony Xia, et al.2023 · 441 citations
- Natural Language Inference by Tree-Based Convolution and Heuristic MatchingAnnual Meeting of the Association for Computational Linguistics (ACL)Lili Mou, Rui Men, Ge Li, et al.2016 · 427 citations
- Commonsense Knowledge Mining from Pretrained ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Joe Davison, Joshua Feldman, Alexander Rush2019 · 413 citations
- Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-ImprovementarXiv:2409.12122An Yang, Beichen Zhang, Binyuan Hui, et al.2024 · 410 citations
- LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical ReasoningInternational Joint Conference on Artificial IntelligenceJian Liu, Leyang Cui, Hanmeng Liu, et al.2020 · 397 citations
- Large Language Models Cannot Self-Correct Reasoning YetarXiv:2310.01798Jie Huang, Xinyun Chen, Swaroop Mishra, et al.2023 · 396 citations
- CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual ReasoningarXiv:1612.06890Justin Johnson, Bharath Hariharan, Laurens van der Maaten, et al.2016 · 390 citations
- ♫ MuSiQue: Multihop Questions via Single-hop Question CompositionTransactions of the Association for Computational Linguistics (TACL)Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.2022 · 384 citations
- Dialogue Natural Language InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Sean Welleck, Jason Weston, Arthur Szlam, et al.2019 · 384 citations
- LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language ModelsarXiv:2308.11462Neel Guha; Julian Nyarko; Daniel E. Ho; Christopher Re; Adam Chilton; Aditya Narayana; Alex Chohlas-Wood; Austin Peters; Brandon Waldon; Daniel N. Rockmore; Diego Zambrano; Dmitry Talisman; Enam Hoque; Faiz Surani; Frank Fagan; Galit Sarfaty; Gregory M. Dickinson; Haggai Porat; Jason Hegland; Jessica Wu; Joe Nudell; Joel Niklaus; John Nay; Jonathan H. Choi; Kevin Tobia; Margaret Hagan; Megan Ma; Michael Livermore; Nikon Rasumov-Rahe; Nils Holzenberger; Noam Kolt; Peter Henderson; Sean Rehaag; Sharad Goel; Shang Gao; Spencer Williams; Sunny Gandhi; Tom Zur; Varun Iyer;, Zehua Li2023 · 381 citations
- ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading ComprehensionarXiv:1810.12885Sheng Zhang, Xiaodong Liu, Jingjing Liu, et al.2018 · 381 citations
- Reasoning with Latent Structure Refinement for Document-Level Relation ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Guoshun Nan, Zhijiang Guo, Ivan Sekulic, et al.2020 · 380 citations
- Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical ReasoningarXiv:2305.12295Liangming Pan, Alon Albalak, Xinyi Wang, et al.2023 · 370 citations
- Large Language Models Are Reasoning TeachersAnnual Meeting of the Association for Computational Linguistics (ACL)Namgyu Ho, Laura Schmid, Se-Young Yun2023 · 368 citations
- WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-InstructarXiv:2308.09583Haipeng Luo, Qingfeng Sun, Can Xu, et al.2023 · 366 citations
- Orca: Progressive Learning from Complex Explanation Traces of GPT-4arXiv:2306.02707Subhabrata Mukherjee, Arindam Mitra, Ganesh Jawahar, et al.2023 · 358 citations
- ViperGPT: Visual Inference via Python Execution for ReasoningIEEE/CVF International Conference on Computer Vision (ICCV)Didac Suris, Sachit Menon, Carl Vondrick2023 · 354 citations
- FiLM: Visual Reasoning with a General Conditioning LayerarXiv:1709.07871Ethan Perez, Florian Strub, Harm de Vries, et al.2017 · 352 citations
- Lessons from Natural Language Inference in the Clinical DomainConference on Empirical Methods in Natural Language Processing (EMNLP)Alexey Romanov, Chaitanya Shivade2018 · 348 citations
- Faithful Chain-of-Thought ReasoningInternational Joint Conference on Natural Language Processing (IJCNLP)Qing Lyu, Shreya Havaldar, Adam Stein, et al.2023 · 345 citations
- Symbolic Knowledge Distillation: from General Language Models to Commonsense ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Peter West, Chandra Bhagavatula, Jack Hessel, et al.2022 · 344 citations
- Complexity-Based Prompting for Multi-Step ReasoningarXiv:2210.00720Yao Fu, Hao Peng, Ashish Sabharwal, et al.2022 · 343 citations
- LLMLingua: Compressing Prompts for Accelerated Inference of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Huiqiang Jiang, Qianhui Wu, Chin-Yew Lin, et al.2023 · 335 citations
- Solving math word problems with process- and outcome-based feedbackarXiv:2211.14275Jonathan Uesato, Nate Kushman, Ramana Kumar, et al.2022 · 335 citations
- WANLI: Worker and AI Collaboration for Natural Language Inference Dataset CreationarXiv:2201.05955Alisa Liu, Swabha Swayamdipta, Noah A. Smith, et al.2022 · 314 citations
- Double Graph Based Reasoning for Document-level Relation ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP)Shuang Zeng, Runxin Xu, Baobao Chang, et al.2020 · 314 citations
- Neural Natural Language Inference Models Enhanced with External KnowledgeAnnual Meeting of the Association for Computational Linguistics (ACL)Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, et al.2018 · 314 citations
- Faith and Fate: Limits of Transformers on CompositionalityConference on Neural Information Processing Systems (NeurIPS)Nouha Dziri, Ximing Lu, Melanie Sclar, et al.2023 · 313 citations
- Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Pan Lu, Baolin Peng, Hao Cheng, et al.2023 · 311 citations
- Recognising Textual Entailment with Logical InferenceJohan Bos, Katja Markert2005 · 306 citations
- Abductive Commonsense ReasoningChandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, et al.2019 · 304 citations
- Large Language Models are Better Reasoners with Self-VerificationFindings of the Association for Computational LinguisticsYixuan Weng, Minjun Zhu, Fei Xia, et al.2023 · 302 citations
- MathPrompter: Mathematical Reasoning using Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Shima Imani, Liang Du, Harsh Shrivastava2023 · 298 citations
- Multimodal Chain-of-Thought Reasoning in Language ModelsarXiv:2302.00923Zhuosheng Zhang, Aston Zhang, Mu Li, et al.2023 · 297 citations
- Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Yanlin Feng, Xinyue Chen, Bill Yuchen Lin, et al.2020 · 296 citations
- Methods for Using Textual Entailment in Open-Domain Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Sanda Harabagiu, Andrew Hickl2006 · 289 citations
- GEAR: Graph-based Evidence Aggregating and Reasoning for Fact VerificationAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Zhou, Xu Han, Cheng Yang, et al.2019 · 288 citations
- Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 287 citations
- ReClor: A Reading Comprehension Dataset Requiring Logical ReasoningarXiv:2002.04326Weihao Yu, Zihang Jiang, Yanfei Dong, et al.2020 · 285 citations
- Analysing Mathematical Reasoning Abilities of Neural ModelsarXiv:1904.01557David Saxton, Edward Grefenstette, Felix Hill, et al.2019 · 282 citations
- A Survey of Paraphrasing and Textual Entailment MethodsJournal of Artificial Intelligence ResearchIon Androutsopoulos, Prodromos Malakasiotis2009 · 281 citations
- Large Language Models for Mathematical Reasoning: Progresses and ChallengesConference of the European Chapter of the Association for Computational Linguistics (EACL)Janice Ahn, Rishu Verma, Renze Lou, et al.2024 · 279 citations
- Llemma: An Open Language Model For MathematicsarXiv:2310.10631Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 276 citations
- Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question AnsweringarXiv:1911.10470Akari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, et al.2019 · 272 citations
- Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What MattersAnnual Meeting of the Association for Computational Linguistics (ACL)Boshi Wang, Sewon Min, Xiang Deng, et al.2023 · 269 citations
- Injecting Numerical Reasoning Skills into Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mor Geva, Ankit Gupta, Jonathan Berant2020 · 268 citations
- GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language ModelsarXiv:2410.05229Iman Mirzadeh, Keivan Alizadeh, Hooman Shahrokhi, et al.2024 · 262 citations
- Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense KnowledgeAnnual Meeting of the Association for Computational Linguistics (ACL)Todor Mihaylov, Anette Frank2018 · 260 citations
- Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential ReasoningPradeep Dasigi, Nelson F. Liu, Ana Marasovic, et al.2019 · 258 citations
- UKP-Athene: Multi-Sentence Textual Entailment for Claim VerificationWorkshop on Fact Extraction and VERification (FEVER)Andreas Hanselowski, Hao Zhang, Zile Li, et al.2018 · 258 citations
- MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicsarXiv:2109.00110Kunhao Zheng, Jesse Michael Han, Stanislas Polu2021 · 255 citations
- Unlearn Dataset Bias in Natural Language Inference by Fitting the ResidualWorkshop on Deep Learning Approaches for Low-Resource NLPHe He, Sheng Zha, Haohan Wang2019 · 254 citations
- Scaling Relationship on Learning Mathematical Reasoning with Large Language ModelsarXiv:2308.01825Zheng Yuan, Hongyi Yuan, Chengpeng Li, et al.2023 · 252 citations
- Measuring Faithfulness in Chain-of-Thought ReasoningarXiv:2307.13702Tamera Lanham, Anna Chen, Ansh Radhakrishnan, et al.2023 · 249 citations
- LeanDojo: Theorem Proving with Retrieval-Augmented Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kaiyu Yang, Aidan M. Swope, Alex Gu, et al.2023 · 248 citations
- Reasoning with Sarcasm by Reading In-BetweenAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Tay, Anh Tuan Luu, Siu Cheung Hui, et al.2018 · 248 citations
- SocialIQA: Commonsense Reasoning about Social InteractionsarXiv:1904.09728Maarten Sap, Hannah Rashkin, Derek Chen, et al.2019 · 246 citations
- MedAgents: Large Language Models as Collaborators for Zero-shot Medical ReasoningFindings of the Association for Computational LinguisticsXiangru Tang, Anni Zou, Zhuosheng Zhang, et al.2024 · 245 citations
- Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-ThoughtarXiv:2210.01240Abulhair Saparov, He He2022 · 239 citations
- Dynamically Fused Graph Network for Multi-hop ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Lin Qiu, Yunxuan Xiao, Yanru Qu, et al.2019 · 237 citations
- COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsJena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, et al.2020 · 236 citations
This page in Markdown → https://md.research.elamur.ai/free/en/topics/reasoning/page/2/