Who cites «Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks»
363 papers of our library cite it, newest first: found in their bibliographies, which we read ourselves. ← the card
- Can LLMs reason over extended multilingual contexts? Towards long-context evaluation beyond retrieval over haystacks — 2026 · Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- ImReasoner: Improving Memory-based Language Models for Reasoning-in-a-Haystack Tasks — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Improving Chain-of-Thought for Logical Reasoning via Attention-Aware Intervention — 2026 · Findings of the Association for Computational Linguistics: EACL 2026
- Instructional Text Across Disciplines: A Survey of Representations, Downstream Tasks, and Open Challenges Toward Capable AI Agents — 2026 · Computational Linguistics
- Interpretable Traces, Unexpected Outcomes: Investigating the Disconnect in Trace-Based Knowledge Distillation — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Logic Haystacks: Probing LLMs'' Long-Context Logical Reasoning (Without Easily Identifiable Unrelated Padding) — 2026 · Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 2: Short Papers)
- Macaron: Controlled, Human-Written Benchmark for Multilingual and Multicultural Reasoning via Template-Filling — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Models — 2026 · Proceedings of the Fifteenth Language Resources and Evaluation Conference
- Multi-Constraint State Tracking with Negation: A Diagnostic Benchmark for LLM World Modeling — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
- MultiGlobeQA: A Multilingual and Globally Diverse Benchmark for Geospatial Reasoning — 2026 · arXiv:2608.03882
- NormWorlds-CF: Solver-Verified Counterfactual Normative Reasoning with Metamorphic-Relation GRPO — 2026 · arXiv:2607.03957
- PBEBench: A Multi-Step Programming by Examples Reasoning Benchmark inspired by Historical Linguistics — 2026 · Findings of the Association for Computational Linguistics: ACL 2026
- QSTRBench: a New Benchmark to Evaluate the Ability of Language Models to Reason with Qualitative Spatial and Temporal Calculi — 2026 · arXiv:2605.18380
- RBCorr: Response Bias Correction in Language Models — 2026 · Proceedings of the Fifth Workshop on Generation, Evaluation and Metrics (GEM)
- SLR: Automated Synthesis for Scalable Logical Reasoning — 2026 · Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Word Surprisal Correlates with Sentential Contradiction in LLMs — 2026 · Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- A Comprehensive Survey on Long Context Language Modeling — 2025 · arXiv:2503.17407
- A Little Human Data Goes A Long Way — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- AnaToM: A Dataset Generation Framework for Evaluating Theory of Mind Reasoning Toward the Anatomy of Difficulty through Structurally Controlled Story Generation — 2025 · Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics
- Are LLMs Rigorous Logical Reasoners? Empowering Natural Language Proof Generation by Stepwise Decoding with Contrastive Learning — 2025 · Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics
- Attention Overflow: Language Model Input Blur during Long-Context Missing Items Identification — 2025 · Proceedings of the 14th International Joint Conference on Natural Language Processing and the 4th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics
- BABILong-ITA: A New Benchmark for Testing Large Language Models Effective Context Length and a Context Extension Method — 2025 · Proceedings of the Eleventh Italian Conference on Computational Linguistics (CLiC-it 2025)
- BIG-Bench Extra Hard — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Do Large Language Models excel in Complex Logical Reasoning with Formal Language? — 2025 · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
- Elements of World Knowledge ( EWoK ): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language Models — 2025
- ExpeTrans: LLMs Are Experiential Transfer Learners — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- From Reasoning to Learning: A Survey on Hypothesis Discovery and Rule Learning with Large Language Models — 2025 · arXiv:2505.21935
- Glider: Global and Local Instruction-Driven Expert Router — 2025 · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
- Improving the Language Understanding Capabilities of Large Language Models Using Reinforcement Learning — 2025 · Findings of the Association for Computational Linguistics: EMNLP 2025
- Is Large Language Model Performance on Reasoning Tasks Impacted by Different Ways Questions Are Asked? — 2025 · Findings of the Association for Computational Linguistics: ACL 2025
- Long Context Benchmark for the Russian Language — 2025 · Proceedings of the 6th Workshop on Computational Approaches to Discourse, Context and Document-Level Inferences (CODI 2025)
- More is not always better? Enhancing Many-Shot In-Context Learning with Differentiated and Reweighting Objectives — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- MultiLogicNMR(er): A Benchmark and Neural-Symbolic Framework for Non-monotonic Reasoning with Multiple Extensions — 2025 · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
- Neuron-Level Differentiation of Memorization and Generalization in Large Language Models — 2025 · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
- Non-Interactive Symbolic-Aided Chain-of-Thought for Logical Reasoning — 2025 · Proceedings of the 39th Pacific Asia Conference on Language, Information and Computation
- Overview of CCL25-Eval Task 1: The Fifth Spatial Cognition Evaluation (SpaCE2025) — 2025 · Proceedings of the 24th China National Conference on Computational Linguistics (CCL 2025)
- ProPara-CRTS: Canonical Referent Tracking for Reliable Evaluation of Entity State Tracking in Process Narratives — 2025 · Proceedings of the 16th International Conference on Computational Semantics
- Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods — 2025 · arXiv:2511.15722
- Temporal Relation Classification: An XAI Perspective — 2025 · Proceedings of the Joint 25th Nordic Conference on Computational Linguistics and 11th Baltic Conference on Human Language Technologies (NoDaLiDa/Baltic-HLT 2025)
- The ShareLM Collection and Plugin: Contributing Human-Model Chats for the Benefit of the Community — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
- Theory of Mind in Large Language Models: Assessment and Enhancement — 2025 · Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Towards Rationality in Language and Multimodal Agents: A Survey — 2025 · Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs — 2025 · Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
- Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmark — 2024 · arXiv:2401.03991
- Aquila2 Technical Report — 2024 · arXiv:2408.07410
- Are self-explanations from Large Language Models faithful? — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- BABILong: Testing the Limits of LLMs with Long Context Reasoning-in-a-Haystack — 2024 · arXiv:2406.10149
- Belief Revision: The Adaptability of Large Language Models Reasoning — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Clever Hans or Neural Theory of Mind? Stress Testing Social Reasoning in Large Language Models — 2024 · Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Enhancing Reasoning Capabilities of LLMs via Principled Synthetic Logic Corpus — 2024 · arXiv:2411.12498
- Instruction Pre-Training: Language Models are Supervised Multitask Learners — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Interpreting User Requests in the Context of Natural Language Standing Instructions — 2024 · Findings of the Association for Computational Linguistics: NAACL 2024
- JFLD: A Japanese Benchmark for Deductive Reasoning Based on Formal Logic — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- LLMs Are Prone to Fallacies in Causal Inference — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Learning Representations for Reasoning: Generalizing Across Diverse Structures — 2024 · arXiv:2410.13018
- Mind''s Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models — 2024 · arXiv:2404.03622
- OpenPI2.0: An Improved Dataset for Entity Tracking in Texts — 2024 · Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
- OpenToM: A Comprehensive Benchmark for Evaluating Theory-of-Mind Reasoning Capabilities of Large Language Models — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- P-FOLIO: Evaluating and Improving Logical Reasoning with Abundant Human-Written Reasoning Chains — 2024 · Findings of the Association for Computational Linguistics: EMNLP 2024
- PIXAR: Auto-Regressive Language Modeling in Pixel Space — 2024 · Findings of the Association for Computational Linguistics: ACL 2024
- Same Task, More Tokens: the Impact of Input Length on the Reasoning Performance of Large Language Models — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Models — 2024 · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Systematic Evaluation of Long-Context LLMs on Financial Concepts — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: Industry Track
- Teaching Small Language Models Reasoning through Counterfactual Distillation — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- TopViewRS: Vision-Language Models as Top-View Spatial Reasoners — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- Which Programming Language and What Features at Pre-training Stage Affect Downstream Logical Inference Performance? — 2024 · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
- tasksource: A Large Collection of NLP tasks with a Structured Dataset Preprocessing Framework — 2024 · Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
- 基于参数高效微调与半监督学习的空间语义理解 — 2024 · Proceedings of the 23rd Chinese National Conference on Computational Linguistics (Volume 3: Evaluations)
- A Benchmark for Reasoning with Spatial Prepositions — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- A Memory Model for Question Answering from Streaming Data Supported by Rehearsal and Anticipation of Coreference Information — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity — 2023 · arXiv:2302.04023
- AI Alignment: A Comprehensive Survey — 2023 · arXiv:2310.19852
- ALERT: Adapt Language Models to Reasoning Tasks — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond — 2023 · arXiv:2306.09841
- COLLIE: Systematic Construction of Constrained Text Generation Tasks — 2023 · arXiv:2307.08689
- Can You Follow Me? Testing Situational Understanding for ChatGPT — 2023 · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Causal Reasoning of Entities and Events in Procedural Texts — 2023 · Findings of the Association for Computational Linguistics: EACL 2023
- Certified Deductive Reasoning with Language Models — 2023 · arXiv:2306.04031
- CoRRPUS: Code-based Structured Prompting for Neurosymbolic Story Understanding — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Do Question Answering Modeling Improvements Hold Across Benchmarks? — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Entity Tracking in Language Models — 2023 · arXiv:2305.02363
- Exploring the Capacity of Pretrained Language Models for Reasoning about Actions and Change — 2023 · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Exploring the State of the Art in Legal QA Systems — 2023 · arXiv:2304.06623 · J Big Data 10, 127 (2023)
- How Many Data Samples is an Additional Instruction Worth? — 2023 · Findings of the Association for Computational Linguistics: EACL 2023
- Identifying the limits of transformers when performing model-checking with natural language — 2023 · Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
- LMentry: A Language Model Benchmark of Elementary Language Tasks — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- Language Models Meet World Models: Embodied Experiences Enhance Language Models — 2023 · arXiv:2305.10626
- Large Language Models Can Be Easily Distracted by Irrelevant Context — 2023 · arXiv:2302.00093
- Learning to Reason and Memorize with Self-Notes — 2023 · arXiv:2305.00833
- Legal Question-Answering in the Indian Context: Efficacy, Challenges, and Potential of Modern AI Models — 2023 · arXiv:2309.14735
- MindGames: Targeting Theory of Mind in Large Language Models with Dynamic Epistemic Modal Logic — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning — 2023 · arXiv:2310.16049 · ICLR 2024 (Spotlight)
- NarrativeXL: a Large-scale Dataset for Long-Term Memory Models — 2023 · Findings of the Association for Computational Linguistics: EMNLP 2023
- Natural Language Reasoning, A Survey — 2023 · arXiv:2303.14725
- ORCA: A Challenging Benchmark for Arabic Language Understanding — 2023 · Findings of the Association for Computational Linguistics: ACL 2023
- OpenPI-C: A Better Benchmark and Stronger Baseline for Open-Vocabulary State Tracking — 2023 · Findings of the Association for Computational Linguistics: ACL 2023