Presupposed Content and Entailments in Natural Language Inference
Paper · 2009 · David Clausen and Christopher D. Manning
Summary
The paper addresses a gap in the NatLog natural logic system for NLI. NatLog runs negation, monotonicity and implicatures through one projection mechanism, but presuppositions behave differently. They survive negation, yet some operators block them and conditionals can cancel them. The authors add a separate presupposition channel to NatLog's pipeline.
Lexical factivity triggers, meaning factive verbs and nouns such as "know" and "realize" and antifactive ones such as "pretend", are found with regular-expression patterns over lemmatized parse trees. Their effects are then projected up the tree using Karttunen's (1973) holes/plugs/filters theory. For each edit from premise to hypothesis, the system computes an atomic presupposition relation, composes these across the edit sequence, and combines the result with NatLog's ordinary entailment relation.
This repairs errors the original system made, for instance concluding that Gore won the election from a premise stating that Bush was unaware of Gore's election victory. On a PARC 3-way entailment test set, accuracy rose from 53.95% to 60.53%. The approach suggests that combining specialized reasoners is a workable path toward open-domain NLI.
Key points
- NatLog has 5 stages: linguistic analysis, alignment, lexical entailment classification, entailment projection, and entailment composition. Presupposition handling is added at stages 1, 4 and 5.
- Triggers are encoded as tree patterns with a lemma, a scope (SBAR/S complement) and a factivity label (FACT or ANTI). For example, "know" is matched as a VB-headed VP.
- Effective factivity is computed bottom-up by pairing the dominated and dominating labels:
- ANTI over anything gives ANTI.
- FACT over ANTI gives ANTI.
- FACT over FACT gives FACT.
- Atomic presupposition relations depend on the edit type and the factivity of the edited operator:
- Deleting a FACT operator gives Forward; inserting one gives Reverse.
- Deleting or inserting an ANTI operator gives Alternation.
- Evaluation used the 3-way NLI problems from PARC (the Nairn et al. 2006 group): Augmented NatLog reached 60.53% versus 53.95% for the original. Other trigger types (aspectual verbs, definite descriptions, iteratives) are left for future work.
Interesting ideas
- I1. Keep presupposed content in its own relation channel, separate from asserted content, because the two project through different operators (negation flips assertions but leaves presuppositions intact).
- I2. Tag every constituent with an "effective factivity" by recursively composing the labels of all dominating operators, using a small lookup table.
- I3. Classify operators by how they treat embedded presuppositions: holes let them through, plugs block them, and filters decide based on the relation between antecedent and consequent.
- I4. Describe lexical triggers declaratively as small records: lemma pattern, structural scope, and factivity label.
- I5. Build a test set of minimal pairs that stress one phenomenon, such as negated factives and antifactive embeddings, and compare the system with and without the new module.
For Mova
How these ideas could serve Mova, our small open language model — its files, stages and tests:
- I1 (world): Store presupposed facts in the world of the text with their own provenance tag, so that negating a clause does not erase what its factive verb takes for granted.
- I2 (frames): A walk up the UD tree from each ccomp/xcomp to the root could assign every embedded frame a veridicality label (fact, counterfact, unknown), and the trace stays fully explainable.
- I3 (frames): Add hole/plug/filter features to verb lexicon entries (realize = hole, pretend = plug, if = filter) so that projection becomes a data-driven rule, not ad hoc code.
- I4 (tree): Keep a trigger table keyed on lemma plus UD relation of the complement, so new factives can be added without touching the parser or the inference code.
- I5 (answer): Add negated-factive and pretend-style items to the QA test suites, with the baseline run kept as a control, to check that the presupposition logic actually changes answers.
Institutions
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 works
🧭 Topics 2Research subjects and languages the work is about.Reasoning · 1,426 worksImplicature · 138 works
Cite
Cite as David Clausen and Christopher D. Manning. 2009. Presupposed Content and Entailments in Natural Language Inference. Proceedings of the 2009 Workshop on Applied Textual Inference (TextInfer).
@inproceedings{clausen2009presupposed,
title = {{Presupposed Content and Entailments in Natural Language Inference}},
author = {David Clausen and Christopher D. Manning},
booktitle = {Proceedings of the 2009 Workshop on Applied Textual Inference (TextInfer)},
year = {2009},
doi = {10.3115/1708141.1708154},
url = {https://doi.org/10.3115/1708141.1708154}
}References
- Beaver, David I. 2001. Presupposition and assertion in dynamic semantics. Stanford: CSLI. find
- Bos, Johan and Katja Markert. 2006. When logical inference helps determining textual entailment (and when it doesn’t). In Proceedings of the Second PASCAL Challenges Workshop on Recognizing Textual Entailment. find
- Hickl, Andrew, John Williams, Jeremy Bensley, Kirk Roberts, Bryan Rink, and Ying Shi. 2006. Recognizing textual entailment with LCC’s GROUND-HOG system. In Proceedings of the Second PAS-CAL Challenges Workshop on Recognizing Textual Entailment. find
- Karttunen, Lauri. 1973. Presuppositions of compound sentences. Linguistic Inquiry 4: 169-93. find
- MacCartney Bill, Trond Grenager, Marie-Catherine de Marneffe, Daniel Cer, and Christopher D. Manning. 2006. Learning to recognize features of valid textual entailments. In Proceedings of the North American Association of Computational Linguistics (NAACL-06). find
- MacCartney, Bill and Christopher D. Manning. 2007. Natural logic for textual inference. In ACL-07 Workshop on Textual Entailment and Paraphrasing, Prague. find
- MacCartney, Bill and Christopher D. Manning. 2008. Modeling semantic containment and exclusion in natural language inference. In Proceedings of Coling-08. find
- MacCartney, Bill and Christopher D. Manning. 2009. An extended model of natural logic. In The Eight International Conference on Computational Semantics (IWCS-8), Tilburg, Netherlands, January 2009 find
- Nairn, Rowan, Cleo Condoravdi, and Lauri Karttunen. 2006. Computing relative polarity for textual inference. In Proceedings of ICoS-5 (Inference in Computational Semantics), Buxton, UK.
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/clausen-2009-presupposed-content-entailments-natural-language/