Responding Intelligently to Unparsable Inputs
Paper · 1980 · Ralph M. Weischedel and John E. Black
Summary
Practical natural language interfaces, such as database front ends, consultation programs and office tools, will inevitably receive inputs outside their coverage. The authors argue that such a system must tell users precisely why an input failed so they can reformulate it. They propose three techniques, each implemented in one of two systems: a tutor for German reading comprehension and a system that computes presuppositions and entailments.
- Presupposition checking. The system verifies the given information of an input against its world model and reports any assumption that does not hold.
- Relaxation of tests during parsing. Grammar constraints are loosened so that ill-formed sentences can still be translated and the violation can be flagged.
- Heuristics for failed parses. When no parse exists, the system uses the expectations of a top-down, left-to-right parser to describe where and why it got stuck.
The methods diagnose problems but do not propose rephrasings. The work matters because helpful failure feedback is presented as a precondition for non-programmers to accept natural language systems.
Key points
- Motivating example. Woods's lunar rock question about "all your samples" broke the system in three ways:
- Syntax: a predeterminer before a determiner was not covered.
- Semantics: there were no rules or data for sample weight.
- Pragmatics: the system was never modelled as owning the samples.
- Psychological basis. Presupposition handling draws on Clark and Haviland's given/new model. The system checks given information in context before asserting new information, and the computation is organized in an augmented transition network (ATN) and lexicon.
- Error diagnosis in the German tutor.
- It catches misunderstood questions when the answer does not entail the question's given information.
- It reports definite noun phrases that refer to nothing.
- It catches misused words, such as essen (human eater) versus fressen (animal eater).
- Anticipated mistakes. Common learner errors are encoded as explicit ATN paths that both translate the answer and generate a correction message. An example is a past participle not placed at the end of the clause ("Ich habe gegessen das Fleisch").
- Related work. Kaplan (1977, 1979) extended presupposition-based cooperative responses to database queries that would return empty answers.
Institutions
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 works
🧭 Topics 1Research subjects and languages the work is about.Implicature · 138 works
Cite
Cite as Ralph M. Weischedel and John E. Black. 1980. Responding Intelligently to Unparsable Inputs. Computational Linguistics.
@article{weischedel1980responding,
title = {{Responding Intelligently to Unparsable Inputs}},
author = {Ralph M. Weischedel and John E. Black},
journal = {Computational Linguistics},
year = {1980},
doi = {10.5555/972439.972442},
url = {https://doi.org/10.5555/972439.972442}
}References
- Allen, James F., "A Plan-Based Approach to Speech Act Recognition," Ph.D. Thesis, Dept. of Computer Science, University of Toronto, Toronto, Canada, 1979. find
- Anderson, Barbara B., "TransformationaUy Based English Strings and their Word Subclasses," String Program Reports No. 7, Linguistic String Program, New York University, New York, NY 1970. find
- Bobrow, D. G., R. M. Kaplan, M. Kay, D. A. Norman, H. Thompson, and T. Winograd, "GUS, A Frame Driven Dialog System," Artificial Intelligence 8, 2, 1977. find
- Bobrow, Robert J., "The RUS System," in B. L. Webber and R. Bobrow, Research in Natural Language Understanding, BBN Report 3878, Bolt Beranek and Newman Inc., Cambridge, MA, 1978. find
- Brown, J. S. and R. R. Burton, "Multiple Representations of Knowledge for Tutorial Reasoning." In D. G. Bobrow and A. Collins, Eds., Representation and Understanding, New York: Academic Press, 1975. find
- Burton, R. R., "Semantic Grammar: An Engineering Technique for Construction of Natural Language Understanding Systems." BBN Report 3453, Bolt, Beranek, and Newman, Cambridge, Mass. Also, Ph.D. Dissertation, University of California, Irvine, CA, 1976. find
- Clark, Herbert H. and Susan E. Haviland, "Comprehension and the Given-New Contract. In R. Freedle, Ed., Discourse Processes: Advances in Research and Theory, Vol. 1. Discourse Production and Comprehension. Norwood, N J: Ablex Publishing Corporation, 1977. Codd, E. F., R. S. Arnold, J. M. Cadiou, C.… find
- Floyd, R. W., "Assigning Meanings to Programs," Proc. of a Symposium in Applied Mathematics, Vol. 19. American Mathematical Society, 1967. Grishman, Ralph, "Implementation of the String Parser of English." In R. Rustin, Ed., Natural Language Processing. find
- New York: Algorithmies Press, 1973. Haviland, Susan E. and Herbert H. Clark, "What's New? Acquiring new information as a process in comprehension." Journal of Verbal Learning and Verbal Behavior, 13, 1974. Hayes, P. and R. Reddy, "An Anatomy of Graceful Interaction in Spoken and Written Man-Machine… find
- Kaplan, S. Jerrold, "Indirect Responses to Loaded Questions," Theoretical Issues in Natural Language Processing-2, University of Illinois at Urbana-Champaign, July, 1978.
- Kaplan, S. Jerrold, "Cooperative Responses from a Natural Language Data Base Query System, ') Ph.D. Dissertation, Dept. of Computer & Information Science, University of Pennsylvania, Philadelphia, PA, 1979. find
- Karttunen, L., "Presuppositions of Compound Sentences," Linguistic Inquiry, 4, 1973. find
- Karttunen, L. and S. Peters, "Conventional Implieature in Montague Grammar," Proc. of the First Annual Meeting of the Berkeley Linguistics Society, Berkeley, CA, 1975 find
- Kwasny, Stan and Norman K. Sondheimer, "Ungrammatieality and Extra-Grammaticality in Natural Language Understanding Systems," Proceedings of the 17th Annual Meeting of the Association for Computational Linguistics, 1979. find
- Levin, J. A. and J. A. Moore, "'Dialogue Games: Meta-communication Structures for Natural Language Interaction," Cognitive Science 1, 4, 1978. find
- Mann, W. C., "Dialogue Games," in K. Hintikka, et.al., Eds., Models of Dialogue, Amsterdam: North-Holland Publishing Company, 1979. find
- Mays, Eric, "Correcting Misconceptions About Data Base Structure," Proceedings of the Conference of the Canadian Society for Computational Studies of Intelligence, 1980. find
- Oh, Choon-Kyu and David A. Dineen, (Eds.), Presupposition, Vol. 11, Syntax and Semantics, New York: Academic Press, 1979. find
- Sager, Naomi, "The String Parser for Scientific Literature." In R. Rustin, Ed., Natural Language Processing. New York: Algorithmies Press, 1973. find
- Weischedel, Ralph M., "Computation of a Unique Subclass of Inferences: Presupposition and Entailment," Ph.D. Thesis, Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, 1975. find
- Weischedel, Ralph M., "A New Semantic Computation While Parsing: Presupposition and Entailment." In C. Oh and D. Dineen, Eds., Presupposition, Vol. 11, Syntax and Semantics, New York: Academic Press, 1979. find
- Weischedel, Ralph M., "Please Re-phrase," Technical Report \#77/1, Department of Computer and Information Sciences, University of Delaware, Newark, DE 1977. find
- Weischedel, Ralph M., Wilfried Voge, and Mark James, "An Artificial Intelligence Approach to Language Instruction," Artificial Intelligence 10, 3, 1978. find
- Winograd, T., Understanding Natural Language, New York: Academic Press, Inc., 1972. Woods, W. A., "Transition Network Grammars for Natural Language Analysis," Comm. ACM, 13, 10, 1970. find
- Woods, W. A., "An Experimental Parsing System for Transition Network Grammars." In R. Rustin, Ed., Natural Language Processing. New York: Algorithmics Press, 1973a. Woods, W. A., "Progress in natural language understanding — An application to lunar geology,," AFIPS Conference Proceedings, NCC. find
- Montvale, NJ: AFIPS Press, 1973b. find
- Woods, W. A., Personal Communication, 1977. find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/weischedel-1980-responding-intelligently-unparsable-inputs/