Bidirectional Grammars and the Design of Natural Language Generation Systems
Summary
This is a position paper on the architecture of systems that both understand and generate natural language. The author examines what changes in such a system when it relies on a bidirectional grammar: a single declarative specification of the correspondence between sentences and their meanings that both the parser and the generator use. This approach has several advantages: simpler implementation, a single lexicon, and no need to keep two separate components synchronized. The technical basis is the PATR-II formalism. In PATR-II, unification of feature structures is order-independent, so the rules are not tied to any particular process. For generation, the author proposes a symmetric scheme. A strategic module decides what to say and outputs a logical form with functional features. A tactical module decides how to say it and turns the specification into a sentence. The main finding is the problem of logical-form equivalence. The strategic module cares only about the content of a formula, while the tactical module cares about its syntax. As a result, logically equivalent formulas may yield different sentences or none at all. The paper states this key obstacle to reversible grammars early and clearly.
Key points
- A bidirectional grammar has two basic requirements. First, it must be declarative. Second, it must define a one-to-one mapping between strings and a meaning representation (logical form plus functional features). For example, an active sentence and a passive sentence share a logical form but differ in their features. DIAGRAM is given as an example of a procedural grammar that cannot be used for generation.
- In PATR-II, bidirectionality comes from the associativity and commutativity of unification. Shieber's generator (still work in progress at the time) takes the logical form the parser would produce and reproduces the same sentence.
- An example from electrical circuit repair: the formula Resistance-of(R1, ohm(500)) maps poorly onto the constituents of the sentence, whereas a version with an equality predicate (the verb be) fits better. Swapping the arguments of the equality yields a different sentence. If this conflicts with the functional features, the generator produces nothing.
- The grammars of KAMP, TEXT, MUMBLE and NIGEL/PENMAN have no explicitly represented formal semantics. Their semantics is built into procedures, so these systems avoid the problem but cannot be considered bidirectional.
- The author sees a possible way out in allowing the tactical component limited logical transformations. For example, unification could treat equality and the logical connectives as associative and commutative.
Cite
@inproceedings{appelt1987bidirectional,
title = {{Bidirectional Grammars and the Design of Natural Language Generation Systems}},
author = {Appelt, Douglas E.},
booktitle = {Theoretical Issues in Natural Language Processing 3},
year = {1987},
doi = {10.3115/980304.980352},
url = {https://doi.org/10.3115/980304.980352}
}References
- Douglas E. Appelt. Planning English Sentences. Cambridge University Press, Cambridge, England, 1985. ↗
- Laurence Dardos. Conceptual and linguistic decisions in generation. In Proceedings of the Tenth International Conference on Computational Linguistics, pages 501-504, 1984. find
- William C. Mann. An overview of the PENMAN text generation system. In Proceedings of the National Conference, pages 261-265, American Association for Artificial Intelligence, 1983. find
- David D. McDonald. Natural Language Generation: Complexities and Techniques. Counselor Project Tecnical Memo 14, University of Massachusetts, 1986. find
- David D. McDonald. Natural Language Generation as a Process of Decision Making under Constraint. PhD thesis, Massachusetts Institute of Technology, 1980. find
- Kathleen McKeown. Text Generation. Cambridge University Press, Cambridge, England, 1985. find
- Fernando Pereira and Stuart Shieber. The semantics of grammar formalisms seen as computer languages. In Proceedings of the Tenth International Conference on Computational Linguistics, pages 123-129, 1984. find
- g Jane Robinson. DIAGRAM: a grammar for dialogues. Communications of the A CM, 25(I):27-47, 1982. find
- Stuart Shieber. An Introduction to Unification-Based Approaches to Grammar. Lecture Note Series Vol. 4, Center For the Study of Language and Information, Stanford University, 1986. [I0] Stuart Shieber. A simple reconstruction of GPSG. In Proceedings of the Eleventh International Conference on Computational Linguistics, pages 211-215, 1986. find
- Henry Thompson. Strategy and tactics: a model for language production. In Papers from the Thirteenth Regional Meeting, Chicago Linguistics Society, 1977. find
- Hans Uszkoreit. Categorial unification grammars. In Proceedings of the Eleventh International Conference on Computational Linguistics, pages 187-194, 1986. find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/appelt-1987-bidirectional-grammars-design-natural-language/