Processing Dictionary Definitions with Phrasal Pattern Hierarchies
Summary
Language understanding systems often break down when they meet words missing from their lexicons, or sentences their grammars cannot fully parse. Alshawi treats both as cases of incomplete linguistic knowledge. He builds an analyser that extracts classification-oriented semantic information from word sense definitions in the machine-readable Longman Dictionary of Contemporary English (LDOCE). The approach relies on the fact that LDOCE writes its definitions with a restricted vocabulary of about 2000 words. A new sense can therefore be placed within a hand-built classification of those vocabulary senses.
Analysis proceeds through a hierarchy of phrasal patterns. General patterns sit above more specialised ones, and matching moves downward as far as it succeeds. When a full analysis fails, a reasonable partial result still survives, most importantly the definition's semantic head (its main superordinate). The output is a nested feature list recording class, properties, purpose, parts and predications.
On a random sample of definitions, the system usually found the semantic head correctly. This suggests that cheap, robust pattern-based analysis can help NLP systems cope with unknown words.
Key points
- Resource: LDOCE definitions were taken from a Lisp-converted version of the typesetting tape. The 2000-word defining vocabulary is closer to "basic English" than to a set of semantic primitives.
- Evaluation: the test used 500 randomly selected definitions, excluding idioms and complex cross-references.
- The semantic head was correct for 387 of them (77%).
- Extra information was extracted for 236 of those (61%), and 207 of these extractions (88%) were judged correct.
- Grammar size: the hierarchy holds about 90 phrasal patterns, including subsidiary ones. The author estimates it could grow to around 400 before returns diminish.
- Implementation: the analyser is written in Cambridge Lisp, with dictionary access in C. It takes about half a second per definition on a GEC-63 minicomputer, and development took only a few person-months each for program and grammar.
- Error sources and future work: most errors came from weak morphological analysis and limited pattern coverage. Proposed future work includes handling idioms as the most specific patterns at the leaves of the hierarchy.
Institutions
Cite
Cite as Hiyan Alshawi. 1987. Processing Dictionary Definitions with Phrasal Pattern Hierarchies. Computational Linguistics.
@article{alshawi1987processing,
title = {{Processing Dictionary Definitions with Phrasal Pattern Hierarchies}},
author = {Hiyan Alshawi},
journal = {Computational Linguistics},
year = {1987},
url = {https://aclanthology.org/J87-3001/}
}References
- Alshawi, H. 1987 Memol~y and Context Mechanisms for Language Interpretation. Cambridge University Press, Cambridge, England. find
- Alshawi, H.; Boguraev, B.; and Briscoe, E. 1985 Towards a Dictionary Support Environment for Real Time Parsing. In Proceedings of the Second Conference of the European Chapter of the Association for Computational Linguistics, Geneva: 171-178. find
- Amsler, R. 1981 A Taxonomy for English Nouns and Verbs. In Proceedings of the 19th Annual Meeting of the Association for Computational Linguistics, Stanford, California: t33-138. our card
- Bobrow, R.J.; and Webber, B.L. 1980 Knowledge Representation for Syntactic/Semantic Processing. In Proceedings of the First AAAI Conference, Stanford, California: 316-323. find
- Calzolari, N. 1984 Detecting Patterns in A Lexical Database. In Proceedings of the lOth International Conference on Computational Linguistics, Stanford, California: 170-173. find
- Carnap, R. 1952 Meaning Postulates. Philosophical Studies 3: 65-73. find
- DeJong, G. 1979 Prediction and Substantiation: A New Approach to Natural Language Processing. Cognitive Science 3: 251-273. find
- Hayes, P.J.; and Mouradian, G.V. 1981 Flexible Parsing. American Journal of Computational Linguistics 7(4): 232-242. find
- Katz, J.J.; and Fodor J.A. 1963 The Structure of a Semantic Theory. Language 39: 170-210. find
- Kwasny, S.C.; and Sondheimer, N.K. 1981 Relaxation Techniques for Parsing Grammatically Ill-Formed Input in Natural Language Understanding Systems. American Journal of Computatiohal Linguistics 7(2): 99-108. find
- Mark, W. 1981 Representation and Inference in the Consul System. In Proceedings of the Seventh International Joint Conference on Artificial Intelligence, Vancouver, British Columbia: 375-381. find
- Michiels, A. 1982 Exploiting a Large Dictionary Database. Ph.D. thesis, Universit6 de Liege, Liege. find
- Parkinson, R.C.; Colby, K. M.; and Faught, W. S. 1977 Conversational Language Comprehension Using Integrated Pattern-Matching and Parsing. Artificial Intelligence 9:111-134. find
- Procter, P., Ed., 1978 Longman Dictionary of Contemporary English. Longman Group Limited, Harlow and London. find
- Pulman, S.G. 1984 Limited Domain Systems for Language Teaching. In Proceedings of the lOth International Conference on Computational Linguistics, Stanford, California: 84-87. find
- Schmolze, J.G.; and Lipkis, T.A. 1983 Classification in the KL-ONE Knowledge Representation System. In Proceedings of Eighth International Joint Conference on Artificial Intelligence, Karlsruhe: 330-332. find
- Walker, D.; and Amsler, R. 1986 The Use of Machine Readable Dictionaries in Sublanguage Analysis. In Analyzing Language in Restricted Domains, edited by Ralph Grishman and Richard Kittredge. Lawrence Erlbaum Associates, Hillsdale, New Jersey: 69-83. find
- Weischedel, R.M.; and Black, J.E. 1980 Responding Intelligently to Unparsable Inputs. American Journal of Computational Linguistics 6(2): 97-109. find
- Wilensky, R.; and Arens, Y. 1980 PHRAN - - A Phrasal Natural Language Understander. In Proceedings of the 18th Annual Meeting of the Association for Computational Linguistics, Philadelphia, Pennsylvania: 117-121. find
- Wilks, Y. 1975 An Intelligent Analyser and Understander of English. Communications of the ACM 18: 264-274. find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/alshawi-1987-processing-dictionary-definitions-phrasal-pattern/