Unsupervised Recognition of Literal and Non-Literal Use of Idiomatic Expressions
Summary
The paper tackles token-level idiom classification: deciding whether a potentially idiomatic expression such as spill the beans or play with fire is meant literally or figuratively in a specific context. Most earlier work instead classified expression types as idioms or non-idioms. The authors adapt Hirst and St-Onge's cohesion-based idea for detecting malapropisms. When an expression's component words connect semantically to the surrounding discourse, a literal reading is likely. When they do not, the usage is probably idiomatic. Relatedness is computed without hand-built resources like WordNet, using Normalized Google Distance (NGD), which relies on search-engine page counts. Two classifiers are proposed. One builds lexical chains and needs parameter tuning. The other, fully unsupervised, checks whether removing the expression increases the connectivity of a cohesion graph. The graph-based method matches the optimally tuned chain classifier and outperforms the CForm and Rep baselines. It also handles expressions in canonical form, which the CForm approach always labels as idiomatic. This makes cohesion a practical, knowledge-lean cue for literal versus non-literal disambiguation.
Key points
- The evaluation covers 17 English expressions, including break the ice, drop the ball, play with fire and spill the beans. Some of them, such as drop the ball, pull the trigger and bounce off the wall, are mostly used literally.
- The graph-based classifier and the globally optimised chain classifier (LC-O) both reach a literal-class F-Score of about 60%, with recall above precision.
- The chain classifier tuned realistically on separate development data (break the ice) scores much lower, because it seldom predicts the literal class.
- A simple supervised classifier still beats all unsupervised methods by a wide margin.
- Per-idiom accuracy of the graph-based method is above 50% for most expressions, peaking at 98.95% for set in stone. The lowest score is 11.11% for blow one's own trumpet, which has only 9 instances.
- The method is not biased toward the idiomatic reading. For drop the ball, 472 of 530 literal predictions were correct.
Cited by
- Semantically Motivated Hebrew Verb-Noun Multi-Word Expressions Identification
- Survey: Multiword Expression Processing: A Survey
- MAGPIE: A Large Corpus of Potentially Idiomatic Expressions
- ID10M-JAM: Stress-Testing Idiom Identification Under Challenging Context
- Non Idiomatic Conventionalised Expressions: A New Pain in the Neck?
- An Empirical Study on Compositionality in Compound Nouns
- Idiom Token Classification using Sentential Distributed Semantics
- The semantic transparency of English compound nouns
- A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity Understanding
- ID10M: Idiom Identification in 10 Languages
- Idiomatic Expression Identification using Semantic Compatibility
Cite
@inproceedings{sporleder2009unsupervised,
title = {{Unsupervised Recognition of Literal and Non-Literal Use of Idiomatic Expressions}},
author = {Sporleder, Caroline and Li, Linlin},
booktitle = {Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009)},
year = {2009},
doi = {10.3115/1609067.1609151},
url = {https://doi.org/10.3115/1609067.1609151}
}References
- Timothy Baldwin, Colin Bannard, Takaaki Tanaka, and Dominic Widdows. 2003. An empirical model of multiword expression decomposability. In Proceedings of the ACL 2003 workshop on Multiword expressions: analysis, acquisition and treatment, pages 89–96. find our card
- Colin Bannard. 2007. A measure of syntactic flexibility for automatically identifying multiword expressions in corpora. In Proceedings of the ACL-07 Workshop on A Broader Perspective on Multiword Expressions, pages 1–8. find
- Regina Barzilay and Michael Elhadad. 1997. Using lexical chains for text summarization. In Proceedings of the ACL-97 Intelligent Scalable Text Summarization Workshop (ISTS-97). find
- Julia Birke and Anoop Sarkar. 2006. A clustering approach for the nearly unsupervised recognition of nonliteral language. In Proceedings of EACL-06, pages 329–336. find
- Alexander Budanitsky and Graeme Hirst. 2006. Evaluating WordNet-based measures of semantic distance. Computational Linguistics, 32(1):13–47. find
- Rudi L. Cilibrasi and Paul M.B. Vitanyi. 2007. The Google similarity distance. IEEE Trans. Knowledge and Data Engineering, 19(3):370–383. find
- Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and Psychological Measurements, 20:37–46. find
- Paul Cook, Afsaneh Fazly, and Suzanne Stevenson. 2007. Pulling their weight: Exploiting syntactic forms for the automatic identification of idiomatic expressions in context. In Proceedings of the ACL-07 Workshop on A Broader Perspective on Multiword Expressions, pages 41–48. find our card
- A.P. Cowie, R. Mackin, and I.R. McCaig. 1997. Oxford dictionary of English idioms. Oxford University Press. find
- Afsaneh Fazly and Suzanne Stevenson. 2006. Automatically constructing a lexicon of verb phrase idiomatic combinations. In Proceedings of EACL-06. find our card
- Afsaneh Fazly, Paul Cook, and Suzanne Stevenson. To appear. Unsupervised type and token identification of idiomatic expressions. Computational Linguistics. find our card
- M.A.K. Halliday and R. Hasan. 1976. Cohesion in English. Longman House, New York. find
- Donald Hindle. 1990. Noun classification from predicate-argument structures. In Proceedings of ACL-90, pages 268–275. find
- Graeme Hirst and David St-Onge. 1998. Lexical chains as representations of context for the detection and correction of malapropisms. In Christiane Fellbaum, editor, WordNet: An electronic lexical database, pages 305–332. The MIT Press. find
- Graham Katz and Eugenie Giesbrecht. 2006. Automatic identification of non-compositional multiword expressions using latent semantic analysis. In Proceedings of the ACL/COLING-06 Workshop on Multiword Expressions: Identifying and Exploiting Underlying Properties, pages 12–19. find
- Mirella Lapata and Frank Keller. 2005. Web-based models for natural language processing. ACM Transactions on Speech and Language Processing, 2:1–31. find
- Dekang Lin. 1998. Automatic retrieval and clustering of similar words. In Proceedings of ACL-98, pages 768–774. find
- Dekang Lin. 1999. Automatic identification of non-compositional phrases. In Proceedings of ACL-99, pages 317–324. find our card
- Guido Minnen, John Carroll, and Darren Pearce. 2001. Applied morphological processing of English. Natural Language Engineering, 7(3):207–223. find
- Saif Mohammad and Graeme Hirst. 2006. Distributional measures of concept-distance: A task-oriented evaluation. In Proceedings of EMNLP-06. find
- Jane Morris and Graeme Hirst. 2004. Non-classical lexical semantic relations. In HLT-NAACL-04 Workshop on Computational Lexical Semantics, pages 46–51. find
- Simone Paolo Ponzetto and Michael Strube. 2007. Knowledge derived from Wikipedia for computing semantic relatedness. Journal of Artificial Intelligence Research, 30:181–212. find
- Susanne Riehemann. 2001. A Constructional Approach to Idioms and Word Formation. Ph.D. thesis, Stanford University. find
- H. Gregory Silber and Kathleen F. McCoy. 2002. Efficiently computed lexical chains as an intermediate representation for automatic text summarization. Computational Linguistics, 28(4):487–496. find
- Aline Villavicencio, Valia Kordoni, Yi Zhang, Marco Idiart, and Carlos Ramisch. 2007. Validation and evaluation of automatically acquired multiword expressions for grammar engineering. In Proceedings of EMNLP-07, pages 1034–1043. find
- Torsten Zesch, Christof Müller, and Iryna Gurevych. 2008. Using wiktionary for computing semantic relatedness. In Proceedings of AAAI-08, pages 861– 867. find
- Xiaojin Zhu and Ronald Rosenfeld. 2001. Improving trigram language modeling with the world wide web. In Proceedings of ICASSP-01. find
This page in Markdown → https://md.research.elamur.ai/free/papers/sporleder-2009-unsupervised-recognition-literal-non-literal/