Joint Inference and Disambiguation of Implicit Sentiments via Implicature Constraints
Summary
Writers often signal opinions indirectly. Praising an event that harms something implies a negative view of the thing harmed and a positive view of whoever caused the event. This paper targets such implicit sentiments in sentences with goodFor/badFor (gfbf) events, which help or hurt a theme entity. Rather than chaining steps in a pipeline, the authors create local detectors for four sources of ambiguity: the polarity of the gfbf event, whether a reverser is present, the identification of the agent and theme among candidate noun phrases, and the writer's sentiment toward those entities. Their scores feed an unsupervised Integer Linear Programming (ILP) model. The implicature rules of Deng and Wiebe (2014) act as soft constraints, so violations are penalized rather than forbidden. On the gfbf-annotated corpus of Deng et al. (2013), with gold gfbf spans as input, joint inference raises sentiment F-measure by more than 10 points over the baselines and gfbf polarity accuracy by about 7 points. The other components lose nothing. The work matters because it shows that inference over events can recover opinions that lexicon-based detectors miss, while resolving several event-level ambiguities at once.
Key points
- The constraints rest on one core regularity. Within a gf event, the writer feels the same way about agent and theme. Within a bf event, the feelings are opposite.
- Agent and theme candidates come from two sources: SENNA semantic role labels (A0/A1/A2) and a dependency-based nearest-noun heuristic. Local sentiment scores rely on MPQA lexicon clues.
- Sentiment results on the subset with correct spans:
- Local detector: F 0.4384.
- ILP: F 0.6421.
- ILP+coref: F 0.6945.
- Recall gains are significant under McNemar's test (p < .001).
- gfbf polarity accuracy rises from 70.68% to 77.25% (ILP) and 77.47% (ILP+coref). Agent/theme span accuracy improves slightly, from 66.67% to 68.54%. Reverser accuracy is about 89% for ILP versus 88.07% for the baseline.
- The gain over the local detector is 2.43 F points larger than in Deng and Wiebe (2014), even though that earlier system used manually annotated gfbf information.
Cited by
Cite
@inproceedings{deng2014joint,
title = {{Joint Inference and Disambiguation of Implicit Sentiments via Implicature Constraints}},
author = {Deng, Lingjia and Wiebe, Janyce and Choi, Yoonjung},
booktitle = {Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers},
year = {2014},
url = {https://aclanthology.org/C14-1009/}
}References
- Cem Akkaya, Janyce Wiebe, and Rada Mihalcea. 2009. Subjectivity word sense disambiguation. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1, EMNLP ’09, pages 190–199, Stroudsburg, PA, USA. Association for Computational Linguistics. find
- Pranav Anand and Kevin Reschke. 2010. Verb classes as evaluativity functor classes. In Interdisciplinary Workshop on Verbs. The Identification and Representation of Verb Features. find
- Yejin Choi and Claire Cardie. 2008. Learning with compositional semantics as structural inference for subsentential sentiment analysis. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 793–801, Honolulu, Hawaii, October. Association for Computational Linguistics. find
- Yejin Choi, Eric Breck, and Claire Cardie. 2006. Joint extraction of entities and relations for opinion recognition. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, EMNLP ’06, pages 431–439, Stroudsburg, PA, USA. Association for Computational Linguistics. find
- Yoonjung Choi, Janyce Wiebe, and Lingjia Deng. 2014. Lexical acquisition for opinion inference: A sense-level lexicon of benefactive and malefactive events. In 5th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis. find
- Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural language processing (almost) from scratch. J. Mach. Learn. Res., 12:2493–2537, November. find our card
- Dipanjan Das, André FT Martins, and Noah A Smith. 2012. An exact dual decomposition algorithm for shallow semantic parsing with constraints. In Proceedings of the First Joint Conference on Lexical and Computational Semantics-Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation, pages 209–217. Association for Computational Linguistics. find
- Lingjia Deng and Janyce Wiebe. 2014. Sentiment propagation via implicature constraints. In Meeting of the European Chapter of the Association for Computational Linguistics (EACL-2014). find our card
- Lingjia Deng, Yoonjung Choi, and Janyce Wiebe. 2013. Benefactive/malefactive event and writer attitude annotation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 120–125, Sofia, Bulgaria, August. Association for Computational Linguistics. find
- Pascal Denis and Jason Baldridge. 2007. Joint determination of anaphoricity and coreference resolution using integer programming. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, pages 236–243, Rochester, New York, April. Association for Computational Linguistics. find our card
- Thomas G. Dietterich. 1998. Approximate statistical tests for comparing supervised classification learning algorithms. Neural Computation, 10:1895–1923. ↗
- Song Feng, Jun Sak Kang, Polina Kuznetsova, and Yejin Choi. 2013. Connotation lexicon: A dash of sentiment beneath the surface meaning. In Proceedings of the 51th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Sofia, Bulgaria, Angust. Association for Computational Linguistics. find
- Amit Goyal, Ellen Riloff, and Hal Daum III. 2013. A computational model for plot units. Computational Intelligence, 29(3):466–488. ↗
- Herbert Paul Grice. 1967. Logic and conversation. The William James lectures. find
- Herbert Paul Grice. 1989. Studies in the Way of Words. Harvard University Press. find
- Richard Johansson and Alessandro Moschitti. 2013. Relational features in fine-grained opinion analysis. Computational Linguistics, 39(3). ↗
- André F. T. Martins and Noah a. Smith. 2009. Summarization with a joint model for sentence extraction and compression. In Proceedings of the Workshop on Integer Linear Programming for Natural Langauge Processing - ILP ’09, pages 1–9, Morristown, NJ, USA. Association for Computational Linguistics. find
- Vasin Punyakanok, Dan Roth, Wen-tau Yih, and Dav Zimak. 2004. Semantic role labeling via integer linear programming inference. In Proceedings of the 20th international conference on Computational Linguistics, page 1346. Association for Computational Linguistics. find
- Vasin Punyakanok, Dan Roth, and Wen-tau Yih. 2008. The importance of syntactic parsing and inference in semantic role labeling. Computational Linguistics, 34(2):257–287. ↗ our card
- Kevin Reschke and Pranav Anand. 2011. Extracting contextual evaluativity. In Proceedings of the Ninth International Conference on Computational Semantics, IWCS ’11, pages 370–374, Stroudsburg, PA, USA. Association for Computational Linguistics. find
- Dan Roth and Wen-tau Yih. 2004. A linear programming formulation for global inference in natural language tasks. In CONLL. find our card
- Swapna Somasundaran and Janyce Wiebe. 2009. Recognizing stances in online debates. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, pages 226–234, Suntec, Singapore, August. Association for Computational Linguistics. find
- P.J. Stone, D.C. Dunphy, M.S. Smith, and D.M. Ogilvie. 1966. The General Inquirer: A Computer Approach to Content Analysis. MIT Press, Cambridge. find
- Veselin Stoyanov, Claire Cardie, Nathan Gilbert, Ellen Riloff, David Buttler, and David Hysom. 2010. Coreference resolution with reconcile. In Proceedings of the ACL 2010 Conference Short Papers, ACLShort ’10, pages 156–161, Stroudsburg, PA, USA. Association for Computational Linguistics. find our card
- Janyce Wiebe and Lingjia Deng. 2014. An account of opinion implicatures. arXiv:1404.6491v1 [cs.CL]. ↗
- Janyce Wiebe, Theresa Wilson, and Claire Cardie. 2005. Annotating expressions of opinions and emotions in language ann. Language Resources and Evaluation, 39(2/3):164–210. ↗
- Theresa Wilson, Janyce Wiebe, , and Paul Hoffmann. 2005. Recognizing contextual polarity in phrase-level sentiment analysis. In HLP/EMNLP, pages 347–354. find
- Theresa Wilson. 2008. Fine-grained subjectivity analysis. Ph.D. thesis, Doctoral Dissertation, University of Pittsburgh. find
- Bishan Yang and Claire Cardie. 2013. Joint Inference for Fine-grained Opinion Extraction. In Proceedings of ACL, pages 1640–1649. find
- Lei Zhang and Bing Liu. 2011. Identifying noun product features that imply opinions. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 575–580, Portland, Oregon, USA, June. Association for Computational Linguistics. find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/deng-2014-joint-inference-disambiguation-implicit-sentiments/