Annotating Attribution in the Penn Discourse TreeBank
Summary
Many NLP applications, from extracting information and answering questions to producing summaries and generating text, need to determine whether a piece of information is presented as fact or opinion, and who it comes from. Earlier annotation work mostly labelled sentiment at the document, sentence or word level. This paper instead targets a finer semantic unit: the abstract objects (propositions, facts, eventualities) that serve as discourse relations and their arguments in the Penn Discourse TreeBank (PDTB), which is built on the Wall Street Journal corpus. The authors extend the core attribution scheme of PDTB-1.0 with four features: source, type (degree of factuality), scopal polarity (negated attribution reversing an argument's polarity) and determinacy (contexts that cancel the attribution entailment). They also add rules for marking the text spans that signal attribution. The paper presents the scheme through annotated examples and does not report an evaluation of it. Data from the earlier scheme show that a sizeable share of relations involve non-writer sources. This makes the extended PDTB a useful resource for compositional, automatic factuality classification.
Key points
- PDTB-1.0 contents: 100 Explicit connective types (18,505 tokens) across all 25 WSJ sections. Sections 08–10 add 2,003 implicit-relation tokens: 1,496 Implicit connectives, 19 AltLex, 435 EntRel and 53 NoRel.
- Non-writer sources are common: under the earlier scheme, 34% of annotated relations attribute the relation or at least one argument to an agent other than the writer.
- Source values: Wr (writer), Ot (a specific agent in the text), Arb (a generic or arbitrary source) and Inh (an argument inheriting the relation's source). Type values shown in the examples include Comm, Ftv, Att and PAtt.
- Span rules: attribution spans may be discontinuous and exclude connectives. Implicit writer attribution gets no span. Non-clausal anchors such as "according to X" or "reportedly" are marked.
- Implicit relations: attribution is annotated for Implicit connectives and AltLex, but not for EntRel or NoRel.
Cited by
- The Penn Discourse TreeBank 2.0.
- Shallow Discourse Parsing for Under-Resourced Languages: Combining Machine Translation and Annotation Projection
- The Effects of Discourse Connectives Prediction on Implicit Discourse Relation Recognition
Cite
@inproceedings{prasad2006annotating,
title = {{Annotating Attribution in the Penn Discourse TreeBank}},
author = {Prasad, Rashmi and Dinesh, Nikhil and Lee, Alan and Joshi, Aravind and Webber, Bonnie},
booktitle = {Proceedings of the Workshop on Sentiment and Subjectivity in Text},
year = {2006},
doi = {10.3115/1654641.1654646},
url = {https://doi.org/10.3115/1654641.1654646}
}References
- Nicholas. Asher. 1993. Reference to Abstract Objects in Discourse. Kluwer, Dordrecht. ↗
- Nikhil Dinesh, Alan Lee, Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, and Bonnie Webber. 2005. Attribution and the (non)-alignment of syntactic and discourse arguments of connectives. In Proceedings of the ACL Workshop on Frontiers in Corpus Annotation II: Pie in the Sky, Ann Arbor, Michigan. find
- Jaakko Hintikka. 1971. Semantics for propositional attitudes. In L. Linsky, editor, Reference and Modality, pages 145–167. Oxford. find
- Laurence Horn. 1978. Remarks on neg-raising. In Peter Cole, editor, Syntax and Semantics 9: Pragmatics. Academic Press, New York. ↗
- Lauri Karttunen. 1971. Some observations on factivity. Papers in Linguistics, 4:55–69. ↗
- Carol Kiparsky and Paul Kiparsky. 1971. Fact. In D. D. Steinberg and L. A. Jakobovits, editors, Semantics: An Interdisciplinary Reader in Philosophy, Linguistics and Psychology, pages 345–369. Cambridge University Press, Cambridge. find
- Howard Lasnik. 1975. On the semantics of negation. In Contemporary Research in Philosophical Logic and Linguistic Semantics, pages 279–313. Dordrecht: D. Reidel. ↗
- Beth Levin. 1993. English Verb Classes And Alternations: A Preliminary Investigation. University of Chicago Press. find
- Mitchell P. Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz. 1993. Building a large annotated corpus of english: The Penn Treebank. Computational Linguistics, 19(2):313–330. ↗ our card
- Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, and Bonnie Webber. 2004. Annotating discourse connectives and their arguments. In Proceedings of the HLT/NAACL Workshop on Frontiers in Corpus Annotation, pages 9–16, Boston, MA. find our card
- Bo Pang, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up? sentiment classification using machine learning techniques. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2002), pages 79–86. ↗
- Rashmi Prasad, Eleni Miltsakaki, Aravind Joshi, and Bonnie Webber. 2004. Annotation and data mining of the Penn Discourse Treebank. In Proceedings of the ACL Workshop on Discourse Annotation, pages 88–95, Barcelona, Spain. find our card
- Rashmi Prasad, Aravind Joshi, Nikhil Dinesh, Alan Lee, Eleni Miltsakaki, and Bonnie Webber. 2005. The Penn Discourse TreeBank as a resource for natural language generation. In Proceedings of the Corpus Linguistics Workshop on Using Corpora for NLG. find our card
- Ellen Riloff, Janyce Wiebe, and Willian Phillips. 2005. Exploiting subjectivity classification to improve information extraction. In Proceedings of the 20th National Conference on Artificial Intelligence (AAAI-2005). find
- Ivan A. Sag and Carl Pollard. 1991. An integrated theory of complement control. Language, 67(1):63– 113. ↗
- The PDTB-Group. 2006. The Penn Discourse Tree-Bank 1.0 Annotation Manual. Technical Report IRCS-06-01, Institute for Research in Cognitive Science, University of Pennsylvania. find
- Veseli Stoyanov, Claire Cardie, and Janyce Wiebe. 2005. Multi-perspective question answering using the OpQA corpus. In Proceedings of HLT-EMNLP. find
- Peter D. Turney. 2002. Thumbs up or thumbs down? semantic orientation applied to unsupervised classification of reviews. In Proceedings of ACL 2002, pages 417–424. find
- Bonnie Webber, Aravind Joshi, M. Stone, and Alistair Knott. 2003. Anaphora and discourse structure. Computational Linguistics, 29(4):545–587. ↗ our card
- Bonnie Webber, Aravind Joshi, Eleni Miltsakaki, Rashmi Prasad, Nikhil Dinesh, Alan Lee, and K. Forbes. 2005. A short introduction to the PDTB. In Copenhagen Working Papers in Language and Speech Processing. find
- Janyce Wiebe, Theresa Wilson, Rebecca Bruce, Matthew Bell, and Melanie Martin. 2004. Learning subjective language. Computational Linguistics, 30(3):277–308. ↗
- Janyce Wiebe, Theresa Wilson, , and Claire Cardie. 2005. Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, 1(2). ↗
- Theresa Wilson and Janyce Wiebe. 2005. Annotating attributions and private states. In Proceedings of the ACL Workshop on Frontiers in Corpus Annotation II: Pie in the Sky, Ann Arbor, Michigan. find
- Hon Yu and Vasileios Hatzivassiloglou. 2003. Towards answering opinion questions: separating facts from opinions and identifying the polarity of opinion sentences. In Proceedings of EMNLP-2003, pages 129–136, Saporo, Japan. find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/prasad-2006-annotating-attribution-penn-discourse-treebank/