Annotation of Discourse Relations for Conversational Spoken Dialogs
Summary
The paper examines how discourse relations work in spontaneous spoken Italian. It tests whether the Penn Discourse Treebank (PDTB) framework, designed for written English news, can be used for conversational dialogs. The authors annotated 60 human-human help-desk conversations from the LUNA corpus. This adds a discourse layer on top of LUNA's existing annotations for domain attributes, dialog acts and FrameNet-style predicate-argument structures.
Several changes to PDTB were needed:
- Non-adjacent arguments: implicit relations may link spans that are not next to each other, because speech is full of interruptions and disfluencies.
- New relation label: an Interruption label covers cases where a speaker is cut off after producing only one argument.
- Revised sense hierarchy: the hierarchy was reworked to capture pragmatic functions, such as separating a word used as a turn-taking marker from the same word used as a real connective.
Corpus statistics show that sense and connective frequencies differ from those in PDTB. Temporal and causal relations dominate, reflecting troubleshooting talk. This was the first application of PDTB to Italian and to spontaneous dialog, which matters for dialog management and other discourse-aware spoken-language systems.
Key points
- LUNA corpus: 1000 Italian dialogs collected at the help-desk of the Piedmont Region's information systems consortium, split evenly between Human-Human and Human-Machine (Wizard of Oz) conversations. Only 60 HH dialogs received discourse annotation.
- Relation types: the PDTB types (Explicit, Implicit, AltLex, EntRel) were kept, and a new Interruption label was added.
- Argument selection: the minimality principle and the strict two-argument rule (Arg1/Arg2) were retained. The adjacency constraint on implicit relations was dropped.
- Connective ambiguity: words like "allora" (so) can act either as a discourse marker or as a true connective, which motivated the pragmatics-oriented sense revisions.
- Sense distribution: Temporal.Asynchronous and causal senses rank much higher in LUNA than in PDTB, which the authors attribute to task-oriented troubleshooting dialogs. Annotating attribution is planned as future work.
Cited by
- The DISRPT 2023 Shared Task on Elementary Discourse Unit Segmentation, Connective Detection, and Relation Classification
- ISO 24617-2: A semantically-based standard for dialogue annotation
- Discourse Markers in Speech: Distinctive Features and Corpus Annotation
- Shallow Discourse Parsing with Conditional Random Fields
- Evaluation of Discourse Relation Annotation in the Hindi Discourse Relation Bank
- GDTB: Genre Diverse Data for English Shallow Discourse Parsing across Modalities, Text Types, and Domains
- TED-CDB: A Large-Scale Chinese Discourse Relation Dataset on TED Talks
- Implicit Discourse Relation Identification for Open-domain Dialogues
- Introducing the Prague Discourse Treebank 1.0
- Discourse Annotation in the PDTB: The Next Generation
- Annotating Discourse Relations in Spoken Language: A Comparison of the PDTB and CCR Frameworks
- Announcing the Prague Discourse Treebank 3.0
- Linguistic Tests for Discourse Relations in the TüBa-D/Z Corpus of Written German
- Modelling the Usage of Discourse Connectives as Rational Speech Acts
- eRST: A Signaled Graph Theory of Discourse Relations and Organization
Cite
@inproceedings{tonelli2010annotation,
title = {{Annotation of Discourse Relations for Conversational Spoken Dialogs}},
author = {Tonelli, Sara and Riccardi, Giuseppe and Prasad, Rashmi and Joshi, Aravind},
booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
year = {2010},
doi = {10.63317/2xr8r3kns22r},
url = {https://doi.org/10.63317/2xr8r3kns22r}
}References
- C. Bazzanella. 1990. Phatic connectives as Interactional cues in Contemporary Spoken Italian. Journal of Pragmatics, 14:629–647. find
- M. Berretta. 1984. Connettivi testuali in italiano e pianifi-cazione del discorso. In Linguistica Testuale, pages 237– 253. Bulzoni. find
- M. Dinarelli, S. Quarteroni, S. Tonelli, A. Moschitti, and G. Riccardi. 2009. Annotating Spoken Dialogs: from Speech Segments to Dialog Acts and Frame Semantics. In EACL Workshop on Semantic Representation of Spoken Language, Athens, Greece. find our card
- M. P. Marcus, B. Santorini, and M. A. Marcinkiewicz. 1993. Building a Large Annotated Corpus of English: the Penn Treebank. Computational Linguistics, 19(2):313–330. find our card
- Lucie Mladová, Šárka Zikánová, and Eva Hajičová. 2008. From Sentence to Discourse: Building an Annotation Scheme for Discourse Based on Prague Dependency Treebank. In Proceedings of the 6th Language Resources and Evaluation Conference (LREC), Marrakech, Morocco. find
- U. Oza, R. Prasad, S. Kolachina, D. M. Sharma, and A. Joshi. 2009. The Hindi Discourse Relation Bank. In Proceedings of the Third Linguistic Annotation Workshop, Suntec, Singapore. find our card
- Silvia Pareti and Irina Prodanof. 2010. Annotating Attribution Relations: Towards an Italian Discourse Treebank. To appear in Proceedings of the Seventh International Conference on Language Resources and Evaluation. find
- Silvia Pareti. 2009. Towards a discourse resource for Italian: developing an annotation schema for attribution. Master’s thesis, Faculty of Letters and Philosophy, University of Pavia, Italy. find
- R. Prasad, N. Dinesh, A. Lee, A. Joshi, and B. Webber. 2007. Attribution and its annotation in the Penn Discourse TreeBank. Traitement Automatique des Langues, Special Issue on Computational Approaches to Document and Discourse, 47(2). find
- R. Prasad, N. Dinesh, A. Lee, E. Miltsakaki, L. Robaldo, A. Joshi, and B. Webber. 2008. The Penn Discourse TreeBank 2.0. In Proceedings of the 6th Language Resources and Evaluation Conference (LREC), Marrakech, Morocco. find our card
- Silvia Quarteroni, Giuseppe Riccardi, Sebastian Varges, and Arianna Bisazza. 2008. An Open-Domain Dialog Act Taxonomy. Technical Report DISI-08-032, Department of Information Engineering and Computer Science, University of Trento. find
- PDTB-Group. 2009. The Penn Discourse Treebank 2.0 Annotation Manual. Technical Report IRCS-08-01, Institute for Research in Cognitive Science, University of Pennsylvania. Available online at http://www.seas.upenn.edu/pdtb/PDTBAPI/pdtb-annotation-manual.pdf. ↗
- Deborah Schiffrin. 1987. Discourse Markers. Cambridge University Press, Cambridge, U.K. find
- E. Sweetser. 1990. From etymology to pragmatics: Metaphorical and cultural aspects of semantic structure. Cambridge University Press. find
- Sara Tonelli and Giuseppe Riccardi. 2010. Guidelines for Annotating the LUNA corpus with Frame Information. Technical Report DISI-10-017, Department of Information Engineering and Computer Science, University of Trento. find
- Janyce Wiebe. 2002. Instructions for annotating opinions in newspaper articles. Technical Report TR-02-101, Department of Computer Science, University of Pittsburgh. find
- Nianwen Xue. 2005. Annotating Discourse Connectives in the Chinese Treebank. In Proceedings of the ACL Workshop on Frontiers in Corpus Annotation II: Pie in the Sky. find our card
- Deniz Zeyrek and Bonnie Webber. 2008. A Discourse Resource for Turkish: Annotating Discourse Connectives in the METU Corpus. In Proceedings of IJCNLP. find our card
This page in Markdown → https://md.research.elamur.ai/free/papers/tonelli-2010-annotation-discourse-relations-conversational-spoken/