Using Explicit Discourse Connectives in Translation for Implicit Discourse Relation Classification
Summary
Classifying implicit discourse relations, which are relations between text spans that no connective such as "because" or "but" signals, remains a weak point of discourse parsing. One main reason is that PDTB offers little labeled data. The authors propose a way to generate extra training examples from English–French parallel text. Human translators sometimes add a connective that the source lacked (explicitation), and this added connective reveals the intended relation.
The pipeline works in four steps:
- A pre-trained MT system translates the French side back into English.
- An end-to-end English discourse parser runs on both the original and the back-translated text.
- The method keeps consecutive sentence pairs that the parser marks as implicit in the source but explicit in the back-translation.
- Each kept source pair receives the label of the explicit relation.
This yields a training set several times larger than PDTB's. With this added data, a plain bidirectional LSTM beats prior state-of-the-art systems on the PDTB 2.0 test set and in cross-validation. The approach does not depend on any particular classifier, so other implicit relation models could reuse it.
Key points
- PDTB provides only 12763 implicit training instances and a 761-relation test set. Some second-level senses have about a dozen examples.
- Back-translating into English lets the method use an English parser and the PDTB label set instead of a target-language parser. MT quality matters mainly for translating the connectives correctly.
- Accuracy rises with more mined intra-sentential samples but levels off around 40,000. That setting gave the best averaged accuracy, 45.87%, which beat using all mined samples.
- Training on mined samples alone, without PDTB data, performed worse than using PDTB only.
- The mined data contains noise, for example "if" wrongly tagged as a connective, which inflates Contingency.Condition. It also captures relation patterns that PDTB does not annotate, such as temporal readings of gerund constructions.
Cited by
- CVAE-based Re-anchoring for Implicit Discourse Relation Classification
- Annotation-Inspired Implicit Discourse Relation Classification with Auxiliary Discourse Connective Generation
- Acquiring Annotated Data with Cross-lingual Explicitation for Implicit Discourse Relation Classification
- Learning to Explicitate Connectives with Seq2Seq Network for Implicit Discourse Relation Classification
- Next Sentence Prediction helps Implicit Discourse Relation Classification within and across Domains
- Topic Tensor Network for Implicit Discourse Relation Recognition in Chinese
Cite
@inproceedings{shi2017using,
title = {{Using Explicit Discourse Connectives in Translation for Implicit Discourse Relation Classification}},
author = {Shi, Wei and Yung, Frances and Rubino, Raphael and Demberg, Vera},
booktitle = {Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)},
year = {2017},
url = {https://aclanthology.org/I17-1049/}
}References
- Fatemeh Torabi Asr and Vera Demberg. 2012. Implicitness of discourse relations. In Proceedings of COLING 2012. find our card
- The COLING 2012 Organizing Committee, Mumbai, India, pages 2669–2684. find
- Or Biran and Kathleen McKeown. 2013. Aggregated word pair features for implicit discourse relation disambiguation. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Sofia, Bulgaria, pages 69–73. find our card
- Bruno Cartoni, Sandrine Zufferey, and Thomas Meyer. 2013. Annotating the meaning of discourse connectives by looking at their translation: The translation-spotting technique. D&D 4(2):65–86. find our card