The Leeds Arabic Discourse Treebank: Annotating Discourse Connectives for Arabic
Summary
Before this work, Arabic corpora had morphological and syntactic annotation but no discourse layer. Earlier Arabic studies of connectives were small, mixed discourse connectives with ordinary prepositions, and measured no agreement. The authors built the Leeds Arabic Discourse Treebank (LADTB) on top of the Penn Arabic Treebank. Following the theory-neutral PDTB approach, they mark each explicit connective, the relation it signals and its two arguments (Arg1/Arg2).
Several adaptations reflect Arabic structure. Clitics count as connectives, prepositions governing nominalizations (Al-Mazdar) are included, and certain noun sentences can serve as arguments. Two annotators worked on 537 news texts using a dedicated annotation tool.
Agreement on finding connectives was very high. Agreement on relation labels was moderate overall, mainly because news texts conventionally begin sentences with و (w/and), often without any real discourse function. When that connective is excluded, relation agreement becomes good. The result is the first principled, reliability-tested discourse resource for Arabic, intended for training connective and relation classifiers.
Key points
- Connective lexicon: 91 basic connectives plus 16 modified forms gives 107 types, comparable to about 100 in the PDTB. Only 68 of these appeared in the final corpus.
- Relation scheme: the 4 PDTB top-level classes are kept, with 18 subclasses. Two subclasses are new, EXPANSION.Background and COMPARISON.Similarity. Annotators also used 22 combinations of multiple relations.
- Connective identification (Task I): over 23,331 candidate tokens, observed agreement was 0.95 with kappa 0.88. Only about 5,586 of the candidates were true connectives, largely because of ambiguous clitics.
- Relation assignment (Task II): agreement was kappa 0.57 and alpha 0.58 overall. Without و it rose to 0.80 observed, kappa 0.77 and alpha 0.80.
- Corpus size: after a 121-text pilot, the final LADTB covers 5,651 connectives in 537 files, about 75% of ATB part 1. Disagreed paragraph-initial و instances were set to Expansion.Conjunction by default.
Cited by
- Multiword expressions as discourse markers in Hebrew and Lithuanian
- Semi-Automatic Annotation of Intra-Sentential Discourse Relations in PDT
- Evaluation of Discourse Relation Annotation in the Hindi Discourse Relation Bank
- Inducing Discourse Connectives from Parallel Texts
- Cross-lingual Discourse Relation Analysis: A corpus study and a semi-supervised classification system
- Introducing the Prague Discourse Treebank 1.0
- Reflections on the Penn Discourse TreeBank, Comparable Corpora, and Complementary Annotation
- Discourse Annotation in the PDTB: The Next Generation
- The Thai Discourse Treebank: Annotating and Classifying Thai Discourse Connectives
- Modelling Discourse Relations for Arabic
- Categories of coherence relations in discourse annotation
- Announcing the Prague Discourse Treebank 3.0
- Linguistic Tests for Discourse Relations in the TüBa-D/Z Corpus of Written German
- Cross-Lingual Identification of Ambiguous Discourse Connectives for Resource-Poor Language
Cite
@inproceedings{alsaif2010leeds,
title = {{The Leeds Arabic Discourse Treebank: Annotating Discourse Connectives for Arabic}},
author = {Al-Saif, Amal and Markert, Katja},
booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
year = {2010},
url = {https://aclanthology.org/L10-1332/}
}References
- Amal Al-Saif, Katja Markert, and Hussein Abdul-Raof. 2009. Corpus-Based Study: Extensive Collection of Discourse Connectives For Arabic. In Proceedings of The Saudi International Conference 2009 (SIC09), Surrey, UK. find
- W. Al-Sanie, A. Touir, and H. Mathkour. 2005. Towards a rhetorical parsing of Arabic text. In The International Conference on Intelligent Agents, Web Technology and Internet Commerce (IAWTIC05). find
- N.N. Al-Warraki and A.T. Hasanayn. 1994. The connectors in modern standard Arabic. American University in Cairo Press. find
- I.H. Alansari. 1985. Mogny Allabib. Dar Alfekur, Beirut. find
- H. Alfarabi. 1990. Ketab AlHorof. Dar AlMashreg, Lebnan. find
- R. Artstein and M. Poesio. 2008. Inter-coder agreement for computational linguistics (survey article). Computational Limnguistics, 34(4):555–596. ↗
- K. Dukes and N. Habas. 2010. Morphological annotation of quranic arabic. In International Conference on Language Resources and Evaluation (LREC 2010). find our card
- J. Hajic, O. Smrz, P. Zemánek, J. Šnaidauf, and E. Beška. 2004. Prague Arabic dependency treebank: Development in data and tools. In Proc. of the NEMLAR Intern. Conf. on Arabic Language Resources and Tools, pages 110–117. Citeseer. find
- M.A.K. Halliday and R. Hasan. 1976. Cohesion in English. Longman London. find
- J.R. Hobbs. 1985. On the coherence and structure of discourse. Center for the Study of Language and Information, Stanford, Calif. find
- E.H. Hovy. 1993. Automated discourse generation using discourse structure relations. Artificial intelligence, 63(1-2):341–385. ↗
- A. Knott and T. Sanders. 1998. The classification of coherence relations and their linguistic markers: An exploration of two languages. Journal of Pragmatics, 30(2):135–175. ↗
- M. Maamouri and A. Bies. 2004. Developing an Arabic treebank: Methods, guidelines, procedures, and tools. In Proceedings of the Workshop on Computational Approaches to Arabic Script-based Languages (COLING), Geneva. find our card
- W.C. Mann and S.A. Thompson. 1988. Rhetorical structure theory: Toward a functional theory of text organization. Text, 8(3):243–281. Number of files Connective types Discourse relation types Potential connective tokens Real discourse connectives Most frequent connective Least frequent connectives ↗ our card
This page in Markdown → https://md.research.elamur.ai/free/en/papers/saif-2010-leeds-arabic-discourse-treebank-annotating/