Splitting EUD Graphs into Trees: A Quick and Clatty Approach
Summary
The paper describes the FASTPARSE team's system for the IWPT 2021 shared task, which requires building Enhanced Universal Dependencies (EUD) graphs. The authors were the first to apply a sequence-labelling approach to graph parsing, in which each token receives a single label. They decompose each EUD graph into four trees using linguistic criteria. The base tree is the one most similar to a regular UD tree, and the other three cover relative clauses, coordination (conj) and control (xcomp). These trees may overlap with one another. For each tree type on each treebank, a separate BiLSTM parser was trained with the bracketing encoding of Strzyz et al. (2019b). The predicted trees were then merged back into a graph with a very simple rule: take the union of all edges, and take the label from the first tree in which the edge occurs. Overall, the parser reproduces the unlabelled graph structure correctly, but it assigns edge labels considerably worse. In the final results, it is the weakest system among those that submitted results for all treebanks. The value of the work is that it shows that a linguistically motivated decomposition of a graph into trees works in principle. The main bottlenecks are edge labelling and the way the trees are assembled into a graph.
Key points
- Allowing a node only one incoming edge covers 94.15% of EUD edges, and allowing two covers 99.53%. Thus almost the entire graph can be represented as several trees.
- As a check, the authors decomposed the gold graphs into trees and reassembled them. On dev, ELAS is roughly 91–99 for most treebanks, and 95.97 for uk-iu. A notable exception is ar-padt (81.91), which the authors attribute to a likely implementation error.
- Average results on dev: EUAS 86.66, EULAS 72.02, ELAS 69.21. The authors explain the large gap between unlabelled and labelled structure by the fact that the relative position of the lemma for case marking was added to the label.
- On test, the average scores are EULAS 68.78 and ELAS 65.81. For Ukrainian, EULAS is 65.41 and ELAS is 63.42. In the overall ranking, the system placed second to last.
- Preprocessing (tokenization, lemmatization, tags) was done by UDPipe 2.0. FastText embeddings with a vocabulary of up to 50K words were used. The authors acknowledge two errors: incorrect construction of the relative-clause tree and missing ccomp edges in the control tree.
Cited by
Cite
@inproceedings{anderson2021splitting,
title = {{Splitting EUD Graphs into Trees: A Quick and Clatty Approach}},
author = {Anderson, Mark and Gómez-Rodríguez, Carlos},
booktitle = {Proceedings of the 17th International Conference on Parsing Technologies and the IWPT 2021 Shared Task on Parsing into Enhanced Universal Dependencies (IWPT 2021)},
year = {2021},
doi = {10.18653/v1/2021.iwpt-1.17},
eprint = {2106.13155},
archivePrefix = {arXiv},
url = {https://doi.org/10.18653/v1/2021.iwpt-1.17}
}References
- Mark Anderson and Carlos Gómez-Rodrı́guez. 2021. A modest Pareto optimisation analysis of dependency parsers in 2021. In Proceedings of the 17th International Conference on Parsing Technologies and the IWPT 2021 Shared Task on Parsing into Enhanced Universal Dependencies, Online. Association for Co… find
- Gosse Bouma, Djamé Seddah, and Daniel Zeman. 2021. From raw text to Enhanced Universal Depen-Michalina Strzyz, David Vilares, and Carlos Gómez-Rodrı́guez. 2019a. Sequence labeling parsing by learning across representations. In Proceedings of the 57th Annual Meeting of the Association for Computati… find
- Yoeng-Jin Chu and Tseng-Hong Liu. 1965. On the shortest arborescence of a directed graph. Scientia Sinica, 14:1396–1400. find
- Michalina Strzyz, David Vilares, and Carlos Gómez-Rodrı́guez. 2019b. Viable dependency parsing as sequence labeling. In Proceedings of NAACL-HLT, pages 717–723. find
- Mathieu Dehouck, Mark Anderson, and Carlos Gómez-Rodrı́guez. 2020. Efficient EUD parsing. In Proceedings of the 16th International Conference on Parsing Technologies and the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies, pages 192–205, Online. Association for Computational L… find
- Michalina Strzyz, David Vilares, and Carlos Gómez-Rodrı́guez. 2020. Bracketing encodings for 2-planar dependency parsing. In Proceedings of the 28th International Conference on Computational Linguistics, pages 2472–2484. find
- Weiwei Sun, Junjie Cao, and Xiaojun Wan. 2017. Semantic dependency parsing via book embedding. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 828–838, Vancouver, Canada. Association for Computational Linguistics. find
- Jack Edmonds. 1967. Optimum branchings. Journal of Research of the national Bureau of Standards B, 71(4):233–240. find
- Daniel Fernández-González and Carlos Gómez-Rodrı́guez. 2018. A dynamic oracle for linear-time 2-planar dependency parsing. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pa… find
- Junru Zhou, Zuchao Li, and Hai Zhao. 2020. Parsing all: Syntax and semantics, dependencies and spans. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 4438–4449, Online. Association for Computational Linguistics. find
- Carlos Gómez-Rodrı́guez and Joakim Nivre. 2010. A transition-based parser for 2-planar dependency structures. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics (ACL 2010), pages 1492–1501. Association for Computational Linguistics. find
- Carlos Gómez-Rodrı́guez and Joakim Nivre. 2013. Divisible transition systems and multiplanar dependency parsing. Comput. Linguist., 39(4):799–845. find
- Carlos Gómez-Rodrı́guez and David Vilares. 2018. Constituent parsing as sequence labeling. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1314– 1324. Association for Computational Linguistics. find
- James Henderson, Paola Merlo, Ivan Titov, and Gabriele Musillo. 2013. Multilingual Joint Parsing of Syntactic and Semantic Dependencies with a Latent Variable Model. Computational Linguistics, 39(4):949–998. find
- Zuchao Li, Jiaxun Cai, Shexia He, and Hai Zhao. 2018. Seq2seq dependency parsing. In Proceedings of the 27th International Conference on Computational Linguistics, pages 3203–3214, Santa Fe, New Mexico, USA. Association for Computational Linguistics. find
- Drahomı́ra Johanka Spoustová and Miroslav Spousta. 2010. Dependency parsing as a sequence labeling task. The Prague Bulletin of Mathematical Linguistics, 94(2010):7–14. find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/anderson-2021-splitting-eud-graphs-into-trees/