Cross-Document Event Coreference Resolution on Discourse Structure
Summary
Cross-document event coreference resolution (CD-ECR) groups event mentions from several documents that describe the same real-world event. Most earlier systems compare mention pairs using only nearby context, so they struggle when the two mentions are far apart or appear in different documents. Chen et al. add global signals from discourse structure. A DRS constructor (segmentor plus parser) converts text into a discourse tree whose leaves are EDUs. For each mention pair, the model uses the tree node where their paths meet (LCP) and the shortest path between them (DT-SDP). A Bi-LSTM encodes the rhetorical and nuclearity labels along that path. These global features are combined with local trigger and EDU embeddings from RoBERTa LARGE, and an MLP then scores coreference. For pairs that span two documents, the authors build a joint cross-document tree. Its best variant keeps the event sentences and compresses the surrounding text before concatenating the documents. On ECB+, the system beats several baselines and is competitive with the state of the art. This suggests that discourse-level links help connect distant mentions.
Key points
- Evaluated on the ECB+ corpus using gold (annotated) event mentions; event detection is outside the scope of the work.
- Local representation: documents longer than 512 word-piece tokens are split at whole-EDU boundaries rather than at a fixed token cut. Trigger-pair and EDU-pair vectors take the form [a, b, aβb].
- Three cross-document tree strategies are compared: ES-only, Full-doc and ES-comp. ES-comp works best, while Full-doc adds noise and ES-only can drop useful rhetorical nodes.
- A case study (Matt Smith cast as the Doctor) shows a DT-SDP containing NS-Elaborate carrying the shared argument "Smith" between the mentions "winning" and "chosen".
- The authors claim to be the first to apply cross-document discourse trees to CD-ECR. They note slow DRS constructor inference and an improvable tree-building strategy as limitations.
Cited by
- A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference Resolution
- Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Models
Cite
@inproceedings{chen2023cross,
title = {{Cross-Document Event Coreference Resolution on Discourse Structure}},
author = {Chen, Xinyu and Xu, Sheng and Li, Peifeng and Zhu, Qiaoming},
booktitle = {Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing},
year = {2023},
doi = {10.18653/v1/2023.emnlp-main.294},
url = {https://doi.org/10.18653/v1/2023.emnlp-main.294}
}References
- Jun Araki and Teruko Mitamura. 2015. Joint event trigger identification and event coreference resolution with structured perceptron. In EMNLP, pages 2074β 2080. find our card
- Amit Bagga. 1998. Evaluation of coreferences and coreference resolution systems. In LREC, pages 563β 572. find
- Shany Barhom, Vered Shwartz, Alon Eirew, Michael Bugert, Nils Reimers, and Ido Dagan. 2019. Revisiting joint modeling of cross-document entity and event coreference resolution. In ACL, pages 4179β 4189. find our card
- Cosmin Adrian Bejan and Sanda M. Harabagiu. 2010. Unsupervised event coreference resolution with rich linguistic features. In ACL, pages 1412β1422. find our card
- Avi Caciularu, Arman Cohan, Iz Beltagy, Matthew E. Peters, Arie Cattan, and Ido Dagan. 2021. CDLM: cross-document language modeling. In EMNLP (Findings), pages 2648β2662. find
- Arie Cattan, Alon Eirew, Gabriel Stanovsky, Mandar Joshi, and Ido Dagan. 2021. Cross-document coreference resolution over predicted mentions. In ACL/IJCNLP (Findings), pages 5100β5107. find our card
- Chen Chen and Vincent Ng. 2016. Joint inference over a lightly supervised information extraction pipeline: Towards event coreference resolution for resource-scarce languages. In AAAI, pages 2913β2920. find
- Greg Durrett and Dan Klein. 2013. Easy victories and uphill battles in coreference resolution. In EMNLP, pages 1971β1982. find our card
- Jie Fang and Peifeng Li. 2020. Data augmentation with reinforcement learning for document-level event coreference resolution. In NLPCC, pages 751β763. find
- Jie Fang, Peifeng Li, and Guodong Zhou. 2018. Employing multiple decomposable attention networks to resolve event coreference. In NLPCC, pages 246β 256. find
- William Held, Dan Iter, and Dan Jurafsky. 2021. Focus on what matters: Applying discourse coherence theory to cross document coreference. In EMNLP, pages 1406β1417. find our card
- Yin Jou Huang, Jing Lu, Sadao Kurohashi, and Vincent Ng. 2019. Improving event coreference resolution by learning argument compatibility from unlabeled data. In NAACL-HLT, pages 785β795. find
- Mandar Joshi, Omer Levy, Luke Zettlemoyer, and Daniel S. Weld. 2019. BERT for coreference resolution: Baselines and analysis. In EMNLP/IJCNLP, pages 5802β5807. find our card
- Kian Kenyon-Dean, Jackie Chi Kit Cheung, and Doina Precup. 2018. Resolving event coreference with supervised representation learning and clustering-oriented regularization. In *SEM@NAACL-HLT, pages 1β10. find our card
- Zheng Chen and Heng Ji. 2009. Graph-based event coreference resolution. In ACL, pages 54β57. find our card
- Sebastian Krause, Feiyu Xu, Hans Uszkoreit, and Dirk Weissenborn. 2016. Event linking with sentential features from convolutional neural networks. In CoNLL, pages 239β249. find
- Fei Cheng and Yusuke Miyao. 2017. Classifying temporal relations by bidirectional LSTM over dependency paths. In ACL, pages 1β6. find
- Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. 2017. End-to-end neural coreference resolution. In EMNLP, pages 188β197. find our card
- Haoyi Cheng, Peifeng Li, and Qiaoming Zhu. 2019. Employing gated attention and multi-similarities to resolve document-level chinese event coreference. In IALP, pages 296β301. find
- Shulin Liu, Yubo Chen, Kang Liu, and Jun Zhao. 2017. Exploiting argument information to improve event detection via supervised attention mechanisms. In ACL, pages 1789β1798. find
- Prafulla Kumar Choubey and Ruihong Huang. 2018. Improving event coreference resolution by modeling correlations between event coreference chains and document topic structures. In ACL, pages 485β495. find our card
- Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized BERT pretraining approach. CoRR, abs/1907.11692. find
- Prafulla Kumar Choubey, Aaron Lee, Ruihong Huang, and Lu Wang. 2020. Discourse as a function of event: Profiling discourse structure in news articles around the main event. In ACL, pages 5374β5386. find
- Agata Cybulska and Piek Vossen. 2014. Using a sledgehammer to crack a nut? lexical diversity and event coreference resolution. In LREC, pages 4545β4552. find our card
- Agata Cybulska and Piek Vossen. 2015. Translating granularity of event slots into features for event coreference resolution. In EVENTS@HLP-NAACL, pages 1β10. find our card
- Zhengzhong Liu, Jun Araki, Eduard H. Hovy, and Teruko Mitamura. 2014. Supervised within-document event coreference using information propagation. In LREC, pages 4539β4544. find our card
- Zhengzhong Liu, Teruko Mitamura, and Eduard H. Hovy. 2018. Graph based decoding for event sequencing and coreference resolution. In COLING, pages 3645β3657. find
- Jing Lu and Vincent Ng. 2017. Joint learning for event coreference resolution. In ACL, pages 90β101. find
- Jing Lu and Vincent Ng. 2021. Span-based event coreference resolution. In AAAI, pages 13489β13497. find
- Jing Lu, Deepak Venugopal, Vibhav Gogate, and Vincent Ng. 2016. Joint inference for event coreference resolution. In COLING, pages 3264β3275. find our card
- Yaojie Lu, Hongyu Lin, Jialong Tang, Xianpei Han, and Le Sun. 2020. End-to-end neural event coreference resolution. CoRR, abs/2009.08153. β [arXiv:2009.08153](https://arxiv.org/abs/2009.08153) find
- Xiaoqiang Luo. 2005. On coreference resolution performance metrics. In HLT/EMNLP, pages 25β32. find our card
- William C Mann and Sandra A Thompson. 1998. Rhetorical structure theory: Toward a functional theory of text organization. Text - Interdisciplinary Journal for the Study of Discourse, 8(3):243β281. find
- Hu Xu, Bing Liu, Lei Shu, and Philip S. Yu. 2019. BERT post-training for review reading comprehension and aspect-based sentiment analysis. In ACL, pages 2324β2335. find our card
- Yan Xu, Lili Mou, Ge Li, Yunchuan Chen, Hao Peng, and Zhi Jin. 2015. Classifying relations via long short term memory networks along shortest dependency paths. In EMNLP, pages 1785β1794. find
- Bishan Yang, Claire Cardie, and Peter I. Frazier. 2015. A hierarchical distance-dependent bayesian model for event coreference resolution. Trans. Assoc. Comput. Linguistics, 3:517β528. find
- Xiaodong Yu, Wenpeng Yin, and Dan Roth. 2022. Pairwise representation learning for event coreference. In *SEM@NAACL-HLT, pages 69β78. find our card
- Vincent Ng. 2010. Supervised noun phrase coreference research: The first fifteen years. In ACL, pages 1396β 1411. find our card
- Yutao Zeng, Xiaolong Jin, Saiping Guan, Jiafeng Guo, and Xueqi Cheng. 2020. Event coreference resolution with their paraphrases and argument-aware embeddings. In COLING, pages 3084β3094. find our card
- Thien Huu Nguyen, Adam Meyers, and Ralph Grishman. 2016. New york university 2016 system for KBP event nugget: A deep learning approach. In TAC. NIST. find
- Longyin Zhang, Fang Kong, and Guodong Zhou. 2021. Adversarial learning for discourse rhetorical structure parsing. In ACL/IJCNLP, pages 3946β3957. find our card
- Cristina Nicolae and Gabriel Nicolae. 2006. BESTCUT: A graph algorithm for coreference resolution. In EMNLP, pages 275β283. find our card
- Haoruo Peng, Yangqiu Song, and Dan Roth. 2016. Event detection and co-reference with minimal supervision. In EMNLP, pages 392β402. find our card
- Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res., 21:140:1β140:67. find
- Karthik Raghunathan, Heeyoung Lee, Sudarshan Rangarajan, Nate Chambers, Mihai Surdeanu, Dan Jurafsky, and Christopher D. Manning. 2010. A multi-pass sieve for coreference resolution. In EMNLP, pages 492β501. find our card
- Satyan Sangeetha and Michael Arock. 2012. Event coreference resolution using mincut based graph clustering. International Journal of Computing and Information Sciences, pages 253β260. find
- Marc B. Vilain, John D. Burger, John S. Aberdeen, Dennis Connolly, and Lynette Hirschman. 1995. A model-theoretic coreference scoring scheme. In MUC, pages 45β52. find our card
- Charles L. Wayne. 1998. Topic detection & tracking: a case study in corpues creation & evaluation methodologies. In LREC, pages 111β116. find
- Dirk Weissenborn, Georg Wiese, and Laura Seiffe. 2017. Making neural QA as simple as possible but not simpler. In CoNLL, pages 271β280. find