Bridging Resolution: A Survey of the State of the Art
Summary
Bridging resolution connects an anaphor to an antecedent that is related to it but does not refer to the same entity. In the paper's example, "the games" depends on "baseball". The task is harder than entity coreference. It lacks agreement, syntactic or lexical-overlap cues, it often requires context and commonsense reasoning, and antecedents can be verb phrases or clauses as well as NPs. Kobayashi and Ng survey the field. They trace how the definition changed: identity relations were gradually removed, indefinite anaphors became allowed, and fixed relation inventories were abandoned. They also compare the main English corpora, list non-English resources, and review evaluation settings and published systems. They find the field fragmented. Corpora use different bridging definitions and often have no standard splits. Systems are evaluated with inconsistent filtering and gold inputs, and many are not released, so results are hard to compare. Reported scores are low, so the problem remains far from solved. The authors recommend:
- a CoNLL-style benchmark with a much larger corpus;
- collaboration with lexical-semantics and IE researchers;
- end-to-end and hybrid models;
- multilingual work using projection.
Key points
- Main English corpora:
- ISNotes: 50 WSJ docs, 663 anaphors.
- BASHI: 50 WSJ docs, 459 anaphors.
- ARRAU: domains RST (413 docs, 3777 anaphors), GNOME, PEAR and TRAINS.
- SciCorp: 14 docs, 1366 anaphors, definite NPs only.
- Differences between corpora: Most of the bridging annotated in ARRAU is lexical, whereas ISNotes, BASHI and SciCorp contain referential bridging. ISNotes excludes comparative anaphora, whereas BASHI and ARRAU treat it as bridging.
- Evaluation settings: there are three, ranging from fully end-to-end to settings that supply gold mentions or gold anaphors. No existing resolver has been evaluated end-to-end.
- Results: the best accuracy when resolving given anaphors is around 50%. The best resolution F-score in full bridging resolution is below 25%. Yu and Poesio's (2020) MTL model outperforms Rösiger et al.'s (2018b) rule-based system on ARRAU and ISNotes, but not on BASHI.
- Non-English resources:
- DIRNDL and GRAIN (German)
- Prague Dependency Treebank (Czech)
- RuGenBridge (Russian)
- parallel corpora CorefPro (German–English–Russian) and Copenhagen Dependency Treebank
Cited by
- Subjectivity in the Annotation of Bridging Anaphora
- GUMBridge: A Corpus for Varieties of Bridging Anaphora
Cite
@inproceedings{kobayashi2020bridging,
title = {{Bridging Resolution: A Survey of the State of the Art}},
author = {Kobayashi, Hideo and Ng, Vincent},
booktitle = {Proceedings of the 28th International Conference on Computational Linguistics},
year = {2020},
doi = {10.18653/v1/2020.coling-main.331},
url = {https://doi.org/10.18653/v1/2020.coling-main.331}
}References
- Maja Bärenfänger, Daniela Goecke, Mirco Hilbert, Harald Lüngen, and Maik Stührenberg. 2008. Anaphora as an indicator of elaboration: A corpus study. Journal for Language Technology and Computational Linguistics, 23(2):49–73. ↗
- Matthew Berland and Eugene Charniak. 1999. Finding parts in very large corpora. In Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, pages 57–64. find
- Anders Björkelund, Kerstin Eckart, Arndt Riester, Nadja Schauffler, and Katrin Schweitzer. 2014. The extended dirndl corpus as a resource for automatic coreference and bridging resolution. In Proceedings of the 9th International Conference on Language Resources and Evaluation, pages 3222–3228. find
- Razvan Bunescu. 2003. Associative anaphora resolution: A web-based approach. In Proceedings of the EACL Workshop on The Computational Treatment of Anaphora, pages 47–52. find
- Aoife Cahill and Arndt Riester. 2012. Automatically acquiring fine-grained information status distinctions in german. In Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 232–236. find
- Tommaso Caselli and Irina Prodanof. 2006. Annotating bridging anaphors in Italian: in search of reliability. In Proceedings of the Fifth International Conference on Language Resources and Evaluation. find our card
- Scott Cederberg and Dominic Widdows. 2003. Using lsa and noun coordination information to improve the recall and precision of automatic hyponymy extraction. In Proceedings of the Seventh Conference on Natural Language Learning, pages 111–118. find
- Herbert H. Clark. 1975. Bridging. In Theoretical Issues in Natural Language Processing. find
- Pascal Denis and Jason Baldridge. 2008. Specialized models and ranking for coreference resolution. In Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing, pages 660–669. find our card
- Claire Gardent and Hélène Manuélian. 2005. Création d’un corpus annoté pour le traitement des descriptions définies. Traitement Automatique des Langues, 46(1):115–140. find
- Claire Gardent, Hélène Manuélian, and Eric Kow. 2003. Which bridges for bridging definite descriptions? In Proceedings of 4th International Workshop on Linguistically Interpreted Corpora. find our card
- Roxana Girju, Adriana Badulescu, and Dan Moldovan. 2003. Learning semantic constraints for the automatic discovery of part-whole relations. In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pages 80–87. find
- Roxana Girju, Adriana Badulescu, and Dan Moldovan. 2006. Automatic discovery of part-whole relations. Computational Linguistics, 32(1):83–135. ↗
- Yulia Grishina and Manfred Stede. 2015. Knowledge-lean projection of coreference chains across languages. In Proceedings of the Eighth Workshop on Building and Using Comparable Corpora, pages 14–22. find our card
- Yulia Grishina. 2016. Experiments on bridging across languages and genres. In Proceedings of the Workshop on Coreference Resolution Beyond OntoNotes, pages 7–15. find our card
- Jeanette K Gundel, Nancy Hedberg, and Ron Zacharski. 1993. Cognitive status and the form of referring expressions in discourse. Language, pages 274–307. ↗
- Jan Hajič, Eduard Bejček, Alevtina Bémová, Eva Buráňová, Eva Hajičová, Jiřı́ Havelka, Petr Homola, Jiřı́ Kárnı́k, Václava Kettnerová, Natalia Klyueva, Veronika Kolářová, Lucie Kučová, Markéta Lopatková, Marie Mikulová, Jiřı́ Mı́rovský, Anna Nedoluzhko, Petr Pajas, Jarmila Panevová, Lucie Poláková, Magdaléna Rysová, Petr Sgall, Johanka Spoustová, Pavel Straňák, Pavlı́na Synková, Magda Ševčı́ková, Jan Štěpánek, Zdeňka Urešová, Barbora Vidová Hladká, Daniel Zeman, Šárka Zikánová, and Zdeněk Žabokrtský. 2018. Prague dependency treebank 3.5. LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University. find
- John A Hawkins. 1978. Definiteness and indefiniteness: A study in reference and grammaticality prediction. Journal of Linguistics, 27:405–442. find
- Marti A. Hearst. 1992. Automatic acquisition of hyponyms from large text corpora. In Proceedings of the 15th International Conference on Computational Linguistics: Volume 2, pages 539–545. find
- Marti A Hearst. 1998. Automated discovery of wordnet relations. WordNet: an electronic lexical database, 2:132–152. ↗
- Iris Hendrickx, Gosse Bouma, Frederik Coppens, Walter Daelemans, Veronique Hoste, Geert Kloosterman, Anne-Marie Mineur, Joeri Van Der Vloet, and Jean-Luc Verschelde. 2008. A coreference corpus and resolution system for Dutch. In Proceedings of the Sixth International Conference on Language Resources and Evaluation. find our card
- Yufang Hou, Katja Markert, and Michael Strube. 2013a. Cascading collective classification for bridging anaphora recognition using a rich linguistic feature set. In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 814–820. find our card
- Yufang Hou, Katja Markert, and Michael Strube. 2013b. Global inference for bridging anaphora resolution. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 907–917. find our card
- Yufang Hou, Katja Markert, and Michael Strube. 2014. A rule-based system for unrestricted bridging resolution: Recognizing bridging anaphora and finding links to antecedents. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 2082–2093. find our card
- Yufang Hou, Katja Markert, and Michael Strube. 2018. Unrestricted bridging resolution. Computational Linguistics, 44(2):237–284. ↗ our card
- Yufang Hou. 2016. Incremental fine-grained information status classification using attention-based LSTMs. In Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers, pages 1880– 1890. find
- Yufang Hou. 2018a. A deterministic algorithm for bridging anaphora resolution. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1938–1948. find our card
- Yufang Hou. 2018b. Enhanced word representations for bridging anaphora resolution. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 1–7. find our card
- Yufang Hou. 2020. Bridging anaphora resolution as question answering. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1428–1438. find our card
- Mandar Joshi, Danqi Chen, Yinhan Liu, Daniel S Weld, Luke Zettlemoyer, and Omer Levy. 2020. SpanBERT: Improving pre-training by representing and predicting spans. Transactions of the Association for Computational Linguistics, 8:64–77. ↗ our card
- Ben Kantor and Amir Globerson. 2019. Coreference resolution with entity equalization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 673–677. find our card
- Iørn Korzen and Matthias Buch-kromann. 2011. Anaphoric relations in the Copenhagen Dependency Treebanks. In Proceedings of Beyond Semantics: Corpus-based Investigations of Pragmatic and Discourse Phenomena, pages 83–98. find
- Emmanuel Lassalle and Pascal Denis. 2011. Leveraging different meronym discovery methods for bridging resolution in French. In The 8th Discourse Anaphora and Anaphor Resolution Colloquium, pages 35–46. find
- Sebastian Löbner. 1998. Definite associative anaphora. http://user.phil-fak.uniduesseldorf. de/˜loebner/publ/DAA-03.pdf. ↗
- Katja Markert, Malvina Nissim, and Natalia N Modjeska. 2003. Using the Web for nominal anaphora resolution. In Proceedings of the EACL Workshop on the Computational Treatment of Anaphora, pages 39–46. find
- Katja Markert, Yufang Hou, and Michael Strube. 2012. Collective classification for fine-grained information status. In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers-Volume 1, pages 795–804. find our card
- André F. T. Martins. 2015. Transferring coreference resolvers with posterior regularization. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 1427–1437. find our card
- Natalia N. Modjeska, Katja Markert, and Malvina Nissim. 2003. Using the web in machine learning for other-anaphora resolution. In Proceedings of the 2003 Conference on Empirical Methods in Natural Language Processing, pages 176–183. find our card
- Natalia Nygren Modjeska. 2003. Resolving Other-Anaphora. Ph.D. thesis, University of Edinburgh. find
- Vincent Ng and Claire Cardie. 2002. Improving machine learning approaches to coreference resolution. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 104–111. find our card
- Malvina Nissim. 2006. Learning information status of discourse entities. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, pages 94–102. find
- Patrick Pantel and Marco Pennacchiotti. 2006. Espresso: Leveraging generic patterns for automatically harvesting semantic relations. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pages 113–120. find
- Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. GloVe: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 1532–1543. find
- Massimo Poesio and Ron Artstein. 2008. Anaphoric annotation in the ARRAU corpus. In Proceedings of the Sixth International Conference on Language Resources and Evaluation, pages 1170–1174. find our card
- Massimo Poesio and Renata Vieira. 1998. A corpus-based investigation of definite description use. Computational Linguistics, 24(2):183–216. ↗
- Massimo Poesio, Renata Vieira, and Simone Teufel. 1997. Resolving bridging references in unrestricted text. In Proceedings of the ACL/EACL Workshop on Operational Factors in Practical, Robust Anaphora Resolution for Unrestricted Texts. find our card
- Massimo Poesio, Tomonori Ishikawa, Sabine Schulte im Walde, and Renata Vieira. 2002. Acquiring lexical knowledge for anaphora resolution. In Proceedings of the Third International Conference on Language Resources and Evaluation. find our card
- Massimo Poesio, Rahul Mehta, Axel Maroudas, and Janet Hitzeman. 2004a. Learning to resolve bridging references. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, pages 143–150. find our card
- Massimo Poesio, Rosemary Stevenson, Barbara Di Eugenio, and Janet Hitzeman. 2004b. Centering: A parametric theory and its instantiations. Computational linguistics, 30(3):309–363. ↗
- Oana Postolache, Dan Cristea, and Constantin Orasan. 2006. Transferring coreference chains through word alignment. In Proceedings of the Fifth International Conference on Language Resources and Evaluation. find our card
- Sameer Pradhan, Lance Ramshaw, Mitchell Marcus, Martha Palmer, Ralph Weischedel, and Nianwen Xue. 2011. CoNLL-2011 shared task: Modeling unrestricted coreference in OntoNotes. In Proceedings of the Fifteenth Conference on Computational Natural Language Learning: Shared Task, pages 1–27. find our card
- Sameer Pradhan, Alessandro Moschitti, Nianwen Xue, Olga Uryupina, and Yuchen Zhang. 2012. CoNLL-2012 shared task: Modeling multilingual unrestricted coreference in OntoNotes. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning: Shared Task, pages 1–40. find our card
- Rashmi Prasad, Nikhil Dinesh, Alan Lee, Eleni Miltsakaki, Livio Robaldo, Aravind Joshi, and Bonnie Webber. 2008. The Penn discourse TreeBank 2.0. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC’08). ↗ our card
- Ellen Prince. 1981. Toward a taxonomy of given-new information. In P. Cole, editor, Radical Pragmatics, page 223–255. Academic Press, New York, N.Y. find
- Altaf Rahman and Vincent Ng. 2011. Learning the information status of noun phrases in spoken dialogues. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, pages 1069–1080. find
- Altaf Rahman and Vincent Ng. 2012a. Learning the fine-grained information status of discourse entities. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 798–807. find
- Altaf Rahman and Vincent Ng. 2012b. Translation-based projection for multilingual coreference resolution. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 720–730. find our card
- Marta Recasens, M Antònia Martı́, and Mariona Taulé. 2007. Where anaphora and coreference meet. annotation in the spanish cess-ece corpus. In Proceedings of Recent Advances in Natural Langage Processing, pages 504–509. find
- Kepa Joseba Rodrı́guez, Francesca Delogu, Yannick Versley, Egon W. Stemle, and Massimo Poesio. 2010. Anaphoric annotation of Wikipedia and blogs in the live memories corpus. In Proceedings of the Seventh International Conference on Language Resources and Evaluation, pages 157–163. find our card
- Anna Roitberg and Anna Nedoluzhko. 2016. Bridging corpus for russian in comparison with czech. In Proceedings of the Workshop on Coreference Resolution Beyond OntoNotes, pages 59–66. find our card
- Ina Rösiger, Maximilian Köper, Kim Anh Nguyen, and Sabine Schulte im Walde. 2018a. Integrating predictions from neural-network relation classifiers into coreference and bridging resolution. In Proceedings of the First Workshop on Computational Models of Reference, Anaphora and Coreference, pages 44–49. find our card
- Ina Rösiger, Arndt Riester, and Jonas Kuhn. 2018b. Bridging resolution: Task definition, corpus resources and rule-based experiments. In Proceedings of the 27th International Conference on Computational Linguistics, pages 3516–3528. find our card
- Ina Rösiger. 2016. SciCorp: A corpus of English scientific articles annotated for information status analysis. In Proceedings of the Tenth International Conference on Language Resources and Evaluation, pages 1743–1749. find our card
- Ina Rösiger. 2018a. BASHI: A corpus of wall street journal articles annotated with bridging links. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation. find our card
- Ina Rösiger. 2018b. Rule-and learning-based methods for bridging resolution in the arrau corpus. In Proceedings of the First Workshop on Computational Models of Reference, Anaphora and Coreference, pages 23–33. find our card
- Ryohei Sasano and Sadao Kurohashi. 2009. A probabilistic model for associative anaphora resolution. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3, pages 1455–1464. find our card
- Katrin Schweitzer, Kerstin Eckart, Markus Gärtner, Agnieszka Falenska, Arndt Riester, Ina Rösiger, Antje Schweitzer, Sabrina Stehwien, and Jonas Kuhn. 2018. German radio interviews: The grain release of the sfb732 silver standard collection. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation. find
- Wee Meng Soon, Hwee Tou Ng, and Daniel Chung Yong Lim. 2001. A machine learning approach to coreference resolution of noun phrases. Computational linguistics, 27(4):521–544. ↗ our card
- Olga Uryupina, Ron Artstein, Antonella Bristot, Federica Cavicchio, Francesca Delogu, Kepa J Rodriguez, and Massimo Poesio. 2020. Annotating a broad range of anaphoric phenomena, in a variety of genres: The ARRAU corpus. Natural Language Engineering, 26(1):95–128. ↗
- Renata Vieira and Massimo Poesio. 2000. An empirically based system for processing definite descriptions. Computational Linguistics, 26(4):539–593. ↗
- Renata Vieira and Simone Teufel. 1997. Towards resolution of bridging descriptions. In Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and the 8th Conference of the European Chapter of the Association for Computational Linguistics, pages 522–524. find our card
- David Yarowsky, Grace Ngai, and Richard Wicentowski. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of the First International Conference on Human Language Technology Research. find
- Juntao Yu and Massimo Poesio. 2020. arXiv:2003.03666 [cs.CL]. Multi-task learning based neural bridging reference resolution. ↗
- Amir Zeldes. 2017. The GUM corpus: Creating multilayer resources in the classroom. Language Resources and Evaluation, 51(3):581–612. ↗