Elamur Research⌕
☰
home / papers / 2018 / ParCorFull: a Parallel Corpus Annotated with Full Coreference

ParCorFull: a Parallel Corpus Annotated with Full Coreference

Summary

Machine translation and other multilingual NLP systems struggle to carry coreference correctly from one language into another. Earlier work on this problem, including shared tasks, test suites and annotated data, has looked almost only at anaphoric pronouns. The authors argue that this focus is too narrow. Even closely related languages like English and German differ systematically in how they express reference, for example through gender-marked adjectives, nominal ellipsis, demonstratives, or pronominal adverbs such as German dagegen.

To support research beyond pronouns, they built ParCorFull, an English-German parallel corpus that extends ParCor with annotation of complete coreference chains. Their guidelines combine ideas from three earlier multilingual schemes. They cover:

  • entity and event antecedents, including split and implicit ones;
  • pronominal and nominal anaphors;
  • type-reference phenomena such as substitution, ellipsis and comparative reference.

Previously available English-German resources were limited to source-side annotation, covered only pronouns, or were very small. The new corpus fills this gap for MT developers, cross-lingual coreference resolution, contrastive linguistics and translation studies.

Key points

  • Availability: ParCorFull is distributed through the LINDAT repository (hdl.handle.net/11372/LRT-2614). It covers English-German and builds on the ParCor corpus.
  • Annotation guidelines: They draw on Kunz (2012, GECCo), Guillou et al. (2014, ParCor) and Grishina & Stede (2016).
  • Markables and anaphors:
    • Markables include pronouns, nouns, NPs and elliptical constructions, plus VPs and clauses serving as event antecedents.
    • Anaphors include personal, demonstrative, relative and reflexive pronouns. Pronominal adverbs are treated as demonstratives.
    • Nominal anaphors include proper names, nominal premodifiers, definite NPs and quantified NPs.
    • Generic nouns may not corefer with other generic nouns.
  • Pronominal adverbs: According to GECCo data, they make up about 8% of German referring expressions, yet most other schemes ignore them.
  • Earlier English-German resources and their limits:
    • GECCo annotates source texts only and has partial access restrictions.
    • ParCor annotates only pairwise pronoun–antecedent links.
    • The Grishina & Stede corpus has full chains but only about 11,000 words per language.
    • Corpus size and agreement figures for ParCorFull were not included in the excerpt provided.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Linguistics & languages

Topics: Coreference resolution

Cited by

39 papers of our library cite it (of the 140673 whose bibliographies we read); 13 of them have a page here, 26 not yet.

Cite

The paper itself, not this page. BibTeX from the library's record of the work.

@inproceedings{lapshinovakoltunski2018parcorfull,
  title = {{ParCorFull: a Parallel Corpus Annotated with Full Coreference}},
  author = {Lapshinova-Koltunski, Ekaterina and Hardmeier, Christian and Krielke, Pauline},
  booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},
  year = {2018},
  url = {https://aclanthology.org/L18-1065/}
}

References

29 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Bawden, R., Sennrich, R., Birch, A., and Haddow, B. (2017). Evaluating discourse phenomena in neural machine translation. ArXiv e-prints, 1711.00513. find our card
  2. Bojar, O., Chatterjee, R., Federmann, C., Graham, Y., Haddow, B., Huang, S., Huck, M., Koehn, P., Liu, Q., Logacheva, V., Monz, C., Negri, M., Post, M., Rubino, R., Specia, L., and Turchi, M. (2017). Findings of the 2017 conference on machine translation (wmt17). In Proceedings of the Second Confere… find our card
  3. De Beaugrande, R.-A. and Dressler, W. U. (1981). Einführung in die Textlinguistik. Niemeyer, Tübingen. find
  4. Green, S., Andrews, N., Gormley, M. R., Dredze, M., and Manning, C. D. (2011). Cross-lingual coreference resolution: A new task for multilingual comparable corpora. Technical Report 6, HLTCOE, Johns Hopkins University. find
  5. Grishina, Y. and Stede, M., (2016). Parallel coreference annotation guidelines. find
  6. Grishina, Y. (2017). Combining the output of two coreference resolution systems for two source languages to improve annotation projection. In Proceedings of the Third Workshop on Discourse in Machine Translation (DiscoMT), EMNLP 2017, Copenhagen, Denmark. find
  7. Guillou, L. and Hardmeier, C. (2016). PROTEST: A test suite for evaluating pronouns in machine translation. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), pages 636–643, Portorož, Slovenia. European Language Resources Association (ELRA). find
  8. Guillou, L. and Webber, B. (2015). Analysing ParCor and its translations by state-of-the-art SMT systems. In Proceedings of the Second Workshop on Discourse in Machine Translation (DiscoMT), EMNLP 2015, Lisbon, Portugal. find
  9. Guillou, L., Hardmeier, C., Smith, A., Tiedemann, J., and Webber, B., (2014). ParCor 1.0: Pronoun Coreference Annotation Guidelines. find
  10. Edinburgh, Uppsala. Guillou, L., Hardmeier, C., Nakov, P., Stymne, S., Tiedemann, J., Versley, Y., Cettolo, M., Webber, B., and Popescu-Belis, A. (2016). Findings of the 2016 WMT shared task on cross-lingual pronoun prediction. In Proceedings of the First Conference on Machine Translation (WMT16), B… find
  11. Guillou, L. (2016). Incorporating Pronoun Function into Statistical Machine Translation. Ph.D. thesis, School of Informatics. University of Edinburgh. find
  12. Hardmeier, C. and Federico, M. (2010). Modelling pronominal anaphora in statistical machine translation. In Proceedings of the IWSLT (International Workshop on Spoken Language Translation), pages 283–289, Paris, France. find our card
  13. Hardmeier, C., P., Nakov, S., Stymne, J., Tiedemann, Y., Versley, and Cettolo, M. (2015). Pronoun-focused MT and cross-lingual pronoun prediction: Findings of the 2015 DiscoMT shared task on pronoun translation. In Proceedings of the Second Workshop on Discourse in Machine Translation (DiscoMT), EMN… find
  14. Springer, Berlin, Heidelberg. Kunz, K. and Lapshinova-Koltunski, E. (2015). Cross-linguistic analysis of discourse variation across registers. Special Issue of Nordic Journal of English Studies, 14(1):258–288. find
  15. Kunz, K. and Steiner, E. (2012). Towards a comparison of cohesive reference in English and German: System and text. In M. Taboada, et al., editors, Contrastive Discourse Analysis. find
  16. Functional and Corpus Perspectives. Equinox, London. Kunz, K. and Steiner, E. (2013). Cohesive substitution in English and German: A contrastive and corpus-based perspectivet. In Karin Aijmer et al., editors, Advances in Corpus-Based Contrastive Linguistics. Studies in honour of Stig Johansson, page… find
  17. John Benjamins, Amsterdam. Kunz, K., (2012). Richtlinien für die Korrektur von kohäsiven Referenzmitteln. find
  18. Lapshinova-Koltunski, E. and Hardmeier, C., (2017). find
  19. Coreference Corpus Annotation Guidelines, December. Lee, H., Recasens, M., Chang, A., Surdeanu, M., and Jurafsky, D. (2012). Joint entity and event coreference resolution across documents. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computation… find our card
  20. Luo, X. (2005). On coreference resolution performance metrics. In Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing, pages 25–32, Vancouver, British Columbia, Canada. find our card
  21. Menzel, K. (2017). Understanding English-German contrasts: a corpus-based comparative analysis of ellipses as cohesive devices. Ph.D. thesis, Universität des Saarlandes, Saarbrücken. find
  22. Morton, T. S. (1999). Using coreference for question answering. In Proceedings of the Workshop on Coreference and its Applications, CorefApp-99, pages 85–89, College Park, Maryland. Novák, M. and Nedoluzhko, A. (2015). Correspondences between Czech and English coreferential expressions. Discours, 1… find our card
  23. Novák, M. and Žabokrtský, Z. (2014). Cross-lingual coreference resolution of pronouns. In Proceedings of COL-ING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 14–24, Dublin, Ireland. Novák, M., Žabokrtský, Z., and Nedoluzhko, A. (2013). Two case… find our card
  24. Pradhan, S., Luo, X., Recasens, M., Hovy, E., Ng, V., and Strube, M. (2014). Scoring coreference partitions of predicted mentions: A reference implementation. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 30–35, Baltimore,… find our card
  25. Zelenko, D., Aone, C., and Tibbetts, J. (2004). Coreference resolution for information extraction. In Proceedings of the Conference on Reference Resolution and Its Applications. 10. find our card
  26. Language Resource References Grishina, Y. and Stede, M. (2015). Knowledge-lean projection of coreference chains across languages. In Proceedings of the 8th Workshop on Building and Using Comparable Corpora, page 14, Beijing, China. find our card
  27. Guillou, L., Hardmeier, C., Smith, A., Tiedemann, J., and Webber, B. (2014). ParCor 1.0: A parallel pronoun-coreference corpus to support statistical MT. In Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC-2014), Reykjavik, Iceland. find our card
  28. Lapshinova-Koltunski, E. and Kunz, K. (2014). Annotating cohesion for multillingual analysis. In Proceedings of the 10th Joint ACL - ISO Workshop on Interoperable Semantic Annotation, pages 57–64, Reykjavik, Iceland. find
  29. Poesio, M. and Artstein, R. (2008). Anaphoric annotation in the ARRAU corpus. In Bente Maegaard Joseph Mariani Jan Odijk Stelios Piperidis Daniel Tapias Nicoletta Calzolari (Conference Chair), Khalid Choukri, editor, Proceedings of the Sixth International Conference on Language Resources and Evaluat… find our card

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/papers/koltunski-2018-parcorfull-parallel-corpus-annotated-full/