Elamur Research⌕
☰
home / papers / 2010 / Anaphoric Annotation of Wikipedia and Blogs in the Live Memories Corpus

Anaphoric Annotation of Wikipedia and Blogs in the Live Memories Corpus

Summary

Italian has few corpora annotated for anaphora. Social Web text such as Wikipedia articles and blog comments also lacks annotated data for training entity and coreference systems, and earlier work showed that resolvers trained on news perform much worse on user comments. The authors address both gaps with the Live Memories Corpus (LMC). It contains Italian Wikipedia articles and Creative Commons–licensed blog posts with user comments, all about the Trentino/Südtirol region, and newspaper text from l'Adige is planned. Web pages are cleaned with KrdWrd. NP markables are extracted automatically using TextPro and the MALT parser trained on the TUT treebank, then annotated by hand in MMAX2. The scheme adapts ARRAU and borrows from VENEX. It covers agreement, information status, semantic class, discourse deixis, bridging and ambiguous antecedents. It also handles Italian-specific cases: empty subjects, clitics attached to verbs, and discontinuous coordination markables. Agreement between two annotators reaches Kappa 0.79–0.93, which suggests the scheme is reliable and reusable. The Wikipedia portion is used in the SemEval 2010 multilingual coreference task.

Key points

  • The Wikipedia dataset has 144 files (about 142K words) and 44.5K markables. Of these markables, 57.8% are discourse-new, 28.5% discourse-old and 13.7% non-referring. The target size is about 150,000 words per genre.
  • Empty subjects make up about 4.5% of anaphoric expressions in the Wikipedia data, and every one is linked to an antecedent.
  • Inter-annotator agreement (Kappa) was:
    • information status: 0.80
    • basic markable annotation: 0.79
    • semantic type: 0.85
    • antecedent links: 0.88
    • clitic antecedents: 0.84
    • empty-pronoun antecedents: 0.93
  • The blog data differs from Wikipedia in several ways:
    • Predicates make up only about 25% of its non-referring expressions.
    • Idioms are about three times as frequent.
    • Expletives and clitics are more common.
  • The corpus will be released in MMAX2 stand-off format and in a CoNLL-style tabular format, under a Creative Commons Attribution license.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Linguistics & languages

Topics: Discourse analysis · Coreference resolution

Cited by

18 papers of our library cite it (of the 140673 whose bibliographies we read); 6 of them have a page here, 12 not yet.

Cite

The paper itself, not this page. BibTeX from the library's record of the work.

@inproceedings{rodriguez2010anaphoric,
  title = {{Anaphoric Annotation of Wikipedia and Blogs in the Live Memories Corpus}},
  author = {Rodríguez, Kepa Joseba and Delogu, Francesca and Versley, Yannick and Stemle, Egon W. and Poesio, Massimo},
  booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)},
  year = {2010},
  doi = {10.63317/4hbf54ijjdr9},
  url = {https://doi.org/10.63317/4hbf54ijjdr9}
}

References

20 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. A. Balahur, E. Boldrini, A. Montoyo, and P. Martı́nez-Barco. 2009a. Opinion and generic question answering systems: a performance analysis. In ACL-IJCNLP ’09: Proceedings of the ACL-IJCNLP 2009 Conference Short Papers, pages 157–160, Morristown, NJ, USA. Association for Computational Linguistics. find
  2. A. Balahur, E. Lloret, E. Boldrini, A. Montoyo, M. Palomar, and P. Martinez-Barco. 2009b. Summarizing threads in blogs using opinion polarity. In Constantin Orăsan, Laura Hasler, and Corina Forascu, editors, Proceedings of the International Workshop on Events in Emerging Text Types (eETTs), pages 5… find
  3. P. Bo and L. Lee. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrival, 2(1 & 2):1 – 135. find
  4. Ester Boldrini, Alexandra Balahur, Patricio Martnez-Barco, and Andrs Montoyo. 2009. Emotiblog: an annotation scheme for emotion detection and analysis in non-traditional textual genres. In Robert Stahlbock, Sven F. Crone, and Stefan Lessmann, editors, DMIN, pages 491– 497. CSREA Press. find
  5. C. Bosco, V. Lombardo, D. Vassallo, and L. Lesmo. 2000. Building a treebank for italian: a data-driven annotation scheme. In Proceedings of the LREC-00, Athens. Greece. find
  6. Jean Carletta. 1996. Assessing agreement on classification tasks: The kappa statistic. Computational Linguistics, 22:249–254. find our card
  7. I. Hendrickx and V. Hoste. 2009. Coreference resolution on blogs and commented news. In DAARC ’09: Proceedings of the 7th Discourse Anaphora and Anaphor Resolution Colloquium on Anaphora Processing and Applications, pages 43–53, Berlin, Heidelberg. Springer-Verlag. find
  8. D.J. Hopkins and G. King. 2010. A method of automated nonparametric contente analysis for social science. American Journal of Political Science, 54(1):229 – 247. find
  9. Linguistic Data Consortium LDC, 2004. ACE (Automatic Content Extraction) English Annotation Guidelines for Entities, version 5.6.1. find
  10. B. Magnini and M. Poesio. 2009. Content extraction meets the social web in the livememories project. In Proceedings of the AT4DL. find
  11. B. Magnini, E. Pianta, Ch. Girardi, M. Negri, L. Romano, M. Speranza, and R. Sprugnoli. 2006. I-cab: the italian content annotation bank. In Proceedings of the LREC-06, Genova, Italia. find
  12. R. Mihalcea. 2007. Using wikipedia for automatic word sense disambiguation. In Proceedings of the NAACL. find
  13. Ch. Müller and M. Strube. 2006. Multi-level annotation of linguistic data with mmax2. In S. Braun, K. Kohn, and J. Mukherjee, editors, Corpus Technology and Language Pedagogy: New Resources, New Tools, New Methods. Peter Lang, Frankfurt a. M., Germany. find
  14. N. Nicolov, F. Salvetti, and S. Ivanova. 2008. Sentiment analysis: Does coreference matter? In Proceedings of the Symposium on Affective Lenguage in Human and Machine, Aberden. UK. find
  15. J. Nivre, J. Hall, J. Nilsson, A. Chanev, G. Eryigit, S. Kbler, S. Marinov, and E. Marsi. 2007. Maltparser: A language-independent system for data-driven dependency parsing. Natural Language Engineering, 2(13). find
  16. E. Pianta, Ch. Girardi, and R. Zanoli. 2008. The textpro tool suite. In Proceedings of LREC-08. find
  17. M. Poesio and R. Artstein. 2008. Anaphoric annotation in the arrau corpus. In Proceedings of LREC-08, Marrakech, Marocco. find our card
  18. M. Poesio, R. Delmonte, A. Bristot, L. Chiran, and S. Tonelli. 2004. The venex corpus of anaphora and deixis in spoken and written italian. Manuscript. find
  19. S. Ponzetto and M. Strube. 2007. Knowledge derived from wikipedia for computing semantic relatedness. Journal of Artificial Intelligence Research, 30. find
  20. J. M. Steger and E. W. Stemle. 2009. The architecture for unified processing of web content. In Proceedings of the Fifth Web as Corpus Workshop (WAC5), Donostia-San Sebastian. Basque Country. find

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/papers/rodriguez-2010-anaphoric-annotation-wikipedia-blogs-live/