Elamur Research⌕
☰
home / papers / 2018 / SACR: A Drag-and-Drop Based Tool for Coreference Annotation

SACR: A Drag-and-Drop Based Tool for Coreference Annotation

Summary

Manual coreference annotation demands a great deal of time and annotator effort, so French has few corpora large enough for supervised learning. The only sizable one, ANCOR, contains spoken data alone. The Democrat project aims to build a much larger annotated written corpus, and the author presents SACR, a browser tool designed specifically for annotating coreference chains. The paper first compares how existing tools (Glozz, Analec, MMAX2, BRAT, GATE, TXM) model coreference, either as pairwise links or as sets/schemata. It argues that attaching a referent name to every mention is quicker than building chains explicitly, because chains can then be derived automatically. It then reviews ergonomic problems: retyping names, lack of word-level tokenization, weak display of nested mentions, and difficulty keeping track of referents. SACR responds to these: users mark a mention by clicking its first and last tokens, link mentions by dragging one onto another, and see colored frames around annotations. Because it needs no installation, it suits students and non-technical annotators. The main contribution is a practical, openly licensed annotation resource rather than a new model.

Key points

  • ANCOR, the reference French corpus, has 488,000 lexical units, 116,000 referring expressions and 51,300 relations, all from spoken French. Democrat targets about 1 million words and 100,000 chain elements.
  • The recommended scheme stores a referent name as a feature on each mention, and chains are computed from matching names. Democrat uses this approach, currently in TXM with the Analec extension.
  • SACR is a single-page HTML/CSS/JavaScript application for Firefox and Chromium/Chrome. It can be used online or downloaded for offline work, and is released under the Mozilla Public License 2.0.
  • The tool has deliberate limitations: mentions may be nested but not overlapping, and chains are treated as sets, so individual relations cannot carry their own features.
  • The work was funded by the French ANR through Democrat (ANR-15-CE38-0008), and SACR is available at boberle.com/projects/sacr.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Linguistics & languages

Topics: Coreference resolution

Cite

The paper itself, not this page. BibTeX from the library's record of the work.

@inproceedings{oberle2018sacr,
  title = {{SACR: A Drag-and-Drop Based Tool for Coreference Annotation}},
  author = {Oberle, Bruno},
  booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},
  year = {2018},
  doi = {10.63317/3cghguv9ewe7},
  url = {https://doi.org/10.63317/3cghguv9ewe7}
}

References

19 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. (2014). BRAT: Brat Rapid Annotation Tool. http://brat.nlplab.org. ↗
  2. Cunningham, H., Maynard, D., Bontcheva, K., Tablan, V., Aswani, N., Roberts, I., Gorrell, G., Funk, A., Roberts, A., Damljanovic, D., Heitz, T., Greenwood, M. A., Saggion, H., Petrak, J., Li, Y., and Peters, W. (2011). Text Processing with GATE (Version 6). find
  3. Cunningham, H., Tablan, V., Roberts, A., and Bontcheva, K. (2013). Getting more out of biomedical documents with gate’s full lifecycle open source text analytics. PLOS Computational Biology, 9(2):1–16. find
  4. Felt, P., Merkling, O., Carmen, M., Ringger, E., Lemmon, W., Seppi, K., and Haertel, R. (2010). CCASH: A web application framework for efficient, distributed language resource development. In Nicoletta Calzolari (Conference Chair), et al., editors, Proceedings of the Seventh International Conference… find our card
  5. Fort, K. (2012). Les ressources annotées, un enjeu pour l’analyse de contenu: vers une méthodologie de l’annotation manuelle de corpus. Ph.D. thesis, Paris 13. find
  6. Habert, B. (2005). Portrait de linguiste(s) à l’instrument. Texto!, 10(4). find
  7. Heiden, S. (2010). The TXM Platform: Building Open-Source Textual Analysis Software Compatible with the TEI Encoding Scheme. In Ryo Otoguro, et al., editors, 24th Pacific Asia Conference on Language, Information and Computation, pages 389–398, Sendai, Japan. Institute for Digital Enhancement of Cogn… find
  8. Landragin, F., Poibeau, T., and Victorri, B. (2012). Analec: a new tool for the dynamic annotation of textual data. In Nicoletta Calzolari (Conference Chair), et al., editors, Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), Istanbul, Turkey. European… find
  9. Landragin, F., Potier, J., and Bothua, M. (2017). Annotation manuelle d’expressions référentielles: expérimenta-tions pour simplifier les prises de décisions et optimiser le processus. In 9èmes Journées Internationales de la Linguistique de Corpus (JLC 2017), Grenoble, France. find
  10. Landragin, F. (2011). Une procédure d’analyse et d’annotation des chaînes de coréférence dans des textes écrits. Corpus, 10:61–80. find
  11. Mélanie-Becquet, F. and Landragin, F. (2014). Linguistique outillée pour l’étude des chaînes de référence: questions méthodologiques et solutions techniques. Langages, 195. find
  12. Müller, C. and Strube, M. (2006). Multi-level annotation of linguistic data with MMAX2. In Sabine Braun, et al., editors, Corpus Technology and Language Pedagogy: New Resources, New Tools, New Methods, pages 197–214. Peter Lang, Frankfurt a. M., Germany. find
  13. Muzerelle, J., Lefeuvre, A., Schang, E., Antoine, J.-Y., Pelletier, A., Maurel, D., Eshkol, I., and Villaneau, J. (2014). ANCOR Centre, a large free spoken french coreference corpus: Description of the resource and reliability measures. In Nicoletta Calzolari (Conference Chair), et al., editors, Pro… find our card
  14. O’Donnell, M. (2008). Demonstration of the UAM CorpusTool for text and image annotation. In Proceedings of the 46th annual meeting of the Association for Computational Linguistics on human language technologies: Demo session, pages 13–16. Association for Computational Linguistics. find
  15. Poudat, C. and Landragin, F. (2017). Explorer un corpus textuel. Champs linguistiques. find
  16. De Boeck. Schmid, H. (1994). Probabilistic part-of-speech tagging using decision trees. In Proceedings of International Conference on New Methods in Language Processing. find
  17. Schmid, H. (1995). Improvements in part-of-speech tagging with an application to german. In Proceedings of the ACL SIGDAT-Workshop. Stenetorp, P., Pyysalo, S., Topić, G., Ohta, T., Ananiadou, S., and Tsujii, J. (2012). BRAT: a web-based tool for NLP-assisted text annotation. In Proceedings of the D… find
  18. Tellier, I., Duchier, D., Eshkol, I., Courmet, A., and Martinet, M. (2012). Apprentissage automatique d’un chunker pour le français. In Gilles Sérasset Georges Antoniadis, Hervé Blanchon, editor, TALN2012, volume 2 of Actes de la conférence conjointe JEP-TALN-RECITAL 2012, pages 431–438, Grenoble, F… find
  19. Widlöcher, A. and Mathet, Y. (2012). The glozz platform: A corpus annotation and mining tool. In Proceedings of the 2012 ACM symposium on Document engineering, pages 171–180. ACM. find

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/oberle-2018-sacr-drag-drop-based-tool/