Elamur Research⌕
☰
home / papers / 2014 / A Joint Model for Entity Analysis: Coreference, Typing, and Linking

A Joint Model for Entity Analysis: Coreference, Typing, and Linking

Summary

Durrett and Klein address three closely linked parts of entity analysis that are usually solved separately or in a fixed pipeline: coreference resolution, coarse semantic typing (NER), and entity linking to Wikipedia. Their argument is that each task can fix the others' mistakes, so no pipeline order is ideal. For example, a nearby "the company" signals that "Dell" means the firm rather than the person.

They build a single structured conditional random field with one antecedent, type, and link variable per mention, plus latent Wikipedia query variables. Unary factors carry features from strong standalone baselines. Binary and ternary factors softly reward consistency across tasks, such as coreferent mentions sharing a type, and map NER types to Wikipedia infoboxes, categories, and article text. Exact inference is intractable, so they use belief propagation after pruning variable domains with a coarse model.

On ACE 2005 and OntoNotes, the joint model beats its independent baselines on every task and reaches state-of-the-art results. This shows that joint modeling can stay modular and efficient.

Key points

  • Evaluation covers two corpora with different mention standards and annotation layers: ACE 2005 and OntoNotes 5.0 (CoNLL 2011/2012 splits).
  • On the OntoNotes / CoNLL 2011 test set, NER F1 reaches 84.04. This compares with 82.64 for the independent model (+1.40), 83.45 for the Illinois system, and 82.24 for Passos et al. (2014). The joint model has higher precision, while Illinois has higher recall.
  • On ACE, entity linking matches Fahrni and Strube (2014). On OntoNotes, coreference is on par with Björkelund and Kuhn (2014), the best published system.
  • Ablations show that removing any pairwise cross-task interaction hurts at least one task. The joint system runs only about twice as slow as the three separate models combined.
  • The code is released as the Berkeley Entity Resolution System (nlp.cs.berkeley.edu). The paper appeared in TACL, vol. 2, 2014.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Linguistics & languages

Topics: Named entity recognition · Coreference resolution

Cited by

95 papers of our library cite it (of the 140673 whose bibliographies we read); 19 of them have a page here, 76 not yet.

Cite

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.1162/tacl_a_00197

@article{durrett2014joint,
  title = {{A Joint Model for Entity Analysis: Coreference, Typing, and Linking}},
  author = {Durrett, Greg and Klein, Dan},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2014},
  doi = {10.1162/tacl\_a\_00197},
  url = {https://doi.org/10.1162/tacl_a_00197}
}

References

59 references, 31 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Amit Bagga and Breck Baldwin. 1998. Algorithms for Scoring Coreference Chains. In Proceedings of the Conference on Language Resources and Evaluation Workshop on Linguistics Coreference. find our card
  2. Mohit Bansal and Dan Klein. 2012. Coreference Semantics from Web Features. In Proceedings of the Association for Computational Linguistics. find our card
  3. Luisa Bentivogli, Pamela Forner, Claudio Giuliano, Alessandro Marchetti, Emanuele Pianta, and Kateryna Tymoshenko. 2010. find
  4. Extending English ACE 2005 Corpus Annotation with Ground-truth Links to Wikipedia. In Proceedings of the Workshop on The People’s Web Meets NLP: Collaboratively Constructed Semantic Resources. find
  5. Anders Björkelund and Jonas Kuhn. 2014. Learning Structured Perceptrons for Coreference Resolution with Latent Antecedents and Non-local Features. In Proceedings of the Association for Computational Linguistics. find our card
  6. David Burkett and Dan Klein. 2012. Fast Inference in Phrase Extraction Models with Belief Propagation. In Proceedings of the North American Chapter of the Association for Computational Linguistics. find
  7. Kai-Wei Chang, Rajhans Samdani, and Dan Roth. 2013. A Constrained Latent Variable Model for Coreference Resolution. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find our card
  8. Xiao Cheng and Dan Roth. 2013. Relational Inference for Wikification. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find
  9. Silviu Cucerzan. 2007. Large-Scale Named Entity Disambiguation Based on Wikipedia Data. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL). find
  10. Hal Daumé, III and Daniel Marcu. 2005. A Large-scale Exploration of Effective Global Features for a Joint Entity Detection and Tracking Model. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find
  11. Pascal Denis and Jason Baldridge. 2008. Specialized Models and Ranking for Coreference Resolution. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find our card
  12. Mark Dredze, Paul McNamee, Delip Rao, Adam Gerber, and Tim Finin. 2010. Entity Disambiguation for Knowledge Base Population. In Proceedings of the International Conference on Computational Linguistics. find
  13. John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research, 12:2121–2159, July. find
  14. Greg Durrett and Dan Klein. 2013. Easy Victories and Uphill Battles in Coreference Resolution. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, October. find our card
  15. Greg Durrett, David Hall, and Dan Klein. 2013. Decentralized Entity-Level Modeling for Coreference Resolution. In Proceedings of the Association for Computational Linguistics. find our card
  16. Angela Fahrni and Michael Strube. 2014. A Latent Variable Model for Discourse-aware Concept and Entity Disambiguation. In Proceedings of the European Chapter of the Association for Computational Linguistics. find
  17. Eraldo Rezende Fernandes, Cı́cero Nogueira dos Santos, and Ruy Luiz Milidiú. 2012. Latent Structure Perceptron with Feature Induction for Unrestricted Coreference Resolution. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Proceedings and Conference on Computational… find our card
  18. Jenny Rose Finkel and Christopher D. Manning. 2009. Joint Parsing and Named Entity Recognition. In Proceedings of the North American Chapter for the Association for Computational Linguistics. find
  19. Jenny Rose Finkel, Trond Grenager, and Christopher Manning. 2005. Incorporating Non-local Information into Information Extraction Systems by Gibbs Sampling. In Proceedings of the Association for Computational Linguistics. find
  20. Kevin Gimpel and Noah A. Smith. 2010. Softmax-Margin CRFs: Training Log-Linear Models with Cost Functions. In Proceedings of the North American Chapter for the Association for Computational Linguistics. find
  21. Yuhang Guo, Bing Qin, Yuqin Li, Ting Liu, and Sheng Li Li. 2013. Improving Candidate Generation for Entity Linking. In Natural Language Processing and Information Systems. find
  22. Ben Hachey, Will Radford, Joel Nothman, Matthew Honnibal, and James R. Curran. 2013. Evaluating Entity Linking with Wikipedia. Artificial Intelligence, 194:130–150, January. find
  23. Aria Haghighi and Dan Klein. 2009. Simple Coreference Resolution with Rich Syntactic and Semantic Features. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find our card
  24. Aria Haghighi and Dan Klein. 2010. Coreference Resolution in a Modular, Entity-Centered Model. In Proceedings of the North American Chapter of the Association for Computational Linguistics. find our card
  25. Hannaneh Hajishirzi, Leila Zilles, Daniel S. Weld, and Luke Zettlemoyer. 2013. Joint Coreference Resolution and Named-Entity Linking with Multi-Pass Sieves. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find our card
  26. Johannes Hoffart, Mohamed Amir Yosef, Ilaria Bordino, Hagen Fürstenau, Manfred Pinkal, Marc Spaniol, Bilyana Taneva, Stefan Thater, and Gerhard Weikum. 2011. Robust Disambiguation of Named Entities in Text. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find
  27. Eduard Hovy, Mitchell Marcus, Martha Palmer, Lance Ramshaw, and Ralph Weischedel. 2006. OntoNotes: The 90% Solution. In Proceedings of the North American Chapter of the Association for Computational Linguistics: Short Papers. find
  28. Heng Ji and Ralph Grishman. 2011. Knowledge Base Population: Successful Approaches and Challenges. In Proceedings of the Association for Computational Linguistics. find
  29. Jun’ichi Kazama and Kentaro Torisawa. 2007. Exploiting Wikipedia as External Knowledge for Named Entity Recognition. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. find
  30. Terry Koo, Xavier Carreras, and Michael Collins. 2008. Simple Semi-supervised Dependency Parsing. In Proceedings of the Association for Computational Linguistics. find our card
  31. John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the International Conference on Machine Learning. find
  32. Heeyoung Lee, Yves Peirsman, Angel Chang, Nathanael Chambers, Mihai Surdeanu, and Dan Jurafsky. 2011. Stanford’s Multi-Pass Sieve Coreference Resolution System at the CoNLL-2011 Shared Task. In Proceedings of the Conference on Computational Natural Language Learning: Shared Task. find our card
  33. Qi Li and Heng Ji. 2014. Incremental Joint Extraction of Entity Mentions and Relations. In Proceedings of the Association for Computational Linguistics. find
  34. Xiaoqiang Luo. 2005. On Coreference Resolution Performance Metrics. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find our card
  35. David Milne and Ian H. Witten. 2008. Learning to Link with Wikipedia. In Proceedings of the Conference on Information and Knowledge Management. find
  36. Vincent Ng. 2010. Supervised Noun Phrase Coreference Research: The First Fifteen Years. In Proceedings of the Association for Computational Linguistics. find our card
  37. NIST. 2005. The ACE 2005 Evaluation Plan. In NIST. find
  38. Joel Nothman, Nicky Ringland, Will Radford, Tara Murphy, and James R. Curran. 2013. Learning Multilingual Named Entity Recognition from Wikipedia. Artificial Intelligence, 194:151–175, January. find
  39. Alexandre Passos, Vineet Kumar, and Andrew McCallum. 2014. Lexicon Infused Phrase Embeddings for Named Entity Resolution. In Proceedings of the Conference on Computational Natural Language Learning. find our card
  40. Slav Petrov, Leon Barrett, Romain Thibaux, and Dan Klein. 2006. Learning Accurate, Compact, and Interpretable Tree Annotation. In Proceedings of the Conference on Computational Linguistics and the Association for Computational Linguistics. find our card
  41. Simone Paolo Ponzetto and Michael Strube. 2006. Exploiting Semantic Role Labeling, WordNet and Wikipedia for Coreference Resolution. In Proceedings of the North American Chapter of the Association of Computational Linguistics. find our card
  42. Sameer Pradhan, Lance Ramshaw, Mitchell Marcus, Martha Palmer, Ralph Weischedel, and Nianwen Xue. 2011. CoNLL-2011 Shared Task: Modeling Unrestricted Coreference in OntoNotes. In Proceedings of the Conference on Computational Natural Language Learning: Shared Task. find our card
  43. Sameer Pradhan, Alessandro Moschitti, Nianwen Xue, Olga Uryupina, and Yuchen Zhang. 2012. CoNLL-2012 Shared Task: Modeling Multilingual Unrestricted Coreference in OntoNotes. In Joint Conference on EMNLP and CoNLL - Shared Task. find our card
  44. Sameer Pradhan, Xiaoqiang Luo, Marta Recasens, Eduard Hovy, Vincent Ng, and Michael Strube. 2014. Scoring Coreference Partitions of Predicted Mentions: A Reference Implementation. In Proceedings of the Association for Computational Linguistics. find our card
  45. Karthik Raghunathan, Heeyoung Lee, Sudarshan Rangarajan, Nathanael Chambers, Mihai Surdeanu, Dan Jurafsky, and Christopher Manning. 2010. A Multi-Pass Sieve for Coreference Resolution. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find our card
  46. Altaf Rahman and Vincent Ng. 2011. Coreference Resolution with World Knowledge. In Proceedings of the Association for Computational Linguistics: Human Language Technologies. find our card
  47. Lev Ratinov and Dan Roth. 2009. Design Challenges and Misconceptions in Named Entity Recognition. In Proceedings of the Conference on Computational Natural Language Learning. find our card
  48. Lev Ratinov and Dan Roth. 2012. Learning-based Multi-sieve Co-reference Resolution with Knowledge. In Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. find our card
  49. Lev Ratinov, Dan Roth, Doug Downey, and Mike Anderson. 2011. Local and Global Algorithms for Disambiguation to Wikipedia. In Proceedings of the Association for Computational Linguistics. find
  50. Avirup Sil and Alexander Yates. 2013. Re-ranking for Joint Named-Entity Recognition and Linking. In Proceedings of the International Conference on Information and Knowledge Management. find
  51. Sameer Singh, Sebastian Riedel, Brian Martin, Jiaping Zheng, and Andrew McCallum. 2013. Joint Inference of Entities, Relations, and Coreference. In Proceedings of the 2013 Workshop on Automated Knowledge Base Construction. find
  52. David A. Smith and Jason Eisner. 2008. Dependency Parsing by Belief Propagation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. find
  53. Wee Meng Soon, Hwee Tou Ng, and Daniel Chung Yong Lim. 2001. A Machine Learning Approach to Coreference Resolution of Noun Phrases. Computational Linguistics, 27(4):521–544, December. find our card
  54. Veselin Stoyanov, Nathan Gilbert, Claire Cardie, and Ellen Riloff. 2009. Conundrums in Noun Phrase Coreference Resolution: Making Sense of the State-of-the-Art. In Proceedings of the Association for Computational Linguistics. find our card
  55. Veselin Stoyanov, Claire Cardie, Nathan Gilbert, Ellen Riloff, David Buttler, and David Hysom. 2010. Coreference Resolution with Reconcile. In Proceedings of the Association for Computational Linguistics: Short Papers. find our card
  56. Marc Vilain, John Burger, John Aberdeen, Dennis Connolly, and Lynette Hirschman. 1995. A Model-Theoretic Coreference Scoring Scheme. In Proceedings of the Conference on Message Understanding. find our card
  57. Kellie Webster and James R. Curran. 2014. Limited Memory Incremental Coreference Resolution. In Proceedings of the Conference on Computational Linguistics. find our card
  58. Tong Zhang and David Johnson. 2003. A Robust Risk Minimization Based Named Entity Recognition System. In Proceedings of the Conference on Natural Language Learning. find
  59. Jiaping Zheng, Luke Vilnis, Sameer Singh, Jinho D. Choi, and Andrew McCallum. 2013. Dynamic Knowledge-Base Alignment for Coreference Resolution. In Proceedings of the Conference on Computational Natural Language Learning. find our card

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/durrett-2014-joint-model-entity-analysis-coreference/