Elamur Research⌕
☰
home / papers / 2015 / Large-Scale Information Extraction from Textual Definitions through Deep Syntactic and Semantic Analysis

Large-Scale Information Extraction from Textual Definitions through Deep Syntactic and Semantic Analysis

Paper · 2015 · Claudio Delli Bovi, Luca Telesca and Roberto Navigli

Summary

DefIE addresses a gap in Open Information Extraction (OIE). Relation phrases produced by such systems usually remain plain surface strings: they are ambiguous, carry no explicit meaning, and have no shared ontological structure. The authors skip huge, noisy web text and use a compact collection of textual definitions, which are dense and nearly noise-free.

Each definition is parsed with the C&C CCG parser and disambiguated with Babelfy, which links words and entity mentions to BabelNet. The two analyses are merged into a syntactic-semantic graph, in which multi-word senses collapse into single nodes. A relation pattern is the shortest path between two linked concepts, and it must pass through at least one verb. Relations then receive semantic type signatures and scores. Their semantified patterns are used to organize them automatically into a taxonomy.

The result is a knowledge base of several million fully disambiguated triples. Its accuracy and coverage rival OIE systems built on far larger corpora. Because the output is already tied to WordNet and Wikipedia, no separate alignment step is needed.

Key points

  • Input: about 4.3 million definitions, totalling under 83 million tokens. Competing OIE systems rely on Wikipedia (over 1.5 billion tokens), ClueWeb (over 33 billion tokens) or the Web.
  • Output: more than 20 million relation instances covering roughly 256,000 distinct relations and nearly 2.4 million concepts and entities.
  • Pipeline: C&C (CCG) parsing, then Babelfy for joint WSD and entity linking over BabelNet. Patterns are found with Floyd-Warshall shortest paths, and rare relations are dropped below a frequency threshold ρ.
  • Both relation arguments and the content words inside patterns are disambiguated. This reduces polysemy and merges synonymous patterns, and the resulting relation taxonomy compares favourably with prior work such as Nakashole et al. (2012).
  • Planned extensions: applying the method to open text together with definition extraction and gloss finding, adding inference to complete the knowledge base, and building multilingual, language-independent relations.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

🎓Sapienza University of RomeRome · Italy57 works · 9,564 citations

 Fields, topics and concepts

📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 works

🧭 Topics 1Research subjects and languages the work is about.Information extraction · 167 works

Cite

Cite as Claudio Delli Bovi, Luca Telesca and Roberto Navigli. 2015. Large-Scale Information Extraction from Textual Definitions through Deep Syntactic and Semantic Analysis. Transactions of the Association for Computational Linguistics.

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.1162/tacl_a_00156

@article{bovi2015large,
  title = {{Large-Scale Information Extraction from Textual Definitions through Deep Syntactic and Semantic Analysis}},
  author = {Claudio Delli Bovi, Luca Telesca and Roberto Navigli},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2015},
  doi = {10.1162/tacl\_a\_00156},
  url = {https://doi.org/10.1162/tacl_a_00156}
}

References

53 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Kurt Bollacker, Colin Evans, Praveen Paritosh, Tim Sturge, and Jamie Taylor. 2008. Freebase: A Collaboratively Created Graph Database For Structuring Human Knowledge. In Proceedings of SIGMOD, pages 1247–1250. find
  2. Andrew Carlson, Justin Betteridge, Bryan Kisiel, Burr Settles, Estevam R. Hruschka Jr., and Tom M. Mitchell. 2010. Toward an Architecture for Never-Ending Language Learning. In Proceedings of AAAI, pages 1306–1313. find
  3. Stephen Clark and James R. Curran. 2007. Wide-coverage Efficient Statistical Parsing with CCG and Log-Linear Models. Computational Linguistics, 33(4):493–552.
  4. Stephen Clark and David Weir. 2002. Class-Based Probability Estimation Using a Semantic Hierarchy. Computational Linguistics, 28(2):187–206. find
  5. Bhavana Dalvi, Einat Minkov, Partha P. Talukdar, and William W. Cohen. 2015. Automatic Gloss Finding for a Knowledge Base using Ontological Constraints. In Proceedings of WSDM, pages 369–378. find
  6. Claudio Delli Bovi, Luis Espinosa Anke, and Roberto Navigli. 2015. Knowledge Base Unification via Sense Embeddings and Disambiguation. In Proceedings of EMNLP, pages 726–736. find
  7. Xin Dong, Evgeniy Gabrilovich, Geremy Heitz, Wilko Horn, Ni Lao, Kevin Murphy, Thomas Strohmann, Shaohua Sun, and Wei Zhang. 2014. Knowledge Vault: a Web-Scale Approach to Probabilistic Knowledge Fusion. In Proceedings of KDD, pages 601–610. find
  8. Arnab Dutta, Christian Meilicke, and Simone Paolo Ponzetto. 2014. A Probabilistic Approach for Integrating Heterogeneous Knowledge Sources. In Proceedings of ESWC, pages 286–301. find
  9. Katrin Erk. 2007. A Simple, Similarity-based Model for Selectional Preferences. In Proceedings of ACL, page 216–223. find
  10. Oren Etzioni, Michele Banko, Stephen Soderland, and Daniel S. Weld. 2008. Open Information Extraction from the Web. Commun. ACM, 51(12):68–74.
  11. Anthony Fader, Stephen Soderland, and Oren Etzioni. 2011. Identifying Relations for Open Information Extraction. In Proceedings of EMNLP, pages 1535– 1545. find
  12. Christiane Fellbaum. 1998. find
  13. WordNet: An Electronic Lexical Database. Bradford Books. Paolo Ferragina and Ugo Scaiella. 2012. Fast and Accurate Annotation of Short Texts with Wikipedia Pages. IEEE Software, 29(1):70–75. find
  14. Tiziano Flati and Roberto Navigli. 2013. SPred: Large-scale Harvesting of Semantic Predicates. In Proceedings of ACL, pages 1222–1232. find
  15. Tiziano Flati, Daniele Vannella, Tommaso Pasini, and Roberto Navigli. 2014. Two Is Bigger (and Better) Than One: the Wikipedia Bitaxonomy Project. In Proceedings of ACL, pages 945–955. find
  16. Robert W. Floyd. 1962. Algorithm 97: Shortest Path. Communications of the ACM, 5(6):345–345. find
  17. Adam Grycner and Gerhard Weikum. 2014. HARPY: Hypernyms and Alignment of Relational Paraphrases. In Proceedings of COLING, pages 2195–2204. find
  18. Rahul Gupta, Alon Halevy, Xuezhi Wang, Steven Euijong Whang, and Fei Wu. 2014. Biperpedia: An Ontology for Search Applications. In Proceedings of VLDB, pages 505–516. find
  19. Raphael Hoffmann, Congle Zhang, Xiao Ling, Luke Zettlemoyer, and Daniel S. Weld. 2011. Knowledge-based Weak Supervision for Information Extraction of Overlapping Relations. In Proceedings of NAACL HLT, pages 541–540. find
  20. Eduard Hovy, Roberto Navigli, and Simone Paolo Ponzetto. 2013. Collaboratively built semi-structured content and Artificial Intelligence: The story so far. Artificial Intelligence, 194:2–27. find
  21. Sarath Kumar Kondreddi, Peter Triantafillou, and Gerhard Weikum. 2014. Combining Information Extraction and Human Computing for Crowdsourced Knowledge Acquisition. In Proceedings of ICDE, pages 988–999. find
  22. Sebastian Krause, Hong Li, Hans Uszkoreit, and Feiyu Xu. 2012. Large-Scale Learning of Relation-Extraction Rules with Distant Supervision from the Web. In Proceedings of ISWC. find
  23. Ni Lao, Amarnag Subramanya, Fernando Pereira, and William W. Cohen. 2012. Reading the Web with Learned Syntactic-Semantic Inference Rules. In Proceedings of EMNLP-CoNLL, pages 1017–1026. find
  24. Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N. Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick van Kleef, Sören Auer, and Christian Bizer. 2014. DBpedia - A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia. Semantic Web Journal, pages 1–29.
  25. Thomas Lin, Mausam, and Oren Etzioni. 2012. No Noun Phrase Left Behind: Detecting and Typing Unlinkable Entities. In Proceedings of EMNLP-CoNLL, pages 893–903. find
  26. Farzaneh Mahdisoltani, Joanna Biega, and Fabian M. Suchanek. 2015. YAGO3: A Knowledge Base from Multilingual Wikipedias. In CIDR.
  27. Pablo N. Mendes, Max Jakob, Andrés García-Silva, and Christian Bizer. 2011. DBPedia Spotlight: Shedding Light on the Web of Documents. In Proceedings of I-Semantics, pages 1–8. find
  28. Rada Mihalcea and Andras Csomai. 2007. Wikify!: Linking Documents to Encyclopedic Knowledge. In Proceedings of CIKM, pages 233–242. find
  29. David Milne and Ian H. Witten. 2013. An Open-Source Toolkit for Mining Wikipedia. Artificial Intelligence, 194:222–239. find
  30. Bonan Min, Shuming Shi, Ralph Grishman, and Chin-Yew Lin. 2012. Ensemble Semantics for Large-scale Unsupervised Relation Extraction. In Proceedings of EMNLP-CoNLL, pages 1027–1037. find
  31. Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. 2009. Distant Supervision for Relation Extraction Without Labeled Data. In Proceedings of ACL-IJCNLP, pages 1003–1011.
  32. Tom M. Mitchell. 2005. Reading the Web: A Breakthrough Goal for AI. find
  33. AI Magazine. Andrea Moro and Roberto Navigli. 2012. WiSeNet: Building a Wikipedia-based Semantic Network with Ontologized Relations. In Proceedings of CIKM, pages 1672–1676. find
  34. Andrea Moro and Roberto Navigli. 2013. Integrating Syntactic and Semantic Analysis into the Open Information Extraction Paradigm. In Proceedings of IJCAI, pages 2148–2154. find
  35. Andrea Moro, Hong Li, Sebastian Krause, Feiyu Xu, Roberto Navigli, and Hans Uszkoreit. 2013. Semantic Rule Filtering for Web-Scale Relation Extraction. In Proceedings of ISWC, pages 347–362. find
  36. Andrea Moro, Alessandro Raganato, and Roberto Navigli. 2014. Entity Linking meets Word Sense Disambiguation: a Unified Approach. TACL, 2:231–244.
  37. Dana Movshovitz-Attias and William W. Cohen. 2015. KB-LDA: Jointly Learning a Knowledge Base of Hierarchy, Relations, and Facts. In Proceedings of ACL. find
  38. Ndapandula Nakashole, Gerhard Weikum, and Fabian M. Suchanek. 2012. PATTY: A Taxonomy of Relational Patterns with Semantic Types. In Proceedings of EMNLP-CoNLL, pages 1135–1145.
  39. Vivi Nastase and Michael Strube. 2013. Transforming Wikipedia into a Large Scale Multilingual Concept Network. Artificial Intelligence, 194:62–85. find
  40. Roberto Navigli and Simone Paolo Ponzetto. 2012. BabelNet: The Automatic Construction, Evaluation and Application of a Wide-Coverage Multilingual Semantic Network. Artificial Intelligence, 193:217–250. find
  41. Roberto Navigli and Paola Velardi. 2010. Learning Word-class Lattices for Definition and Hypernym Extraction. In Proceedings of ACL, pages 1318–1327.
  42. Maria Pershina, Bonan Min, Wei Xu, and Ralph Grishman. 2014. Infusion of Labeled Data into Distant Supervision for Relation Extraction. In Proceedings of ACL, pages 732–738. find
  43. Francesco Piccinno and Paolo Ferragina. 2014. From TagME to WAT: a New Entity Annotator. In Proceedings of ERD, pages 55–62. find
  44. Simone Paolo Ponzetto and Michael Strube. 2011. Taxonomy Induction Based on a Collaboratively Built Knowledge Repository. Artificial Intelligence, 175(9-10):1737–1756. find
  45. Philip Resnik. 1996. Selectional Constraints: An Information-Theoretic Model and its Computational Realization. Cognition, 61(1-2):127–159. find
  46. Stephen D. Richardson, William B. Dolan, and Lucy Vanderwende. 1998. MindNet: Acquiring and Structuring Semantic Information from Text. In Proceedings of ACL, pages 1098–1102. find
  47. Sebastian Riedel, Limin Yao, and Andrew McCallum. 2010. Modeling Relations and Their Mentions without Labeled Text. In Proceedings of ECML-PKDD, pages 148–163. find
  48. Sebastian Riedel, Limin Yao, Andrew McCallum, and Benjamin M. Marlin. 2013. Relation Extraction with Matrix Factorization and Universal Schemas. In Proceedings of NAACL HLT, pages 74–84. find
  49. Alan Ritter, Mausam, and Oren Etzioni. 2010. A Latent Dirichlet Allocation Method for Selectional Preferences. In Proceedings of ACL, pages 424–434.
  50. The Syntactic Process. MIT Press, Cambridge, MA, USA. Mihai Surdeanu, Julie Tibshirani, Ramesh Nallapati, and Christopher D. Manning. 2012. Multi-instance Multi-label Learning for Relation Extraction. In Proceedings of EMNLP-CoNLL, pages 455–465. Denny Vrandečić. 2012. Wikidata: A New Platform for… find
  51. William Yang Wang, Kathryn Mazaitis, Ni Lao, Tom M. Mitchell, and William W. Cohen. 2015. Efficient Inference and Learning in a Large Knowledge Base -Reasoning with Extracted Information using a Locally Groundable First-Order Probabilistic Logic. Machine Learning, 100(1):101–126. find
  52. Fei Wu and Daniel S. Weld. 2007. Autonomously Semantifying Wikipedia. In Proceedings of CIKM, pages 41–50. find
  53. Mohamed Yahya, Steven Euijong Whang, Rahul Gupta, and Alon Halevy. 2014. ReNoun: Fact Extraction for Nominal Attributes. In Proceedings of EMNLP, pages 325–335. find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/bovi-2015-large-scale-information-extraction-textual/