Elamur Research⌕
☰
home / papers / 2013 / Linking and Extending an Open Multilingual Wordnet

Linking and Extending an Open Multilingual Wordnet

Summary

The authors want researchers in lexical semantics to be able to work with wordnets for many languages without legal or technical obstacles. First, they collected all wordnets whose licenses permit redistribution into a single sqlite database following the Japanese WordNet schema. All of these resources were mapped to a common version of Princeton WordNet. Its synsets became the pivot through which languages are linked to one another at the level of senses rather than individual words. The resource was then automatically extended from two sources: Unicode CLDR (names of languages, territories and dates) and the English Wiktionary. The main novelty is that Wiktionary senses are linked directly to WordNet synsets. To achieve this, the authors combine monolingual features with translations into many languages, which help disambiguate senses. The result is the Open Multilingual Wordnet: over 2 million senses for 117,659 concepts, spanning more than 1.4 million words across hundreds of languages. Precision by sense ranges from 85–99%, with an overall estimate of over 94%. Beyond the resource itself, the work is valuable for its attention to licensing and to how the resource can be maintained in the future: errors found during conversion are reported back by the authors to the original projects.

Key points

  • Large wordnets (over 10,000 concepts) exist for 26+ languages, and smaller ones for 57. The large ones cover 42–100% of the list of the 5,000 most frequent senses (core senses, Boyd-Graber et al., 2006).
  • Open projects were merged, among them Albanet, Arabic WordNet, DanNet, FinnWordNet, WOLF, MultiWordNet, Japanese Wordnet, Multilingual Central Repository, plWordNet, OpenWN-PT, Wordnet Bahasa and Thai Wordnet. The scripts of Daudé et al. (2003) were used to map them between PWN versions.
  • CLDR provided data for 122 languages, typically about 550 senses per language. This volume is small, so it was checked manually.
  • Licenses were divided into four types: unrestricted, attribution, share-alike and non-commercial. Some of them are incompatible, so releasing a single database is impossible: everything except the French and Basque wordnets can be redistributed together.
  • For comparison, the precision of Universal Wordnet (UWN) is slightly below 90%. Data from a new version of Wiktionary is integrated within a few hours. When English links are checked manually, the corrections propagate to all languages at once.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: AI & machine learning

Topics: Multilingual & cross-lingual NLP

Cite

The paper itself, not this page. BibTeX from the library's record of the work.

@inproceedings{bond2013linking,
  title = {{Linking and Extending an Open Multilingual Wordnet}},
  author = {Bond, Francis and Foster, Ryan},
  booktitle = {Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2013},
  url = {https://aclanthology.org/P13-1133/}
}

References

41 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Stephen Bird, Ewan Klein, and Edward Loper. 2010. Nyumon Shizen Gengo Shori [Introduction to Natural Language Processing]. O’Reilly. (translated by Hagiwara, Nakamura and Mizuno). find
  2. W. Black, S. Elkateb, H. Rodriguez, M. Alkhalifa, P. Vossen, A. Pease, M. Bertran, and C. Fellbaum. 2006. The Arabic wordnet project. In Proceedings of LREC 2006. find
  3. Francis Bond and Kyonghee Paik. 2012. A survey of wordnets and their licenses. In Proceedings of the 6th Global WordNet Conference (GWC 2012). Matsue. 64–71. find
  4. Jordan Boyd-Graber, Christiane Fellbaum, Daniel Osherson, and Robert Schapire. 2006. Adding dense, weighted connections to WordNet. In Proceedings of the Third Global WordNet Meeting. Jeju. find
  5. Thatsanee Charoenporn, Virach Sornlerlam-vanich, Chumpol Mokarat, and Hitoshi Isahara. 2008. Semi-automatic compilation of Asian WordNet. In 14th Annual Meeting of the Association for Natural Language Processing, pages 1041–1044. Tokyo. find
  6. Jordi Daude, Lluis Padro, and German Rigau. 2003. Validation and tuning of Wordnet mapping techniques. In Proceedings of the International Conference on Recent Advances in Natural Language Processing (RANLP’03). Borovets, Bulgaria. find
  7. Gerard de Melo and Gerhard Weikum. 2009. Towards a universal wordnet by learning from combined evidence. In Proceedings of the 18th ACM Conference on Information and Knowledge Management (CIKM 2009), pages 513– 522. ACM, New York, NY, USA. find
  8. Gerard de Melo and Gerhard Weikum. 2010. Towards universal multilingual knowledge bases. In Pushpak Bhattacharyya, Christiane Fellbaum, and Piek Vossen, editors, Principles, Construction, and Applications of Multilingual Wordnets. Proceedings of the 5th Global Word-Net Conference (GWC 2010), pages 1… find
  9. Valeria de Paiva and Alexandre Rademaker. 2012. Revisiting a Brazilian wordnet. In Proceedings of the 6th Global WordNet Conference (GWC 2012). Matsue. find
  10. Christiane Fellbaum and Piek Vossen. 2012. Challenges for a multilingual wordnet. Language Resources and Evaluation, 46(2):313– 326. Doi=10.1007/s10579-012-9186-z. — [doi:10.1007/s10579-012-9186-z](https://doi.org/10.1007/s10579-012-9186-z) find
  11. Christine Fellbaum, editor. 1998. WordNet: An Electronic Lexical Database. MIT Press. find
  12. Aitor Gonzalez-Agirre, Egoitz Laparra, and German Rigau. 2012. Multilingual central repository version 3.0: upgrading a very large lexical knowledge base. In Proceedings of the 6th Global WordNet Conference (GWC 2012). Matsue. find
  13. Valérie Hanoka and Benoı̂t Sagot. 2012. Wordnet creation and extension made simple: A multilingual lexicon-based approach using wiki resources. In Proceedings of LREC 2012. Istanbul. find
  14. Chu-Ren Huang, Shu-Kai Hsieh, Jia-Fei Hong, Yun-Zhu Chen, I-Li Su, Yong-Xiang Chen, and Sheng-Wei Huang. 2010. Chinese wordnet: Design and implementation of a cross-lingual knowledge processing infrastructure. Journal of Chinese Information Processing, 24(2):14–23. (in Chinese). find
  15. Hitoshi Isahara, Francis Bond, Kiyotaka Uchimoto, Masao Utiyama, and Kyoko Kanzaki. 2008. Development of the Japanese WordNet. In Sixth International conference on Language Resources and Evaluation (LREC 2008). Marrakech. find
  16. Toru Ishida. 2006. Language grid: An infrastructure for intercultural collaboration. In IEEE/IPSJ Symposium on Applications and the Internet (SAINT-06), pages 96–100. URL http://langrid.nict.go.jp/file/langrid20060211.pdf, (keynote address). ↗
  17. Kow Kuroda, Takayuki Kuribayashi, Francis Bond, Kyoko Kanzaki, and Hitoshi Isahara. 2011. Orthographic variants and multilingual sense tagging with the Japanese WordNet. In 17th Annual Meeting of the Association for Natural Language Processing, pages A4–1. Toyohashi. find
  18. Krister Lindén and Lauri Carlson. 2010. Finnwordnet — wordnet påfinska via översättning. LexicoNordica — Nordic Journal of Lexicography, 17:119–140. In Swedish with an English abstract. find
  19. John McCrae, Philipp Cimiano, and Elena Montiel-Ponsoda. 2012. Integrating wordnet and wiktionary with lemon. In Christian Chiarcos, Sebastian Nordhoff, and Sebastian Hellman, editors, Linked Data in Linguistics. Springer. find
  20. Christian M. Meyer and Iryna Gurevych. 2011. What psycholinguists know about chemistry: Aligning wiktionary and wordnet for increased domain coverage. In Proceedings of the 5th International Joint Conference on Natural Language Processing (IJCNLP), pages 883–892. find
  21. Nurril Hirfana Mohamed Noor, Suerya Sapuan, and Francis Bond. 2011. Creating the open Wordnet Bahasa. In Proceedings of the 25th Pacific Asia Conference on Language, Information and Computation (PACLIC 25), pages 258–267. Singapore. find
  22. Mortaza Montazery and Heshaam Faili. 2010. Automatic Persian wordnet construction. In 23rd International conference on computational linguistics, pages 846–850. find
  23. Roberto Navigli and Simone Paolo Ponzetto. 2012. BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artificial Intelligence, 193:217–250. find
  24. NIST. 2012. Secure hash standard (shs). Fips pub 180-4, National Institute of Standards and Technology. find
  25. Noam Ordan and Shuly Wintner. 2007. Hebrew wordnet: a test case of aligning lexical databases across languages. International Journal of Translation, 19(1):39–58. find
  26. B.S Pedersen, S. Nimb, J. Asmussen, N. Sørensen, L. Trap-Jensen, and H. Lorentzen. 2009. Dan-Net — the challenge of compiling a wordnet for Danish by reusing a monolingual dictionary. Language Resources and Evaluation. find
  27. Ted Pederson. 2008. Empiricism is not a matter of faith. Computational Linguistics, 34(3):465– 470. find
  28. Emanuele Pianta, Luisa Bentivogli, and Christian Girardi. 2002. Multiwordnet: Developing an aligned multilingual database. In In Proceedings of the First International Conference on Global WordNet, pages 293–302. Mysore, India. find
  29. Maciej Piasecki, Stan Szpakowicz, and Bartosz Broda. 2009. A Wordnet from the Ground Up. Wroclaw University of Technology Press. URL http://www.plwordnet.pwr.wroc.pl/main/content/files/publications/A_Wordnet_from_the_Ground_Up.pdf, (ISBN 978-83-7493-476-3). ↗
  30. Chiew Kin Quah, Francis Bond, and Takefumi Yamazaki. 2001. Design and construction of a machine-tractable Malay-English lexicon. find
  31. In Asialex 2001 Proceedings, pages 200–205. Seoul. find
  32. Ervin Ruci. 2008. On the current state of Albanet and related applications. Technical report, University of Vlora. (http://fjalnet.com/technicalreportalbanet.pdf). find
  33. Benoı̂t Sagot and Darja Fišer. 2008. Building a free French wordnet from multilingual resources. In European Language Resources Association (ELRA), editor, Proceedings of the Sixth International Language Resources and Evaluation (LREC’08). Marrakech, Morocco. find
  34. Sareewan Thoongsup, Thatsanee Charoenporn, Kergrit Robkop, Tan Sinthurahat, Chumpol Mokarat, Virach Sornlertlamvanich, and Hitoshi Isahara. 2009. Thai wordnet construction. In Proceedings of The 7th Workshop on Asian Language Resources (ALR7), Joint conference of the 47th Annual Meeting of the Assoc… find
  35. Dan Tufiş, Dan Cristea, and Sofia Stamou. 2004. BalkaNet: Aims, methods, results and perspectives. a general overview. Romanian Journal of Information Science and Technology, 7(1–2):9– 34. find
  36. Unicode, Inc. 2012. Unicode, Inc. license agreement - data files and software. http://www.unicode.org/copyright.html. ↗
  37. Piek Vossen, editor. 1998. Euro WordNet. Kluwer. find
  38. Piek Vossen. 2005. Building wordnets. http://www.globalwordnet.org/gwa/BuildingWordnets.ppt. ↗
  39. Wikimedia. 2013. List of wiktionaries. http://meta.wikimedia.org/w/index. php?title=Wiktionary&oldid=4729333. (accessed on 2013-02-14). ↗
  40. Wikipedia. 2013. Wikipedia — wikipedia, the free encyclopedia. URL http://en.wikipedia.org/w/index.php? title=Wikipedia&oldid=552515903, [Online; accessed 30-April-2013]. ↗
  41. Renjie Xu, Zhiqiang Gao, Yuzhong Qu, and Zhisheng Huang. 2008. An integrated approach for automatic construction of bilingual Chinese-English WordNet. In 3rd Asian Semantic Web Conference (ASWC 2008), pages 302–341. find

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/bond-2013-linking-extending-open-multilingual-wordnet/