Learning Word Vectors for 157 Languages

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Natural language processing

Cited by

451 papers of our library cite it (of the 140673 whose bibliographies we read); 19 of them have a page here, 432 not yet.

• Towards a Cleaner Document-Oriented Multilingual Crawled Corpus
• On the Importance of Tokenization in Arabic Embedding Models
• Comparing Neural Network Parsers for a Less-resourced and Morphologically-rich Language: Amharic Dependency Parser
• Evaluating Word Embeddings on Low-Resource Languages
• Contextual String Embeddings for Sequence Labeling
• On the Role of Morphological Information for Contextual Lemmatization
• Acquiring a Formality-Informed Lexical Resource for Style Analysis
• Word-Embeddings Distinguish Denominal and Root-Derived Verbs in Semitic
• Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
• When Similar Means Different: Evaluating LLMs on Arabic–Hebrew Cognates
• DataComp-LM: In search of the next generation of training sets for language models
• Morphology-rich Alphasyllabary Embeddings
• CamemBERT: a Tasty French Language Model
• CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languages
• CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB
• A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages
• Integrating Graph-Based and Transition-Based Dependency Parsers in the Deep Contextualized Era
• CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data
• Handling Syntactic Divergence in Low-resource Machine Translation

Cite

The paper itself, not this page. BibTeX from the library's record of the work. arXiv 1802.06893

@inproceedings{grave2018learning,
  title = {{Learning Word Vectors for 157 Languages}},
  author = {Grave, Edouard and Bojanowski, Piotr and Gupta, Prakhar and Joulin, Armand and Mikolov, Tomas},
  booktitle = {Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)},
  year = {2018},
  eprint = {1802.06893},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1802.06893}
}

References

23 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Al-Rfou, R., Perozzi, B., and Skiena, S. (2013). Polyglot: Distributed word representations for multilingual nlp. find our card
2. Proc. CoNLL. Baldwin, T. and Lui, M. (2010). Language identification: The long and the short of the matter. In Proc. find
3. NAACL. Berardi, G., Esuli, A., and Marcheggiani, D. (2015). Word embeddings go to Italy: a comparison of models and training datasets. find
4. Italian Information Retrieval Workshop. Bojanowski, P., Grave, E., Joulin, A., and Mikolov, T. (2017). Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics, 5. find
5. Buck, C., Heafield, K., and Van Ooyen, B. (2014). N-gram counts and language models from the common crawl. In Proc. LREC, volume 2. find
6. Spanish Billion Words Corpus and Embeddings, March. Chang, P.-C., Galley, M., and Manning, C. D. (2008). Optimizing chinese word segmentation for machine translation performance. In Proceedings of the third workshop on statistical machine translation. find
7. Collobert, R. and Weston, J. (2008). A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proc. find
8. ICML. Hartmann, N., Fonseca, E., Shulby, C., Treviso, M., Rodrigues, J., and Aluisio, S. (2017). Portuguese word embeddings: Evaluating on word analogies and natural language tasks. arXiv preprint arXiv:1708.06025. find
9. Jin, P. and Wu, Y. (2012). Semeval-2012 task 4: evaluating chinese word similarity. In Proc. *SEM. find
10. Joulin, A., Grave, E., Bojanowski, P., and Mikolov, T. (2017). Bag of tricks for efficient text classification. In Proc. find
11. EACL. Koehn, P. (2005). Europarl: A parallel corpus for statistical machine translation. In MT summit, volume 5. Köper, M., Scheible, C., and im Walde, S. S. (2015). Multilingual reliability and ”semantic” structure of continuous word spaces. find
12. Proc. IWCS 2015. Kudo, T. (2005). Mecab: Yet another part-of-speech and morphological analyzer. http://mecab. sourceforge. net/. find
13. Lui, M. and Baldwin, T. (2012). langid.py: An off-the-shelf language identification tool. In Proc. ACL (system demonstrations). find our card
14. Mihalcea, R. (2007). Using wikipedia for automatic word sense disambiguation. In Proc. find
15. NAACL. Mikolov, T., Chen, K., Corrado, G. D., and Dean, J. (2013a). Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781. find
16. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., and Dean, J. (2013b). Distributed representations of words and phrases and their compositionality. In Adv. find
17. NIPS. Mikolov, T., Grave, E., Bojanowski, P., Puhrsch, C., and Joulin, A. (2017). Advances in pre-training distributed word representations. arXiv preprint arXiv:1712.09405. find our card
18. Mnih, A. and Kavukcuoglu, K. (2013). Learning word embeddings efficiently with noise-contrastive estimation. In Adv. find
19. NIPS. Nguyen, T.-P. and Le, A.-C. (2016). A hybrid approach to vietnamese word segmentation. In Computing & Communication Technologies, Research, Innovation, and Vision for the Future (RIVF), 2016 IEEE RIVF International Conference on. find
20. IEEE. Pennington, J., Socher, R., and Manning, C. (2014). Glove: Global vectors for word representation. In Proc. find
21. EMNLP. Svoboda, L. and Brychcin, T. (2016). New word analogy corpus for exploring embeddings of Czech words. In Proc. find
22. CICLING. Venekoski, V. and Vankka, J. (2017). Finnish resources for evaluating language model semantics. In Proc. find
23. NoDaLiDa. Wu, F. and Weld, D. S. (2010). Open information extraction using wikipedia. In Proc. ACL. find