Elamur Research⌕
☰
home / papers / 2022 / Universal Dependencies for Punjabi

Universal Dependencies for Punjabi

Summary

Universal Dependencies (UD) barely covers the languages of South Asia: only Hindi and Urdu have large treebanks. Punjabi, spoken natively by more than 100 million people, still had no UD corpus. The author created the first UD treebank for Punjabi in the Gurmukhi script (the standard Majhi dialect). The texts were selected manually from various sources: news, editorials, blogs, and selected sentences from IndicCorp and FLORES-101. As a result, the corpus is less skewed toward news than existing resources. The annotation was done by a single native speaker in UD Annotatrix. It covers POS tags, syntactic dependencies, and Enhanced Dependencies. Most of the paper explains the decisions made for difficult phenomena: multiword postpositions, the copula, subjects in oblique cases, complex predicates, and displaced relative clauses. No parser has been trained yet, so there are no scores such as LAS. The value of the paper lies in a new open resource and well-motivated annotation decisions that can be carried over to other Indo-Aryan languages.

Key points

  • The corpus is small: about 6,220 tokens and roughly 300 sentences. The most frequent POS tags are NOUN (21.9%) and ADP (17.1%), and the most frequent relation is case (14.9%).
  • For "noun/adjective + light verb" constructions, the subtype compound:lvc is introduced, with the verb treated as the head. 28% of verbs occur in such constructions. For aspectual verb combinations, compound:svc is used rather than aux, as in the Hindi and Urdu treebanks.
  • Subjects in the dative and locative cases are labeled nsubj. The agent in the passive is labeled obl:agent.
  • In multiword postpositions, the first element is labeled case, and the rest are attached via fixed. Case markers fused with pronouns were deliberately left unsplit.
  • Enhanced Dependencies (in particular ref for relative pronouns) are applied to a language of this group for the first time. Future plans include morphological features, an inter-annotator agreement check, parser training, and a corpus in the Shahmukhi script.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

Fields: Linguistics & languages

Topics: Universal Dependencies · Treebanks · Part-of-speech tagging

Cited by

6 papers of our library cite it (of the 140673 whose bibliographies we read); 2 of them have a page here, 4 not yet.

Cite

The paper itself, not this page. BibTeX from the library's record of the work.

@inproceedings{arora2022universal,
  title = {{Universal Dependencies for Punjabi}},
  author = {Arora, Aryaman},
  booktitle = {Proceedings of the Thirteenth Language Resources and Evaluation Conference},
  year = {2022},
  doi = {10.63317/5eih9848bweq},
  url = {https://doi.org/10.63317/5eih9848bweq}
}

References

32 references, 2 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Baker, Paul, Hardie, Andrew, McEnery, Tony, Cunningham, Hamish, and Gaizauskas, Rob (2002). EMILLE, a 67-million word corpus of indic languages: Data collection, mark-up and harmonisation. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC’02). European L… find our card
  2. Bhaskararao, P. and Subbarao, K. V., editors (2004). Non-nominative Subjects, volume 1. John Benjamins Publishing Company, Netherlands. find
  3. Bhat, Irshad, Bhat, Riyaz A., Shrivastava, Manish, and Sharma, Dipti (2018). Universal Dependency parsing for Hindi-English code-switching. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Lon… find
  4. Bhat, Riyaz Ahmad and Sharma, Dipti Misra (2012). Dependency treebank of Urdu and its evaluation. In Proceedings of the Sixth Linguistic Annotation Workshop, pages 157–165. Association for Computational Linguistics, Jeju, Republic of Korea. find
  5. Bhatia, Tej K. (1993). Punjabi: A cognitive-descriptive grammar. Routledge, London and New York. find
  6. Bhatt, Rajesh (2003). Aryan. find
  7. Relativization strategies in Indo-Bhatt, Rajesh, Narasimhan, Bhuvana, Palmer, Martha, Rambow, Owen, Sharma, Dipti, and Xia, Fei (2009). A multi-representational and multi-layered treebank for Hindi/Urdu. In Proceedings of the Third Linguistic Annotation Workshop (LAW III), pages 186–189. Association… find
  8. Dwivedi, Puneet and Zeman, Daniel (2017). Universal Dependencies for Sanskrit: A pilot study. Preprint. find
  9. Ehsan, Toqeer and Butt, Miriam (2020). Dependency parsing for Urdu: Resources, conversions and learning. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 5202–5207. European Language Resources Association, Marseille, France. find
  10. Gill, Mandeep Singh, Lehal, Gurpreet Singh, and Joshi, Shiv Sharma (2009). Part-of-speech tagging for grammar checking of Punjabi. Linguistics Journal, 4(1). find
  11. Goyal, Naman, Gao, Cynthia, Chaudhary, Vishrav, Chen, Peng-Jen, Wenzek, Guillaume, Ju, Da, Krishnan, San-jana, Ranzato, Marc’Aurelio, Guzman, Francisco, and Fan, Angela (2021). The FLORES-101 evaluation benchmark for low-resource and multilingual machine translation. find
  12. Haddow, Barry and Kirefu, Faheem (2020). PMIndia – a collection of parallel corpora of languages of India. find
  13. Hellwig, Oliver, Scarlata, Salvatore, Ackermann, Elia, and Widmer, Paul (2020). The treebank of vedic Sanskrit. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 5137–5146. European Language Resources Association, Marseille, France. find
  14. Kakwani, Divyanshu, Kunchukuttan, Anoop, Golla, Satish, N.C., Gokul, Bhattacharyya, Avik, Khapra, Mitesh M., and Kumar, Pratyush (2020). IndicNLPSuite: Monolingual corpora, evaluation benchmarks and pre-trained multilingual language models for Indian languages. In Findings of the Association for Com… find
  15. Levshina, Natalia (2019). Token-based typology and word order entropy: A study based on Universal Dependencies. Linguistic Typology, 23(3):533–572. doi:doi:10.1515/ lingty-2019-0025. find
  16. McEnery, Anthony, Baker, Paul, Gaizauskas, Rob, and Cunningham, Hamish (2000). EMILLE: building a corpus of South Asian languages. In Proceedings of the International Conference on Machine Translation and Multilingual Applications in the new Millennium: MT 2000. University of Exeter, UK. find
  17. Mohanan, Tara (1994). Argument structure in Hindi. Center for the Study of Language (CSLI). find
  18. Nallani, Sneha, Shrivastava, Manish, and Sharma, Dipti (2020). A fully expanded dependency treebank for Telugu. In Proceedings of the WILDRE5– 5th Workshop on Indian Language Data: Resources and Evaluation, pages 39–44. European Language Resources Association (ELRA), Marseille, France. find
  19. Nivre, Joakim, de Marneffe, Marie-Catherine, Ginter, Filip, Goldberg, Yoav, Hajič, Jan, Manning, Christopher D., McDonald, Ryan, Petrov, Slav, Pyysalo, Sampo, Silveira, Natalia, Tsarfaty, Reut, and Zeman, Daniel (2016). Universal Dependencies v1: A multilingual treebank collection. In Proceedings o… find
  20. Farris, Adam and Arora, Aryaman (2021). For the purpose of curry: A UD treebank for Ashokan Prakrit. In Proceedings of the Fifth Workshop on Universal Dependencies (UDW, SyntaxFest 2021), pages 49–61. Association for Computational Linguistics, Sofia, Bulgaria. find
  21. Nivre, Joakim, de Marneffe, Marie-Catherine, Ginter, Filip, Hajič, Jan, Manning, Christopher D., Pyysalo, Sampo, Schuster, Sebastian, Tyers, Francis, and Zeman, Daniel (2020). Universal Dependencies v2: An evergrowing multilingual treebank collection. In Proceedings of the 12th Language Resources a… find
  22. Ojha, Atul Kr. and Zeman, Daniel (2020). Universal Dependency treebanks for low-resource Indian languages: The case of Bhojpuri. In Proceedings of the WILDRE5– 5th Workshop on Indian Language Data: Resources and Evaluation, pages 33–38. European Language Resources Association (ELRA), Marseille, Fran… find
  23. Tyers, Francis M., Sheyanova, Mariya, and Washington, Jonathan North (2017). UD annotatrix: An annotation tool for Universal Dependencies. In Proceedings of the 16th International Workshop on Treebanks and Linguistic Theories, pages 10–17. Prague, Czech Republic. find
  24. Vaidya, Ashwini, Rambow, Owen, and Palmer, Martha (2014). Light verb constructions with ‘do’ and ‘be’ in Hindi: A TAG analysis. In Proceedings of Workshop on Lexical and Grammatical Resources for Language Processing, pages 127–136. Association for Computational Linguistics and Dublin City University… find
  25. Poiret, Rafaël, Wong, Tak-Sum, Lee, John, Gerdes, Kim, and Leung, Herman (2021). Universal Dependencies for Mandarin Chinese. Language Resources and Evaluation, pages 1–38. find
  26. Ravishankar, Vinit (2017). A Universal Dependencies treebank for Marathi. In Proceedings of the 16th International Workshop on Treebanks and Linguistic Theories, pages 190–200. Prague, Czech Republic. find
  27. RCPLT (2021). Punjabi–English Dictionary. Punjabi University, Patiala. find
  28. Reddy, Siva, Täckström, Oscar, Petrov, Slav, Steedman, Mark, and Lapata, Mirella (2017). Universal semantic parsing. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 89–101. Association for Computational Linguistics, Copenhagen, Denmark. doi:10.18653/v… find
  29. Schuster, Sebastian and Manning, Christopher D. (2016). Enhanced English Universal Dependencies: An improved representation for natural language understanding tasks. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pages 2371–2378. European Languag… find our card
  30. Sharma, Sanjeev Kumar and Lehal, Gurpreet Singh (2011). Using Hidden Markov Model to improve the accuracy of Punjabi POS tagger. In 2011 IEEE International Conference on Computer Science and Automation Engineering, volume 2, pages 697–701. doi:10.1109/CSAE.2011. 5952600. — [doi:10.1109/csae.2011](https://doi.org/10.1109/csae.2011) find
  31. Singh, Maya (1895). The Panjabi Dictionary. Munshi Gu-lab Singh & Sons, Lahore. find
  32. Tandon, Juhi, Chaudhry, Himani, Bhat, Riyaz Ahmad, and Sharma, Dipti (2016). Conversion from paninian karakas to Universal Dependencies for Hindi dependency treebank. In Proceedings of the 10th Linguistic Annotation Workshop held in conjunction with ACL 2016 (LAW-X 2016), pages 141–150. Association… find

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/papers/arora-2022-universal-dependencies-punjabi/