Building a Corpus of Qatari Arabic Expressions
Paper · 2020 · Sara Al-Mulla and Wajdi Zaghouani
Summary
Arabic NLP resources focus mostly on Modern Standard Arabic. A few dialects, such as Egyptian and Levantine, have some coverage, but Gulf Arabic, and Qatari in particular, has almost none. The authors also argue that traditional Qatari vocabulary is disappearing as English spreads and younger speakers stop using older words. To document and preserve it, they built a pilot lexical corpus of 1000 Qatari traditional expressions, both single words and multiword expressions (MWEs).
They gathered about 600 entries automatically from printed books and web sources, then cleaned them by hand. The remaining 400 came from transcribed interviews with older Qatari citizens. Each entry carries rich metadata, including:
- a theme
- a gloss in MSA and an English translation
- loanword origin
- POS and inflected forms
- an example sentence, pronunciation, synonyms and source
An online survey of 50 volunteers checked part of the data. It tested whether people recognised word meanings and could identify where loanwords came from. The corpus is free for research and is intended to support dialectal Arabic text and speech tools.
Key points
- Size and sources: 1000 entries in total. Roughly 600 came from five printed books and eight online sources, including Mojam, the AlArab newspaper lexicon, the ElBadi message board, AlHewar and the Mufradat lexicon. The other 400 came from interviews.
- Interviews: eight interviewees, Qatari citizens of both genders aged 40–80, recruited by snowball sampling. They received a topic list but were encouraged to go beyond it and tell the stories behind expressions.
- Metadata: each entry has 11 fields. Loanwords are tagged with one of four origins: Indian, Turkish, Persian or Western.
- Survey design: 50 participants. The first section asked for the meanings of 10 expressions shown in example sentences, with an "I don't know" option. The second section asked participants to group 26 expressions.
- Survey results: correct-answer rates ranged from about 36% to 87.5% across items.
- Availability: released on data.world under a Creative Commons license. Audio and transcripts are planned for later release.
Interesting ideas
- I1. Interviewees were given seed topics but invited to tell stories freely, which surfaced far more expressions than direct questioning would.
- I2. Each lexical entry stores not just the headword but its inflected forms, synonyms, an example sentence and the source it came from.
- I3. Meaning-recognition questions included an explicit "I don't know" choice, separating ignorance from confident error.
- I4. Loanwords are tagged with a coarse donor-language class (Indian, Turkish, Persian, Western) rather than a fine etymology.
- I5. Survey answers were tracked by participant age group, since familiarity with old vocabulary depends on generation.
For Mova
How these ideas could serve Mova, our small open language model — its files, stages and tests:
- I1 (learn): when prompting LLM teacher tiers for rare constructions, ask for loose narrative passages on a seed theme rather than lists, to harvest more natural, varied examples.
- I2 (tokens): MWE and idiom entries in the en lexicon could carry inflected variants plus a provenance field, so the tokenizer can match "kicked the bucket" forms and explain which source licensed the match.
- I3 (answer): give readers an abstain option in school-test and fable QA evaluation, and score wrong answers apart from abstentions, to measure calibration rather than raw accuracy.
- I4 (world): a small closed set of origin or register tags on ontology entries could help explain why a word behaves unusually, without needing a full etymological database.
- I5 (learn): break evaluation results down by text era or genre, so archaic vocabulary in old fables is not hidden inside an aggregate score.
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 works
🧭 Topics 1Research subjects and languages the work is about.Semitic languages · 2,908 works
Cite
Cite as Sara Al-Mulla and Wajdi Zaghouani. 2020. Building a Corpus of Qatari Arabic Expressions. Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection.
@inproceedings{almulla2020building,
title = {{Building a Corpus of Qatari Arabic Expressions}},
author = {Sara Al-Mulla and Wajdi Zaghouani},
booktitle = {Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection},
year = {2020},
url = {https://aclanthology.org/2020.osact-1.4/}
}References
- Al-Fahad, G. (2013). The Encyclopedia of Words Gone with Days . Kuwait. find
- Al-Badawi, K. (2013). Turkish words exotic to the Arabic language. Retrieved from Civilized dialogue: http://www.m.ahewar.org/s.asp?aid=360711&r=0&cid=0&u=&i=6452&q= ↗
- Al-Kuwari, R. (2014). The dictionary of Pearl diving and marine life terms in the Gulf. Doha: Katara Cultural Village. find
- Al-Malki, A. (2015). Camels in Qatar. Doha: Dar for Qatari books (Qatari books' house). find
- Al-Malki, K. (2005). Brief explanation of the Qatari parables. Doha: Al Majlis Al watani lethaqafa walfounon Ave. Age Correct answers 24.5 28.5 32.5 36.5 walturath. find
- AlMuhannadi, M. (2006). A guide to the idioms of Qatari Arabic with reference to English idioms. Doha: Dar Al kutub AlQataria. find
- Al-Attiyah, H. (2013, 5 27). Reviving the Local Dialect in Qatar: An Issue of Linguistic Concern or Identity Politics? Retrieved from Arab Center for Research and PolicyStudies: — Overview of the CLEF-2018 CheckThat! Lab on Automatic Identification and Verification of Political Claims. Task 1: Check-Worthiness https://www.dohainstitute.org/en/ResearchAndStudies/Pages/Reviving_the_Local_Dialect_in_Qatar_An_Issue _of_Linguistic_Concern_or_Identity_Politics.aspx AlNaama, N. (2012). Torath Al'ajdad. Retrieved from AlArab.Newspaper: https://www.alarab.qa/story/209946/%D8%AA%D8%B 1%D8%A7%D8%AB-%D8%A7%D9%84%D8%A3% D8%AC%D8%AF%D8%A7%D8%AF Atanasova Pepa, Alberto Barron-Cedeno, Tamer Elsayed, Reem Suwaileh, Wajdi Zaghouani, Spas Kyuchukov, Giovanni Da San Martino, Preslav Nakov (2018). Overview of the CLEF-2018 CheckThat! Lab on automatic identification and verification of political claims. Task 1: Check-worthiness. CLEF 2018 Working Notes. Working Notes of CLEF 2018 - Conference and Labs of the Evaluation Forum Babbie, E. (2010). The practice of social research. Belmont: Wadsworth, Cengage Learning. ↗
- Barrón-Cedeño Alberto, Tamer Elsayed, Reem Suwaileh, Lluís Màrquez, Pepa Atanasova, Wajdi Zaghouani, Spas Kyuchukov, Giovanni Da San Martino and Preslav Nakov (2018). Overview of the CLEF-2018 CheckThat! Lab on automatic identification and verification of political claims. Task 2: Factuality. CLEF 2018 Working Notes. Working Notes of CLEF 2018 - Conference and Labs of the Evaluation Forum Bouamor, H., Habash, N., Salameh, M., Zaghouani,W.,Rambow, O., Abdulrahim, D., Obeid, O., Khalifa, S., Eryani, F., Erdmann, A., et al. (2018). The MADAR arabic dialect corpus and lexicon. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). find
- Bouamor, H., Zaghouani, W., Diab, M., Obeid, O., Oflazer, K., Ghoneim, M., and Hawwari, A. (2015). A pilot study on arabic multi-genre corpus diacritization. In Proceedings of the Second Workshop on Arabic Natural Language Processing, pages 80–88.
- Bouamor Houda, Nizar Habash, Mohammad Salameh, Wajdi Zaghouani, Owen Rambow, Dana Abdulrahim, Ossama Obeid, Salam Khalifa, Fadhl Eryani, Alexander Erdmann, Kemal Oflazer(2018). The MADAR Arabic Dialect Corpus and Lexicon. In Proceedings of The International Conference on Language Resources and Evaluation, Miyazaki, Japan . find
- Braber , N., & Davies, D. (2016). Using and creating oral history in dialect research. Oral History, 44(1), 98-107. Carmen Berlinches Ramos, . "Idioms in Syrian Arabic: A First Approach towards a Lexico-Semantic and Grammatical Analysis." Zeitschrift für Arabische Linguistik 70 (2019): 17-43. find
- Buchanan , E., & Hvizdak, E. (2009). Online Survey Tools: Ethical and Methodological Concerns of Human Research Ethics Committees. Journal of Empirical Research on Human Research Ethics: An International Journal, 4(2), 37-48. ↗
- Burnard, L. (2004). Developing Linguistic Corpora: a Guide to Good Practice -Metadata for corpus work. Retrieved from ahds: Literature, Languages, and Linguistics: https://ota.ox.ac.uk/documents/creating/dlc/chapter3.ht m Diab Mona , Aous Mansouri, Martha Palmer, Olga Babko-Malaya, Wajdi Zaghouani, Ann Bies, Mohammed Maamouri. 2008) A Pilot Arabic Propbank. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08) ↗
- Habash (2010). Arabic Natural Language Processing. Morgan & Claypool Publishers. find
- Habash, N., Khalifa, S., Eryani, F., Rambow, O., Abdulrahim, D., Erdmann, A., Faraj, R., Zaghouani, W., Bouamor, H., Zalmout, N., Hassan, S., Shargi, F. A., Alkhereyf, S., Abdulkareem, B., Eskander, R., Salameh, M., and Saddiki, H. (2018). Unified Guidelines and Resources for Arabic Dialect Orthography. In Proceedings of the International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan Khalifa Salam, Nizar Habash, Dana Abdulrahim, Sara Hassan (2016) A Large Scale Corpus of Gulf Arabic. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
- Laoudi, Jamal, Claire Bonial, Lucia Donatelli, Stephen Tratz, and Clare Voss. "Towards a Computational Lexicon for Moroccan Darija: Words, Idioms, and Constructions." In Proceedings of the Joint Workshop on Linguistic Annotation, Multiword Expressions and Constructions (LAW-MWE-CxG-2018), pp. 74-85. 2018.
- Liaquat, S. Q. (2016). Freedom of Expression in Pakistan: A myth or a reality. (R. f. http://0-www.jstor.org.library.qnl.qa/stable/resrep02846.4, Trans.) Sustainable Development Policy Institute. ↗
- Maamouri, M., Bies, A., Kulick, S., Zaghouani, W., Graff, D., and Ciul, M. (2010). From speech to trees: Applying treebank annotation to Arabic broadcast news. In Proceedings of the Nine International Conference on Language Resources and Evaluation (LREC 2010). find
- Pasha, A., Al-Badrashiny, M., Kholy, A. E., Eskander, R., Diab, M., Habash, N., Pooleery, M., Rambow, O., and Roth, R. (2014). MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic. In In Proceedings of LREC, Reykjavik, Iceland Palmer Martha , Olga Babko-Malaya, Ann Bies, Mona Diab, Mohamed Maamouri, Aous Mansouri, Wajdi Zaghouani. (2008) A Pilot Arabic Propbank. In Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
- Rangel, F., Rosso, P., Charfi, A., and Zaghouani, W. (2019a). Detecting deceptive tweets in arabic for cybersecurity. In 2019 IEEE International Conference on Intelligence and Security Informatics (ISI), pages 86–91. IEEE. find
- Rangel, F., Rosso, P., Charfi, A., Zaghouani, W., Ghanem, B., and Snchez-Junquera, J. (2019b). Overview of the Track on Author Profiling and Deception Detection in Arabic. In Working Notes of the Forum for Information Retrieval Evaluation (FIRE’19). CEUR Workshop Proceedings. In: CEUR-WS. org, Kolkata, India Rosso, P., Rangel, F., Far´ıas, I. H., Cagnina, L., Zaghouani, W., and Charfi, A. (2018). A survey on author profiling, deception, and irony detection for the Arabic language. Language and Linguistics Compass, 12(4):e12275 find
- Rubin, B. (1991). Pan-Arab Nationalism: The Ideological Dream as Compelling Force. Journal of Contemporary History, 26(3/4), 535-551. ↗
- Zaghouani, W. (2014). Critical Survey of the Freely Available Arabic Corpora. In Proceedings of the Nine International Conference on Language Resources and Evaluation (LREC’14), OSACT Workshop, Reykjavik, Iceland, May. European Language Resources Association (ELRA). find
- Zaghouani Wajdi , Abdelati Hawwari, Mona Diab (2012). A pilot Propbank annotation for quranic Arabic. In Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature. find
- Zaghouani, W., Mohit, B., Habash, N., Obeid, O., Tomeh,., Rozovskaya, A., Farra, N., Alkuhlani, S., and Oflazer, K. (2014). Large scale arabic error annotation: Guidelines Zaghouani, W. and Charfi, A. (2018). Arap-tweet: A large multi-dialect twitter corpus for gender, age and language variety identification. arXiv preprint arXiv:1808.07674. ↗
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/mulla-2020-building-corpus-qatari-arabic-expressions/