Gulf Arabic Linguistic Resource Building for Sentiment Analysis
Summary
The authors address sentiment analysis for Gulf Arabic, a dialect widely used online but, by their account, not previously studied for this task. Most Arabic NLP tools and lexicons target Modern Standard Arabic (MSA). They argue that Gulf Arabic differs enough in vocabulary, word meaning, syntax and negation that MSA resources do not carry over. Examples include Arabized English, dialect-only words, and forms whose part of speech or even polarity is reversed. Because no Gulf Arabic resources existed, they built two: an annotated corpus and a Gulf Arabic sentiment lexicon. They then ran four Naive Bayes experiments: no lexicon, the MSA lexicon SLSA, the Gulf lexicon, and both lexicons together. The Gulf lexicon raised accuracy above the no-lexicon baseline. The MSA lexicon pushed accuracy below the baseline, and combining the two lexicons also did worse than the Gulf lexicon alone. The authors conclude that, for opinion mining at minimum, every dialect deserves to be handled as a distinct language equipped with dedicated resources. This matters because real web Arabic is mostly dialectal.
Key points
- Accuracy by setting: plain Naive Bayes baseline 82.81%; with the MSA lexicon SLSA 76.83%; with the Gulf Arabic lexicon 90.54%; with both lexicons 84.94%.
- SLSA was built from the MADAMIRA MSA database. Its polarity scores come from linking English glosses to SentiWordNet.
- Lexicon features use thresholds on polarity score:
- 0.5–0.7 counts as a plain positive or negative word, and the normal NB score is kept.
- 0.7 or above counts as a strong word, which is forced to probability near 1 for its own polarity and near 0 for the opposite one.
- Negation is handled by one rule: a clearly polar token (word, emoticon or numeral) that follows a negative particle has its polarity flipped.
- Gulf Arabic has its own negation particles beyond the MSA ones, often written attached to the next word. The particle ما is ambiguous between negation, relative pronoun and question word.
- Some words that are negative in MSA ("terrible", "dangerous") express strong praise in Gulf Arabic, and the intensity is marked by repeating characters.
Interesting ideas
- I1. Add a resource from a neighbouring language variety as a separate ablation arm and check whether it beats the baseline, since a plausible but mismatched resource can actively hurt. — For Mova (learn): Treat each imported lexicon or treebank as an experiment with a "without it" control, and reject it if scores fall below the bare model.
- I2. Mix hard lexicon decisions with soft statistical ones: high-confidence entries override the model, while weaker entries are left to the probabilistic score. — For Mova (frames): Polarity or speech-act cues in prag could be split the same way, with strong lexical triggers deciding outright and the explanation trace recording which tier fired.
- I3. Repeating characters inside a word works as an intensity marker, so normalizing spelling should not erase that signal. — For Mova (tokens): The en tokenizer could map elongated forms like "soooo" to their lemma while keeping an explicit intensity feature for later stages.
- I4. The same surface form can carry opposite sentiment depending on community or register ("conflicting vocabulary"), so lexicon entries should not be assumed universal. — For Mova (world): Value and polarity entries in the compiled knowledge could carry a register or domain tag, letting slang praise like "sick" or "wicked" resolve differently from the literal sense.
- I5. A simple, transparent negation rule flips polarity when a negative particle precedes a polar token, and the authors also note it needs refinement. — For Mova (frames): Mova can do better by flipping polarity along the UD neg dependency rather than by linear adjacency, which keeps the rule explainable but scope-correct.
Institutions
Cite
@inproceedings{adouane2016gulf,
title = {{Gulf Arabic Linguistic Resource Building for Sentiment Analysis}},
author = {Adouane, Wafia and Johansson, Richard},
booktitle = {Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)},
year = {2016},
doi = {10.63317/3qa3f5oi8m9x},
url = {https://doi.org/10.63317/3qa3f5oi8m9x}
}References
- Arfath Pasha, Mohamed Al-Badrashiny, Mona Diab, Ahmed El Kholy, Ramy Eskander, Nizar Habash, Manoj Pooleery, Owen Rambow and Ryan M. Roth. (2014). MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic. In Proceedings of the Language Resources and Evaluation Conference (LREC), Reykjavik, Iceland. find our card
- Diab, M. (2009). Second Generation Tools (AMIRA 2.0): Fast and Robust Tokenization, POS tagging, and Base Phrase Chunking. MEDAR 2 nd International Conference on Arabic Language Resources and Tools, Cairo, Egypt. find
- Ditters, E. (2013). Issues in Arabic Computational Linguistics. In The Oxford Handbook of Arabic Linguistics, Oxford University Press, pp. 213—236. find
- Hossam S. Ibrahim, Sherif M. Abdou and Mervat Gheith. (2015). Sentiment Analysis for Modern Standard Arabic and Colloquial. In International Journal on Natural Language Computing (IJNLC) Vol. 4, No.2. find
- Mohammed Korayem, Mona T. Diab and Muhammad Abdul-Mageed. (2011). Subjectivity and Sentiment Analysis of Modern Standard Arabic. In Proceedings of the 49 th Annual Meeting of the Association for Computational Linguistics: shortpapers, pp. 587—591, Portland, Oregon. find
- Mona Diab, Nizar Habash. (2014). Natural Language Processing for Arabic and its Dialects. In EMNLP, Doha, Qatar Tutorial. find
- Nizar Habash. (2010). Introduction to Arabic Natural Language Processing. Synthesis Lectures on Human Language Technologies, 3(1), 1—187. find
- Nizar Y. Habash. (2010). Introduction to Arabic Natural Language Processing (Synthesis Lectures on Human Language Technologies), Edited by Graeme Hist. find
- Owens, J. (2013). A House of Sound Structure, of Marvelous Form and Proportion: An Introduction. In The Oxford Handbook of Arabic Linguistics, Oxford University Press, pp. 1—21. find
- Ramy Eskander, Owen Rambow. (2015). SLSA: A Sentiment Lexicon for Standard Arabic. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP2015), http://aclweb.org/anthology/D/D15/D15-1304.pdf. ↗
- Versteegh Kees. (2011). Les dialectes arabes. Dictionnaire des langues, p p . 3 3 6—346. Paris: Presses Universitaires de France. find
- Yasir Suleiman. (2013). Arabic Folk Linguistics: Between Mother Tongue and Native Language. In The Oxford Handbook of Arabic Linguistics, Oxford University Press, pp. 264—279. find
This page in Markdown → https://md.research.elamur.ai/free/en/papers/adouane-2016-gulf-arabic-linguistic-resource-building/