Elamur Research⌕
☰
home / papers / 2014 / A Framework for the Classification and Annotation of Multiword Expressions in Dialectal Arabic

A Framework for the Classification and Annotation of Multiword Expressions in Dialectal Arabic

Paper · 2014 · Abdelati Hawwari, Mohammed Attia and Mona Diab

Summary

The paper addresses the lack of lexical resources for multiword expressions (MWEs) in Arabic dialects. Social media and other user-generated content are full of such idioms, collocations and compounds, but existing MWE lexicons mostly cover edited or standard language. The authors present annotation guidelines for a computational lexicon of Egyptian Arabic MWEs (EMWE), containing 7,331 entries gathered from corpora and printed dictionaries.

Their central claim is that no single taxonomy of MWEs is adequate. Instead, each entry is described on several independent levels that coexist rather than compete:

  • pronunciation and orthography,
  • a whole-unit POS,
  • internal structure,
  • lexicographic type,
  • semantic field and lexical relations,
  • degree of idiomaticity,
  • degree of flexibility,
  • usage register,
  • equivalents in Modern Standard Arabic (MSA) and English.

The contribution is the scheme itself, not an evaluated system. It is presented as the first such design for a dialect and as a template for other informal or morphologically rich varieties. It also gives material for studying diglossia between MSA and the dialects.

Key points

  • The lexicon holds 7,331 Egyptian Arabic MWEs spanning nominal, verbal, adverbial, adjectival and prepositional expressions. Romanization uses the Buckwalter scheme.
  • Entries are fully diacritized for Cairene pronunciation, list phonological variants where known, and are spelled following the CODA conventions for dialectal orthography.
  • Each MWE receives a single POS from a small tagset (verb, noun, adjective, adverb, interjection, proper noun, preposition), chosen according to the head word. A separate field records the component pattern, such as verb+preposition+noun or noun+adjective.
  • Two separate three-level scales are used:
    • idiomaticity, after Mel'čuk: full, quasi- and semi-phrasemes;
    • flexibility, after Sag et al.: fixed, semi-fixed and syntactically flexible.
  • Further layers cover semantic fields (e.g. social relations, oaths, occasions, death, trickery, occultism) and the relations synonymy, antonymy and polysemy. Usage labels (e.g. youth, vulgar, taboo, aggressive, women/girls) are inspired by the CALLHOME Egyptian Arabic corpus. Each entry also has an MSA and English equivalent, either a matching MWE or a paraphrase.

Interesting ideas

  • I1. Instead of choosing one "correct" MWE taxonomy, annotate several orthogonal dimensions side by side, so that each downstream consumer can use the view it needs.
  • I2. Idiom entries contain explicit placeholder arguments (a "somebody" slot marked for gender and case), so the lexicon records where open participants attach inside a frozen phrase.
  • I3. Semantic opacity and surface flexibility are measured on separate scales, since an expression can be opaque yet inflect freely, or transparent yet frozen.
  • I4. Usage labels record who typically says an expression and in what tone (youth, vulgar, aggressive), which turns register into lexical data rather than leaving it to guesswork.
  • I5. Equivalents are given as a matching MWE in the target language when one exists, and otherwise as a plain paraphrase.

For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

  • I1 (world): The compiled multiword lexicon could store idiomaticity, flexibility, semantic field and register as separate fields. The world builder and the parser would then each query their own dimension without forcing a single label.
  • I2 (frames): Phrasal-verb and idiom entries could carry typed open slots that map directly to semantic roles. A frame for an idiom like "take someone to task" would then receive its patient from the tree explainably.
  • I3 (tree): Flexibility could decide whether an expression is parsed as one fixed unit (UD fixed/flat) or as a normal internal structure that allows modifiers and inflection. Opacity would separately tell later stages not to compose meaning from the parts.
  • I4 (frames): Register tags on expressions could feed speech-act, politeness and irony detection, giving an explainable reason when an utterance is read as hostile or jocular.
  • I5 (back): Generation and translation through the meta-world could prefer a native idiom when the lexicon lists one and fall back to a literal paraphrase otherwise, keeping output faithful to meaning rather than to words.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

🎓George Washington UniversityWashington · United States51 works · 8,148 citations

 Fields, topics and concepts

📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 works

🧭 Topics 2Research subjects and languages the work is about.Semitic languages · 2,908 worksIdioms & multiword expressions · 217 works

Cite

Cite as Abdelati Hawwari, Mohammed Attia and Mona Diab. 2014. A Framework for the Classification and Annotation of Multiword Expressions in Dialectal Arabic. Proceedings of the EMNLP 2014 Workshop on Arabic Natural Language Processing (ANLP).

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.3115/v1/w14-3606

@inproceedings{hawwari2014framework,
  title = {{A Framework for the Classification and Annotation of Multiword Expressions in Dialectal Arabic}},
  author = {Abdelati Hawwari, Mohammed Attia and Mona Diab},
  booktitle = {Proceedings of the EMNLP 2014 Workshop on Arabic Natural Language Processing (ANLP)},
  year = {2014},
  doi = {10.3115/v1/w14-3606},
  url = {https://doi.org/10.3115/v1/w14-3606}
}

References

39 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Acosta, Otavio Costa, Aline Villavicencio, Viviane P. Moreira. (2011) Identification and Treatment of Multiword Expressions applied to Information Retrieval. Proceedings of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World (MWE 2011), pages 101–109, Portland, Oregon, USA, 23 June 2011. find
  2. Atkins, B. T. S. and M. Rundell. 2008. The Oxford Guide to Practical Lexicography. Oxford University Press. ↗
  3. Attia, Mohammed, Antonio Toral, Lamia Tounsi, Pavel Pecina and Josef van Genabith. 2010. Automatic Extraction of Arabic Multiword Expressions. COLING 2010 Workshop on Multiword Expressions: from Theory to Applications.
  4. Beijing, China Attia, Mohammed. (2006) Accommodating Multiword Expressions in an Arabic LFG Grammar. In T. Salakoski et al. (Eds.): Advances in Natural Language Processing. FinTAL 2006, Lecture Notes in Computer Science. Vol. 4139, pp. 87 - 98, 2006. Springer-Verlag Berlin Heidelberg. find
  5. Baldwin, T. (2005a). The deep lexical acquisition of English verb-particles. Computer Speech and Language, Special Issue on Multiword Expressions 19 (4), 398–414. find
  6. Baldwin, T. (2005b). Looking for prepositional verbs in corpus data. In Proceedings of the 2nd ACL-SIGSEM Workshop on the Linguistic Dimensions of Prepositions and their Use in Computational Linguistics Formalisms and Applications, Colchester, UK, pp. 115–126. find
  7. Baldwin, Timothy and Su Nam Kim. 2009. Multiword expressions. In Nitin Indurkhya and Fred J. Damerau, editors, Handbook of Natural Language Processing, pages 267–292. CRC Press, Boca Raton, USA, 2nd edition. find
  8. Bannard, C. 2007. A Measure of Syntactic Flexibility for Automatically Identifying Multi Word Expressions in Corpora. Proceedings of A Broader Perspective on Multiword Expressions, Workshop at the ACL 2007 Conference: 1–8. find
  9. Benson, M. 1990. Collocations and general-purpose dictionaries. International Journal of Lexicography, 3(1):23–35. ↗
  10. Bouamor, Dhouha, Nasredine Semmar and Pierre Zweigenbaum. (2011) Improved Statistical Machine Translation Using MultiWord Expressions. International Workshop on Using Linguistic Information for Hybrid Machine Translation LIHMT. find
  11. Barcelona, November 2011 find
  12. Bu, Fan, Xiao-Yan Zhu, and Ming Li. (2011) A New Multiword Expression Metric and Its Applications. In Journal of Computer Science and Technology. 26(1): 3-13, Jan. 2011. ↗
  13. Calzolari, Nicoletta, Charles J. Fillmore, Ralph Grishman, Nancy Ide, Alessandro Lenci, Catherine MacLeod, Antonio Zampolli. (2002) Towards Best Practice for Multiword Expressions in Computational Lexicons. In Proceedings of the Third International Conference on Language Resources and Evaluation (LREC 2002), Las Palmas, Canary Islands, pp. 1934-1940 find
  14. Carpuat, Marine and Mona Diab. (2010) Task-based evaluation of multiword expressions: a pilot study in statistical machine translation. Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Los Angeles, CA. Pp. 242-245. Chafe, Wallace1968. Idiomaticity as an Anomaly in the Chomskyan Paradigm. Foundations of Language 4.109-127. find
  15. da Silva, Edson Marchetti and Renato Rocha Souza. (2012) Information retrieval system using Multiwords Expressions (MWE) as descriptors. JISTEM - Journal of Information Systems and Technology Management. Vol.9 no.2 São Paulo May/Aug. 2012. ↗
  16. Deksne, Daiga, Raivis Skadiņš, and Inguna Skadiņa. a. 2008. Dictionary of Multiword Expressions for Translation into Highly Infliected Languages. In the 6th International Conference on Language Resources and Evaluation (LREC 2008), Marrakech, Morocco. find
  17. Dubremetz, Marie and Joakim Nivre. (2014) Extraction of Nominal Multiword Expressions in French. In proceedings of the 10thWorkshop on Multiword Expressions (MWE 2014), the 14th Conference of the European Chapter of the Association for Computational Linguistics. 26-27 April 2014. Gothenburg, Sweden Eryiğit, Gülşen, Tugay ˙Ilbay Ozan and Arkan Can. (2011) Multiword Expressions in Statistical Dependency Parsing. Proceedings of the Second Workshop on Statistical Parsing of Morphologically Rich Languages. find
  18. Fillmore, C.J., P. Kay, M. O’Connor. (1988) Regularity and idiomaticity in grammatical constructions: the case of let alone. Language, 64, 3, 501– 538. ↗
  19. Gadalla, Hassan, Hanaa Kilany, Howaida Arram, Ashraf Yacoub, Alaa El-Habashi, Amr Shalaby, Krisjanis Karins, Everett Rowson, Robert Mac-Intyre, Paul Kingsbury, David Graff, Cynthia McLemore. (1997) CALLHOME Egyptian Arabic Transcripts. LDC catalog number LDC97T19, ISBN 1-58563-115-9. find
  20. Ghoneim, Mahmoud and Mona Diab. (2013) Multiword Expressions in the context of Statistical Machine Translation. In the Proceedings of IJCNLP 2013, October, Nagoya, Japan. ↗
  21. Gibbs, R. W. (1980). Spilling the beans on understanding and memory for idioms. Memory & Cognition, 8, 449–456. find
  22. Grégoire, Nicole. (2010) DuELME: a Dutch electronic lexicon of multiword expressions. In Language Resources and Evaluation, 44(1-2):23-39 (2010) ↗
  23. Gross, Maurice, 1986. Lexicon-Grammar. The Representation of Compound Words. In COLING-1986 Proceedings, Bonn, pp. 1-6. find
  24. Habash, Nizar, Mona Diab, Owen Rambow (2012). CODA: A Conventional Orthography for Dialectal Arabic. Proceedings of LREC, Istanbul Turkey, May 2012.
  25. Hawwari, Abdelati, Kfir Bar, and Mona Diab (2012). Building an Arabic Multiword Expressions Repository. Proceedings of the NAACL-HLT 2012 Workshop on Computational Linguistics for Literature, Montreal, Canada, June 2012.
  26. Jackendoff, R. (1973). The base rules for prepositional phrases. In A Festschrift for Morris Halle, pp. 345–356. New York, USA: Rinehart and Winston. find
  27. Korkontzelos, Ioannis, and Suresh Manandhar. (2010) Can Recognising Multiword Expressions Improve Shallow Parsing? In proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the ACL, pages 636–644, Los Angeles, California, June 2010. find
  28. Mel’čuk, I. (1998) Collocations and Lexical Functions. In A.P. Cowie (ed.): Phraseology. Theory, Analysis, and Applications, Oxford: Clarendon Press, 23-53. ↗
  29. Mel’čuk, Igor (2004) Verbes supports sans peine. Lingvisticæ Investigationes 27: 2, 203-217. ↗
  30. Nivre, Joakim and Jens Nilsson. 2004. Multiword Units in Syntactic Parsing. InWorkshop on Methodologies and Evaluation of Multiword Units in Real-World Applications, the 4th International Conference on Language Resources and Evaluation (LREC 2004), pp. 39-46. Lisbon, Portugal. find
  31. Odijk, Jan. (2013) Identification and Lexical Representation of Multiword Expressions. In P. Spyns and J. Odijk (eds.), Essential Speech and Language Technology for Dutch, Theory and Applications of Natural Language Processing Palmer, Martha, Dan Gildea, Paul Kingsbury. (2005) The Proposition Bank: An Annotated Corpus of Semantic Roles. Computational Linguistics, 31:1., pp. 71-105. ↗
  32. Ramisch, Carlos, Aline Villavicencio, Christian Boitet, "mwetoolkit: a Framework for Multiword Expression Identification", Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC 2010), Valetta, Malta, May, 2010. find
  33. Sag, I. A., Baldwin, T., Bond, F., Copestake, A., and Flickinger, D. 2002. Multiword Expressions: A Pain in the Neck for NLP. Proceedings of the 3rd International Conference on Intelligent Text Processing and Computational Linguistics, CI-CLING2002: 1–15.
  34. SanJuan, Eric and Fidelia Ibekwe-SanJuan. 2006. Text mining without document context. In Information Processing and Management. Volume 42, Issue 6, pp. 1532-1552. ↗
  35. Schneider, Nathan, Spencer Onuffer, Nora Kazour, Emily Danchik, Michael T. Mordowanec, Henrietta Conrad, and Noah A. Smith. (2014) Comprehensive Annotation of Multiword Expressions in a Social Web Corpus. In Proceedings of the Language Resources and Evaluation Conference (LREC 2014), Reykjavik, Iceland, May 2014.
  36. Shudo, Kosho, Akira Kurahone, and Toshifumi Tanabe. (2011) A Comprehensive Dictionary of Multiword Expressions. Proceedings of HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Portland, Oregon. Volume 1, pp. 161-170 find
  37. Walters, Keith. Diglossia, linguistic variation, and language change in Arabic. 1996. In Eid, Mushira, Perspectives on Arabic Linguistics VIII. ↗
  38. Weller, Marion, Ulrich Heid. (2010) Extraction of German Multiword Expressions from Parsed Corpora Using Context Features. In proceedings of the seventh international conference on Language Resources and Evaluation (LREC), Val-letta, Malta. find
  39. Zaninello, Andrea, Malvina Nissim. (2010) Creation of lexical resources for a characterisation of multiword expressions in Italian. In proceedings of the seventh international conference on Language Resources and Evaluation (LREC), Valletta, Malta find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/hawwari-2014-framework-classification-annotation-multiword-expressions/