Botta: An Arabic Dialect Chatbot
Paper · 2016 · Dana Abu Ali and Nizar Habash
Summary
Arabic is poorly served by conversational agents, and its spoken dialects even more so. Dialects have no standard spelling, heavy inflection and ambiguity, and their own conversational formulas. The authors build BOTTA, which they describe as the earliest chatbot able to hold a conversation in a dialect of Arabic. It has a friendly young female persona, speaks Cairene Egyptian Arabic, and recognizes greetings from several other dialects. The authors chose not to learn from corpora, because mixing many speakers' voices would make the persona incoherent. Instead they hand-author the bot in AIML on the Pandorabots platform, partly adapting resources from the English bot Rosie. The knowledge base has three parts:
- AIML category files (greetings, biography)
- set files (countries, dialect-specific month names, offensive words, dialect cues)
- map files (nation2capital, word2proverb, name2gender)
User input is orthographically normalized before pattern matching. An informal trial with three native speakers found the bot entertaining and authentically Egyptian, though sometimes repetitive. The database files are released publicly as a starting base for future Arabic botmasters.
Key points
- BOTTA 1.0 is built in AIML, hosted on Pandorabots (BotID dana33/botta), with database files distributed via the CAMeL lab resources page.
- Input normalization has three rules, partly drawn from CODA: Alif-Maqsura→Ya, Ta-Marbuta→Ha, and Alif-Hamza forms→bare Alif. Citing Eskander et al. (2013), these cover 85.1% of spelling errors in spontaneous typing, and Alif-Hamza errors alone account for 38.5%.
- Gendered responses rely on guessingthegender.aiml. It looks up the user's name in names.set and then in name2gender.map, confirms the guess with the user, and asks directly if the name is unknown.
- Preliminary evaluation used three native speakers (two Egyptian, one Levantine). They praised authenticity and entertainment value but noted repetition and out-of-context remarks.
- Planned work includes corpus-based learning and morphological analysis of input with Egyptian Arabic tools (Pasha et al., 2014) for lemma-based matching. Call Home Egyptian was considered, but its speakers are acquaintances of varied age and gender, which does not match the persona.
Interesting ideas
- I1. Normalize noisy input only for matching while leaving generated output in natural spelling, so robustness does not degrade output quality.
- I2. Idiomatic exchanges like Arabic's modified echo greetings (a greeting answered with a related but different phrase) cannot come from translating another language's bot; they need language-specific pairing tables.
- I3. Infer a hidden attribute (user gender) from a name lexicon, confirm it, and fall back to asking when the name is missing. This is a three-step guess, verify, and defer policy.
- I4. The authors avoided multi-author conversational data because pooled sources would blend inconsistent perspectives into one voice.
- I5. Evaluators were not told the bot's purpose and were asked to guess it, a cheap blind check of whether the system's behaviour conveys its intended role.
For Mova
How these ideas could serve Mova, our small open language model — its files, stages and tests:
- I1 (tokens): Keep a separate matching key (case, spelling-variant, contraction-normalized) next to each token's surface form, so lexicon lookup tolerates noise while the original text stays available for explanation and generation.
- I2 (frames): Store conventional adjacency pairs (greeting/reply, thanks/acknowledgement) as an explicit lexicalized table in the speech-act layer, rather than deriving them compositionally.
- I3 (world): Assign entity gender from name lists with an explicit "unknown" state instead of a forced default, so pronoun coreference can report that it lacks evidence rather than guessing silently.
- I4 (learn): When building silver data from heterogeneous treebanks or LLM teachers, track provenance and check annotation-convention consistency, so training does not average incompatible styles.
- I5 (answer): Have judges infer what a reader's answer was meant to establish without seeing the question type, to test whether explanations are self-evidently on target.
Institutions
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 16,667 worksArtificial Intelligence · 16,194 worksArts and Humanities · 16,039 worksLanguage and Linguistics · 15,891 works
🧭 Topics 2Research subjects and languages the work is about.Semitic languages · 2,908 worksDialogue systems · 624 works
Cite
Cite as Dana Abu Ali and Nizar Habash. 2016. Botta: An Arabic Dialect Chatbot. Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations.
@inproceedings{ali2016botta,
title = {{Botta: An Arabic Dialect Chatbot}},
author = {Dana Abu Ali and Nizar Habash},
booktitle = {Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: System Demonstrations},
year = {2016},
url = {https://aclanthology.org/C16-2044/}
}References
- Eman Saad AlHagbani and Muhammad Badruddin Khan. 2016. Challenges facing the development of the Arabic chatbot. In First International Workshop on Pattern Recognition, pages 100110Y–100110Y. International Society for Optics and Photonics. find
- Ramy Eskander, Nizar Habash, Owen Rambow, and Nadi Tomeh. 2013. Processing Spontaneous Orthography. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), Atlanta, GA. find
- Hassan Gadalla, Hanaa Kilany, Howaida Arram, Ashraf Yacoub, Alaa El-Habashi, Amr Shalaby, Krisjanis Karins, Everett Rowson, Robert MacIntyre, Paul Kingsbury, David Graff, and Cynthia McLemore. 1997. CALLHOME Egyptian Arabic Transcripts. In Linguistic Data Consortium, Philadelphia. find
- Nizar Habash, Abdelhadi Soudi, and Tim Buckwalter. 2007. On Arabic Transliteration. In A. van den Bosch and A. Soudi, editors, Arabic Computational Morphology: Knowledge-based and Empirical Methods. Springer. ↗
- Nizar Habash, Mona Diab, and Owen Rabmow. 2012. Conventional Orthography for Dialectal Arabic. In Proceedings of LREC, Istanbul, Turkey.
- Nizar Habash. 2010. Introduction to Arabic Natural Language Processing. Morgan & Claypool Publishers. ↗
- Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016. A persona-based neural conversation model. arXiv preprint arXiv:1603.06155. ↗
- Arfath Pasha, Mohamed Al-Badrashiny, Ahmed El Kholy, Ramy Eskander, Mona Diab, Nizar Habash, Manoj Pooleery, Owen Rambow, and Ryan Roth. 2014. MADAMIRA: A Fast, Comprehensive Tool for Morphological Analysis and Disambiguation of Arabic. In In Proceedings of LREC, Reykjavik, Iceland.
- Bayan Abu Shawar and Eric Atwell. 2003. Using dialogue corpora to train a chatbot. In Proceedings of the Corpus Linguistics 2003 conference, pages 681–690. ↗
- Abu Shawar and ES Atwell. 2004. An Arabic chatbot giving answers from the Qur’an. In Proceedings of TALN04: XI Conference sur le Traitement Automatique des Langues Naturelles, volume 2, pages 197–202. ATALA. find
- Bayan Abu Shawar. 2011. A chatbot as a natural web interface to Arabic web qa. iJET, 6(1):37–43. find
- Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Margaret Mitchell, Jian-Yun Nie, Jianfeng Gao, and Bill Dolan. 2015. A neural network approach to context-sensitive generation of conversational responses. arXiv preprint arXiv:1506.06714. ↗
- Richard Wallace. 2003. The elements of AIML style. Alice AI Foundation. find
- Wajdi Zaghouani, Behrang Mohit, Nizar Habash, Ossama Obeid, Nadi Tomeh, Alla Rozovskaya, Noura Farra, Sarah Alkuhlani, and Kemal Oflazer. 2014. Large scale Arabic error annotation: Guidelines and framework. In LREC, pages 2362–2369. ↗
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/ali-2016-botta-arabic-dialect-chatbot/