Elamur Research⌕
☰
home / papers / 2022 / A Pilot Study on the Collection and Computational Analysis of Linguistic Differences Amongst Men and Women in a Kuwaiti Arabic WhatsApp Dataset

A Pilot Study on the Collection and Computational Analysis of Linguistic Differences Amongst Men and Women in a Kuwaiti Arabic WhatsApp Dataset

Paper · 2022 · Hesah Aldihan, Robert Gaizauskas and Susan Fitzmaurice

Summary

Kuwaiti Arabic (KA) is a low-resource Gulf dialect with few conversational texts and almost no sociolinguistic work on how men and women write differently. The authors built what they describe as the first gender-labelled corpus of naturally occurring KA conversation. With ethical approval and informed consent, they collected chats from three long-running Kuwaiti book-club WhatsApp groups, anonymised the members, and studied interactional and lexical cues that could later feed a gender classifier. They compared men and women on number of turns, turn length and emoji counts using statistical tests. They then looked qualitatively at which emojis each group used, at words used by only one gender, and at word lengthening. None of the counted features showed a statistically significant gender difference, even though the raw numbers differed noticeably. Emoji choice and elongated words, however, did separate men from women. The work offers a scarce dialect resource and a list of candidate features for future KA gender profiling. It also shows that small samples can make large-looking gaps statistically inconclusive.

Key points

  • The corpus has 4479 turns, 2623 from 28 women and 1856 from 14 men, drawn from three Kuwaiti reading-club WhatsApp groups. The chats were exported after the researcher had been a member for 9 months.
  • Usernames were replaced by pseudonyms that encode gender, such as USER1F. Access to the data is by request to the first author.
  • Raw totals: women used 2144 emojis and 17,388 words; men used 801 emojis and 14,005 words. Per-person spread was wide (women's mean of 94 turns against a median of 29).
  • Women produced 0.057 lengthened words per turn and men 0.037, about 1.5 times as often. Women's elongations had more varied functions (encouraging, agreeing, greeting, missing someone), while men's were mostly laughter and greetings.
  • Few gender-exclusive dialect words appeared, mostly in women's messages, which the authors attribute to the formal book-discussion register. The authors also note limits: small size, gender imbalance and an unrepresentative register.

Interesting ideas

  • I1. Elongated spellings carry a pragmatic function such as laughter, amazement, agreement or greeting, so they should not be treated as noise.
  • I2. Measuring a phenomenon as a per-turn rate (once per 18 vs 28 turns) gives a fairer comparison than raw totals when groups produce very different amounts of text.
  • I3. The study pairs significance tests with qualitative inspection and shows that sizeable raw gaps can still be inconclusive on small, skewed samples.
  • I4. Grouping elongations by communicative purpose turns a surface trick into a signal about what the writer is doing.
  • I5. The authors note that a formal register suppressed the very phenomena they wanted to find. This shows that the domain of a sample shapes which features are even observable.

For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

  • I1 (tokens): Normalise forms like "sooo" or "yeees" to their lemma but keep an emphasis/elongation feature on the token so later stages can still see it.
  • I2 (learn): Report error or phenomenon rates normalised per sentence or per text when comparing parsers or genres with unequal sizes.
  • I3 (learn): Evaluation reports should include significance checks and median-vs-mean views before claiming one parser or rule set beats another on small test sets.
  • I4 (frames): An elongation flag could serve as a cue for speech acts and affect (greeting, agreeing, enthusiasm), feeding speech-act and irony detection in crate prag.
  • I5 (answer): When building QA or reader tests, check that the source texts actually contain the constructions being tested, rather than assuming one genre stands for the language.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

 Fields, topics and concepts

Cite

Cite as Hesah Aldihan, Robert Gaizauskas and Susan Fitzmaurice. 2022. A Pilot Study on the Collection and Computational Analysis of Linguistic Differences Amongst Men and Women in a Kuwaiti Arabic WhatsApp Dataset. Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP).

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.18653/v1/2022.wanlp-1.35

@inproceedings{aldihan2022pilot,
  title = {{A Pilot Study on the Collection and Computational Analysis of Linguistic Differences Amongst Men and Women in a Kuwaiti Arabic WhatsApp Dataset}},
  author = {Hesah Aldihan, Robert Gaizauskas and Susan Fitzmaurice},
  booktitle = {Proceedings of the Seventh Arabic Natural Language Processing Workshop (WANLP)},
  year = {2022},
  doi = {10.18653/v1/2022.wanlp-1.35},
  url = {https://doi.org/10.18653/v1/2022.wanlp-1.35}
}

References

14 references, 3 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Kholoud Alsmearat, Mahmoud Al-Ayyoub, and Riyad Al-Shalabi. 2014. An extensive study of the bag-of-words approach for gender identification of arabic articles. In 2014 IEEE/ACS 11th International Conference on Computer Systems and Applications (AICCSA), pages 601–608. IEEE. find
  2. David Bamman, Jacob Eisenstein, and Tyler Schnoebelen. 2014. Gender identity and lexical variation in social media. Journal of Sociolinguistics, 18(2):135–160. ↗
  3. Angelo Basile, Gareth Dwyer, Maria Medvedeva, Josine Rawee, Hessel Haagsma, and Malvina Nissim. 2017. N-gram: New groningen author-profiling model. arXiv preprint arXiv:1707.03764. ↗
  4. Zhenpeng Chen, Xuan Lu, Wei Ai, Huoran Li, Qiaozhu Mei, and Xuanzhe Liu. 2018. Through a gender lens: Learning usage patterns of emojis from large-scale android users. In Proceedings of the 2018 World Wide Web Conference, pages 763–772. find
  5. Penelope Eckert and Sally McConnell-Ginet. 2013. Language and gender. Cambridge University Press. ↗
  6. Orly Turgeman Goldshmidt and Leonard Weller. 2000. talking emotions: Gender differences in a variety of conversational contexts. Symbolic Interaction, 23(2):117–134. ↗
  7. Janet Holmes and Miriam Meyerhoff. 2008. The handbook of language and gender, volume 25. John Wiley & Sons. find
  8. Shereen Hussein, Mona Farouk, and ElSayed Hemayed. 2019. Gender identification of egyptian dialect in twitter. Egyptian Informatics Journal, 20(2):109–116. ↗
  9. Salam Khalifa, Nizar Habash, Dana Abdulrahim, and Sara Hassan. 2016. A large scale corpus of gulf arabic. arXiv preprint arXiv:1609.02960. ↗
  10. Lia Litosseliti and Jane Sunderland. 2002. Gender identity and discourse analysis, volume 2. John Benjamins Publishing. find
  11. Hamdy Mubarak, Shammur Absar Chowdhury, and Firoj Alam. 2022. Arabgend: Gender analysis and inference on arabic twitter. arXiv preprint arXiv:2203.00271. ↗
  12. Ossama Obeid, Nasser Zalmout, Salam Khalifa, Dima Taji, Mai Oudah, Bashar Alhafni, Go Inoue, Fadhl Eryani, Alexander Erdmann, and Nizar Habash. 2020. CAMeL tools: An open source python toolkit for Arabic natural language processing. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 7022–7032, Marseille, France. European Language Resources Association.
  13. Avi Rosenfeld, Sigal Sina, David Sarne, Or Avidov, and Sarit Kraus. 2016. Whatsapp usage patterns and prediction models. In ICWSM/IUSSP Workshop on Social Media and Demographic Research. find
  14. Shan Wareing. 1996. What do we know about language and gender. In eleventh sociolinguistic symposium, Cardiff, September, pages 5–7. find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/aldihan-2022-pilot-study-collection-computational-analysis/