Fady Baly
Fady Baly has 3 papers in our library, in 2020–2021, most of them on Semitic languages, Language models & pretraining, Text generation; often with Hazem Hajj, Wissam Antoun.
OpenAlex · h-index 5 · 7 works · 803 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 773 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #1657
Affiliations
Concepts, shelves and topics
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 4Research subjects and languages the work is about.Semitic languages · 3 worksMultilingual & cross-lingual NLP · 1 workLanguage models & pretraining · 1 workText generation · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Transformer and attention · 1 work
Works by year
2020s
Papers
- AraBERT: Transformer-based Model for Arabic Language Understanding (2020 · 1,302 citations)
Arabic has rich morphology, limited NLP resources and little in common with Latin-script languages. As a result, multilingual models such as Google's multilingual BERT represent it poorly. The authors address this by training a BERT model only on Arabic, called AraBERT. It uses the standard BERT-base architecture and… - AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding (2021 · 97 citations)
Earlier Arabic pretrained encoders, including AraBERT, Arabic-BERT and ARBERT, all relied on masked language modeling. - AraGPT2: Pre-Trained Transformer for Arabic Language Generation (2021 · 79 citations)
Arabic NLP had strong pre-trained models for understanding tasks, mostly masked-LM encoders such as AraBERT, but lacked a capable generative model.
All works
- AraBERT: Transformer-based Model for Arabic Language UnderstandingarXiv:2003.00104Wissam Antoun, Fady Baly, Hazem Hajj2020 · 1,302 citations
- AraELECTRA: Pre-Training Text Discriminators for Arabic Language UnderstandingArabic Natural Language Processing Workshop (WANLP)Wissam Antoun, Fady Baly, Hazem Hajj2021 · 97 citations
- AraGPT2: Pre-Trained Transformer for Arabic Language GenerationArabic Natural Language Processing Workshop (WANLP)Wissam Antoun, Fady Baly, Hazem Hajj2021 · 79 citations
- Multi-Task Learning using AraBert for Offensive Language DetectionProceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection · original ↗ · no summary yetMarc Djandji et al.2020 · 42 citations
Co-authors here
- Hazem Hajj ×3
- Wissam Antoun ×3
Venues
- Arabic Natural Language Processing Workshop (WANLP) ×2: WANLP 2021 ×2
- Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/fady-baly/