Arash Ahmadian
Arash Ahmadian has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Multilingual & cross-lingual NLP; often with Acyr Locatelli, Ahmet Ustun, Daniel D'souza.
OpenAlex · h-index 6 · 18 works · 112 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 436 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #4441
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Multilingual & cross-lingual NLP · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier (2024 · 180 citations)
Multilingual LLMs usually do worse outside English and a few high-resource languages, and poor tokenization makes them slower and more expensive for other languages. - Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning (2023 · 66 citations)
Mixture of Experts (MoE) models route inputs to specialized sub-networks while keeping compute constant. However, they are costly because every expert must be stored and, when fine-tuned, updated. Zadouri et al. (Cohere for AI) ask whether MoE can still help in instruction tuning when only a tiny share of weights may…
All works
- Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs · original ↗ · no summary yet · Proceedings of the 62nd Annual Meeting of the Association for Computational…Arash Ahmadian et al.2024 · 201 citations
- Aya Expanse: Combining Research Breakthroughs for a New Multilingual FrontierJohn Dang, Shivalika Singh, Daniel D'souza, et al.arXiv:2412.04261 · 180 citations
- Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction TuningTed Zadouri, Ahmet Ustun, Arash Ahmadian, et al.arXiv:2309.05444 · 66 citations
- The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harm · original ↗ · no summary yet · Proceedings of the 2024 Conference on Empirical Methods in Natural Language…Aakanksha et al.2024 · 47 citations
Co-authors here
Venues
- Proceedings of the 2024 Conference on Empirical Methods in…
- Proceedings of the 62nd Annual Meeting of the Association…
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/arash-ahmadian/