Haidar Khan
Haidar Khan has 3 papers in our library, in 2022–2024, most of them on Language models & pretraining, Evaluation & benchmarks, Multilingual & cross-lingual NLP; often with M Saiful Bari, Andy Rosenbaum, Anna Rumshisky.
OpenAlex · ORCID · h-index 11 · 33 works · 718 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 270 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #5856
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 works
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 3 worksEvaluation & benchmarks · 2 worksMultilingual & cross-lingual NLP · 1 work
Works by year
2020s
Papers
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024 · 105 citations)
LLM evaluation results often conflict across studies because each study sets up its experiments differently. - AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model (2022 · 84 citations)
Large language models that learn from a few examples in the prompt have mostly been decoder-only. Their left-to-right attention can be a handicap when the input is long. This Amazon Alexa AI paper asks whether an encoder-decoder model can be an equally strong in-context learner. - When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards (2024 · 74 citations)
The authors, from NCAI (SDAIA, Riyadh), test whether LLM leaderboards built on multiple-choice question (MCQ) benchmarks can be trusted.
All works
- A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and RecommendationsConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tahmid Rahman Laskar, Sawsan Alqahtani, M Saiful Bari, et al.2024 · 105 citations
- AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelarXiv:2208.01448Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.2022 · 84 citations
- When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model LeaderboardsarXiv:2402.01781Norah Alzahrani, Hisham Abdullah Alyahya, Yazeed Alnumay, et al.2024 · 74 citations
- Using multiple ASR hypotheses to boost i18n NLU performance ↗Proceedings of the 17th International Conference on Natural Language Processing (ICON) · no summary yetCharith Peris et al.2020 · 1 citation
Co-authors here
- M Saiful Bari ×2
- Andy Rosenbaum
- Anna Rumshisky
- Areeb Alowisheq
- Charith Peris
- Enamul Hoque
- Faisal Abdulrahman Mirza
- Hisham Abdullah Alyahya
- Md Rizwan Parvez
- Md Tahmid Rahman Laskar
- Mizanur Rahman
- Mohammad Abdullah Matin Khan
Venues
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2024
- Proceedings of the 17th International Conference on Natural Language Processing (ICON)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/haidar-khan/