🧑‍🔬 Sebastian Ruder — all works

47 works · ← Sebastian Ruder

1. Universal Language Model Fine-tuning for Text Classification ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetJeremy Howard, Sebastian Ruder2018 · 4,841 citations
2. An Overview of Multi-Task Learning in Deep Neural NetworksarXiv:1706.05098Sebastian Ruder2017 · 2,520 citations
3. On the Cross-lingual Transferability of Monolingual RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Mikel Artetxe, Sebastian Ruder, Dani Yogatama2020 · 1,179 citations
4. MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 839 citations
5. AdapterHub: A Framework for Adapting TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.2020 · 754 citations
6. XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation ↗International Conference on Machine Learning · no summary yetJunjie Hu et al.2020 · 726 citations
7. Transfer Learning in Natural Language ProcessingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, et al.2019 · 708 citations
8. XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual GeneralizationarXiv:2003.11080Junjie Hu, Sebastian Ruder, Aditya Siddhant, et al.2020 · 558 citations
9. To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks ↗arXiv:1903.05987 · no summary yetMatthew E. Peters, Sebastian Ruder, Noah A. Smith2019 · 522 citations
10. Language Models are Multilingual Chain-of-Thought ReasonersarXiv:2210.03057Freda Shi, Mirac Suzgun, Markus Freitag, et al.2022 · 494 citations
11. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Phillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 449 citations
12. MasakhaNER: Named Entity Recognition for African LanguagesTransactions of the Association for Computational Linguistics (TACL)David Ifeoluwa Adelani, Jade Abbott, Graham Neubig, et al.2021 · 431 citations
13. Long Range Arena: A Benchmark for Efficient TransformersarXiv:2011.04006Yi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 414 citations
14. On the Limitations of Unsupervised Bilingual Dictionary InductionAnnual Meeting of the Association for Computational Linguistics (ACL)Anders Søgaard, Sebastian Ruder, Ivan Vulić2018 · 401 citations
15. A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis ↗Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · no summary yetSebastian Ruder, Parsa Ghaffari, John G. Breslin2016 · 335 citations
16. XTREME-R: Towards More Challenging and Nuanced Multilingual EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Sebastian Ruder, Noah Constant, Jan Botha, et al.2021 · 281 citations
17. How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions ↗ACL 2019 (Florence) · no summary yetGoran Glavas et al.2019 · 277 citations
18. Parameter-efficient Multi-task Fine-tuning for Transformers via Shared HypernetworksAnnual Meeting of the Association for Computational Linguistics (ACL)Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, et al.2021 · 258 citations
19. Strong Baselines for Neural Semi-Supervised Learning under Domain ShiftAnnual Meeting of the Association for Computational Linguistics (ACL)Sebastian Ruder, Barbara Plank2018 · 229 citations
20. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationarXiv:2106.12672Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 186 citations
21. UNKs Everywhere: Adapting Multilingual Language Models to New ScriptsConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2021 · 176 citations
22. MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity RecognitionConference on Empirical Methods in Natural Language Processing (EMNLP)David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, et al.2022 · 151 citations
23. IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetSamuel Cahyawijaya et al.2021 · 150 citations
24. One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetAlham Fikri Aji et al.2022 · 146 citations
25. AfriSenti: A Twitter Sentiment Analysis Benchmark for African LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP)Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, et al.2023 · 143 citations
26. Rethinking embedding coupling in pre-trained language modelsarXiv:2010.12821Hyung Won Chung, Thibault Févry, Henry Tsai, et al.2020 · 142 citations
27. MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual TransferFindings of the Association for Computational LinguisticsAlan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, et al.2021 · 130 citations
28. MultiFiT: Efficient Multi-lingual Language Model Fine-tuning ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetJulian Eisenschlos et al.2019 · 130 citations
29. NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment AnalysisLanguage Resources and Evaluation Conference (LREC)Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, et al.2022 · 127 citations
30. INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis ↗Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · no summary yetSebastian Ruder, Parsa Ghaffari, John G. Breslin2016 · 127 citations
31. ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning ↗arXiv:2111.10952 · no summary yetVamsi Aribandi et al.2021 · 114 citations
32. Unsupervised Cross-Lingual Representation Learning ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts · no summary yetSebastian Ruder, Anders Søgaard, Ivan Vulić2019 · 108 citations
33. A Call for More Rigor in Unsupervised Cross-lingual Learning ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetMikel Artetxe et al.2020 · 104 citations
34. Learning to select data for transfer learning with Bayesian OptimizationConference on Empirical Methods in Natural Language Processing (EMNLP)Sebastian Ruder, Barbara Plank2017 · 97 citations
35. NusaCrowd: Open Source Initiative for Indonesian NLP Resources ↗Findings of the Association for Computational Linguistics: ACL 2023 · no summary yetSamuel Cahyawijaya et al.2023 · 95 citations
36. BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual TransferConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Akari Asai, Sneha Kudugunta, Xinyan Yu, et al.2024 · 86 citations
37. Expanding Pretrained Models to Thousands More Languages via Lexicon-based AdaptationAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyi Wang, Sebastian Ruder, Graham Neubig2022 · 73 citations
38. Multi-view Subword Regularization ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetXinyi Wang, Sebastian Ruder, Graham Neubig2021 · 72 citations
39. Understanding and Mitigating Language Confusion in LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Kelly Marchisio, Wei-Yin Ko, Alexandre Berard, et al.2024 · 57 citations
40. QAmeleon: Multilingual QA with Only 5 ExamplesTransactions of the Association for Computational Linguistics (TACL)Priyanka Agrawal, Chris Alberti, Fantine Huot, et al.2023 · 45 citations
41. Efficient Test Time Adapter Ensembling for Low-resource Language Varieties ↗Findings of the Association for Computational Linguistics: EMNLP 2021 · no summary yetXinyi Wang et al.2021 · 45 citations
42. FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetYanan Zheng et al.2022 · 34 citations
43. M-RewardBench: Evaluating Reward Models in Multilingual SettingsAnnual Meeting of the Association for Computational Linguistics (ACL)Srishti Gureja, Lester James V. Miranda, Shayekh Bin Islam, et al.2025 · 28 citations
44. XTREME-S: Evaluating Cross-lingual Speech Representations ↗Interspeech (USB) · no summary yetAlexis Conneau et al.2022 · 28 citations
45. AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal ArabicFindings of the Association for Computational LinguisticsNathaniel Romney Robinson, Shahd Abdelmoneim, Kelly Marchisio, et al.2025 · 14 citations
46. The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMsFindings of the Association for Computational LinguisticsPiotr Nawrot, Jianing Li, Renjie Huang, et al.2026 · 10 citations
47. Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL ↗Findings of the Association for Computational Linguistics: ACL 2026 · no summary yetZhaofeng Wu et al.2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/sebastian-ruder/works/