Elamur Research⌕
☰
home / authors / Lysandre Debut / cited by

Who cites Lysandre Debut

10,234 citations of their works from 9,402 papers of our library (of the 149,439 whose bibliographies we read) · 1,291 with a page here, the most cited first · page 1 of 13 · 1–100 · ← Lysandre Debut

1 2 … 10 … 13

  1. Transformers: State-of-the-Art Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Thomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,755 citations
  2. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
  3. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
  4. LoRA: Low-Rank Adaptation of Large Language ModelsarXiv:2106.09685Edward J. Hu, Yelong Shen, Phillip Wallis, et al.2021 · 8,661 citations
  5. The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
  6. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterarXiv:1910.01108Victor Sanh, Lysandre Debut, Julien Chaumond, et al.2019 · 6,751 citations
  7. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksarXiv:2005.11401Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.2020 · 6,256 citations
  8. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,942 citations
  9. Large language models are zero-shot reasonersConference on Neural Information Processing Systems (NeurIPS)Takeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.2022 · 3,832 citations
  10. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  11. RoFormer: Enhanced Transformer with Rotary Position EmbeddingarXiv:2104.09864Jianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 3,028 citations
  12. QLoRA: Efficient Finetuning of Quantized LLMsConference on Neural Information Processing Systems (NeurIPS)Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, et al.2023 · 2,929 citations
  13. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
  14. SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics (TACL)Mandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,616 citations
  15. Measuring Mathematical Problem Solving With the MATH DatasetarXiv:2103.03874Dan Hendrycks, Collin Burns, Saurav Kadavath, et al.2021 · 2,395 citations
  16. TinyBERT: Distilling BERT for Natural Language UnderstandingFindings of the Association for Computational LinguisticsXiaoqi Jiao, Yichun Yin, Lifeng Shang, et al.2020 · 2,378 citations
  17. TruthfulQA: Measuring How Models Mimic Human FalsehoodsAnnual Meeting of the Association for Computational Linguistics (ACL)Stephanie Lin, Jacob Hilton, Owain Evans2022 · 2,088 citations
  18. High-Resolution Image Synthesis with Latent Diffusion ModelsarXiv:2112.10752Robin Rombach, Andreas Blattmann, Dominik Lorenz, et al.2021 · 1,996 citations
  19. AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated PromptsConference on Empirical Methods in Natural Language Processing (EMNLP)Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, et al.2020 · 1,909 citations
  20. Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language InferenceConference of the European Chapter of the Association for Computational Linguistics (EACL)Timo Schick, Hinrich Schütze2021 · 1,817 citations
  21. COMET: A Neural Framework for MT EvaluationRicardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 1,792 citations
  22. Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
  23. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,756 citations
  24. Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
  25. Multitask Prompted Training Enables Zero-Shot Task GeneralizationarXiv:2110.08207Victor Sanh, Albert Webson, Colin Raffel, et al.2021 · 1,612 citations
  26. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,556 citations
  27. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
  28. Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?Conference on Empirical Methods in Natural Language Processing (EMNLP)Sewon Min, Xinxi Lyu, Ari Holtzman, et al.2022 · 1,444 citations
  29. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsFindings of the Association for Computational LinguisticsSamuel Gehman, Suchin Gururangan, Maarten Sap, et al.2020 · 1,306 citations
  30. A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
  31. CamemBERT: a Tasty French Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,269 citations
  32. What Makes Good In-Context Examples for GPT-3?Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Learning ArchitecturesJiachang Liu, Dinghan Shen, Yizhe Zhang, et al.2022 · 1,256 citations
  33. BERTweet: A pre-trained language model for English TweetsConference on Empirical Methods in Natural Language Processing (EMNLP)Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen2020 · 1,144 citations
  34. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Timo Schick, Hinrich Schütze2021 · 1,132 citations
  35. Evaluating the Factual Consistency of Abstractive Text SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP)Wojciech Kryscinski, Bryan McCann, Caiming Xiong, et al.2020 · 1,120 citations
  36. Quantifying Attention Flow in TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Samira Abnar, Willem Zuidema2020 · 1,064 citations
  37. LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Yaowei Zheng, Richong Zhang, Junhao Zhang, et al.2024 · 1,048 citations
  38. MTEB: Massive Text Embedding BenchmarkConference of the European Chapter of the Association for Computational Linguistics (EACL)Niklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,032 citations
  39. MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.2020 · 1,016 citations
  40. PyTorch 2: Faster Machine Learning Through Dynamic Python Bytecode Transformation and Graph CompilationACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)Jason Ansel, Edward Yang, Horace He, et al.2024 · 946 citations
  41. CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Nikita Nangia, Clara Vania, Rasika Bhalerao, et al.2020 · 897 citations
  42. DocVQA: A Dataset for VQA on Document ImagesarXiv:2007.00398Minesh Mathew, Dimosthenis Karatzas, C.V. Jawahar2020 · 844 citations
  43. MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 839 citations
  44. ERASER: A Benchmark to Evaluate Rationalized NLP ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, et al.2020 · 832 citations
  45. BARTScore: Evaluating Generated Text as Text GenerationarXiv:2106.11520Weizhe Yuan, Graham Neubig, Pengfei Liu2021 · 815 citations
  46. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondACM Transactions on Knowledge Discovery from DataJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 814 citations
  47. In-Context Retrieval-Augmented Language ModelsTransactions of the Association for Computational Linguistics (TACL)Ori Ram, Yoav Levine, Itay Dalmedigos, et al.2023 · 793 citations
  48. GLM-130B: An Open Bilingual Pre-trained ModelarXiv:2210.02414Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 786 citations
  49. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningFindings of the Association for Computational LinguisticsAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 774 citations
  50. Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningConference on Neural Information Processing Systems (NeurIPS)Haokun Liu, Derek Tam, Mohammed Muqeeth, et al.2022 · 754 citations
  51. AdapterHub: A Framework for Adapting TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.2020 · 754 citations
  52. Fact or Fiction: Verifying Scientific ClaimsConference on Empirical Methods in Natural Language Processing (EMNLP)David Wadden, Shanchuan Lin, Kyle Lo, et al.2020 · 709 citations
  53. CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model SocietyConference on Neural Information Processing Systems (NeurIPS)Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, et al.2023 · 706 citations
  54. KILT: a Benchmark for Knowledge Intensive Language TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Fabio Petroni, Aleksandra Piktus, Angela Fan, et al.2020 · 678 citations
  55. A Frustratingly Easy Approach for Entity and Relation ExtractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Danqi Chen2020 · 631 citations
  56. Efficient Intent Detection with Dual Sentence EncodersWorkshop on Natural Language Processing for Conversational AIIñigo Casanueva, Tadas Temčinas, Daniela Gerz, et al.2020 · 628 citations
  57. LayoutLMv2: Multi-modal Pre-training for Visually-rich Document UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Yang Xu, Yiheng Xu, Tengchao Lv, et al.2021 · 627 citations
  58. HybridFlow: A Flexible and Efficient RLHF FrameworkarXiv:2409.19256Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.2024 · 624 citations
  59. Towards a Unified View of Parameter-Efficient Transfer LearningarXiv:2110.04366Junxian He, Chunting Zhou, Xuezhe Ma, et al.2021 · 619 citations
  60. FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
  61. OCR-free Document Understanding TransformerLecture notes in computer scienceGeewook Kim, Teakgyu Hong, Moonbin Yim, et al.2021 · 584 citations
  62. Plug and Play Language Models: A Simple Approach to Controlled Text GenerationarXiv:1912.02164Sumanth Dathathri, Andrea Madotto, Janice Lan, et al.2019 · 578 citations
  63. PhoBERT: Pre-trained language models for VietnameseFindings of the Association for Computational LinguisticsDat Quoc Nguyen, Anh Tuan Nguyen2020 · 571 citations
  64. XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual GeneralizationarXiv:2003.11080Junjie Hu, Sebastian Ruder, Aditya Siddhant, et al.2020 · 558 citations
  65. How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and DetectionarXiv:2301.07597Biyang Guo, Xin Zhang, Ziyuan Wang, et al.2023 · 555 citations
  66. DeCLUTR: Deep Contrastive Learning for Unsupervised Textual RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)John Giorgi, Osvald Nitski, Bo Wang, et al.2021 · 516 citations
  67. SPLADE: Sparse Lexical and Expansion Model for First Stage RankingInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Thibault Formal, Benjamin Piwowarski, Stéphane Clinchant2021 · 512 citations
  68. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timearXiv:2203.05482Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, et al.2022 · 507 citations
  69. DeeBERT: Dynamic Early Exiting for Accelerating BERT InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Ji Xin, Raphael Tang, Jaejun Lee, et al.2020 · 487 citations
  70. ColBERTv2: Effective and Efficient Retrieval via Lightweight Late InteractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Keshav Santhanam, Omar Khattab, Jon Saad-Falcon, et al.2022 · 485 citations
  71. Data Augmentation using Pre-trained Transformer ModelsarXiv:2003.02245Varun Kumar, Ashutosh Choudhary, Eunah Cho2020 · 474 citations
  72. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object DetectionarXiv:2303.05499Shilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.2023 · 472 citations
  73. CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-XACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)Qinkai Zheng, Xiao Xia, Xu Zou, et al.2023 · 465 citations
  74. Text-to-SQL Empowered by Large Language Models: A Benchmark EvaluationProceedings of the VLDB EndowmentDawei Gao, Haibin Wang, Yaliang Li, et al.2023 · 463 citations
  75. From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Anne Lauscher, Vinit Ravishankar, Ivan Vulić, et al.2020 · 463 citations
  76. MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question AnsweringarXiv:2203.14371 · ACM Conference on Health, Inference, and Learning (CHIL) 2022Ankit Pal, Logesh Kumar Umapathi, Malaikannan Sankarasubbu2022 · 462 citations
  77. Large language models are few-shot clinical information extractorsConference on Empirical Methods in Natural Language Processing (EMNLP)Monica Agrawal, Stefan Hegselmann, Hunter Lang, et al.2022 · 454 citations
  78. Pretrained Transformers Improve Out-of-Distribution RobustnessAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Hendrycks, Xiaoyuan Liu, Eric Wallace, et al.2020 · 452 citations
  79. GeDi: Generative Discriminator Guided Sequence GenerationFindings of the Association for Computational LinguisticsBen Krause, Akhilesh Deepak Gotmare, Bryan McCann, et al.2021 · 449 citations
  80. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Phillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 449 citations
  81. Masked Language Model ScoringAnnual Meeting of the Association for Computational Linguistics (ACL)Julian Salazar, Davis Liang, Toan Q. Nguyen, et al.2020 · 447 citations
  82. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied AgentsarXiv:2201.07207Wenlong Huang, Pieter Abbeel, Deepak Pathak, et al.2022 · 443 citations
  83. Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot FlyAnnual Meeting of the Association for Computational Linguistics (ACL)Nora Kassner, Hinrich Schütze2020 · 435 citations
  84. Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware SamplingInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Sebastian Hofstatter, Sheng-Chieh Lin, Jheng-Hong Yang, et al.2021 · 425 citations
  85. Tulu 3: Pushing Frontiers in Open Language Model Post-TrainingarXiv:2411.15124Nathan Lambert, Jacob Morrison, Valentina Pyatkin, et al.2024 · 423 citations
  86. The Hateful Memes Challenge: Detecting Hate Speech in Multimodal MemesarXiv:2005.04790Douwe Kiela, Hamed Firooz, Aravind Mohan, et al.2020 · 420 citations
  87. Factual Probing Is [MASK]: Learning vs. Learning to RecallConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Dan Friedman, Danqi Chen2021 · 415 citations
  88. Mind2Web: Towards a Generalist Agent for the WebConference on Neural Information Processing Systems (NeurIPS)Xiang Deng, Yu Gu, Boyuan Zheng, et al.2023 · 413 citations
  89. True Few-Shot Learning with Language ModelsarXiv:2105.11447Ethan Perez, Douwe Kiela, Kyunghyun Cho2021 · 412 citations
  90. KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social MediaInternational Workshop on Semantic Evaluation (SemEval)Ali Safaya, Moutasem Abdullatif, Deniz Yuret2020 · 411 citations
  91. DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-ExpertsAnnual Meeting of the Association for Computational Linguistics (ACL)Alisa Liu, Maarten Sap, Ximing Lu, et al.2021 · 409 citations
  92. Do Prompt-Based Models Really Understand the Meaning of Their Prompts?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Albert Webson, Ellie Pavlick2022 · 407 citations
  93. UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianbao Xie, Chen Henry Wu, Peng Shi, et al.2022 · 407 citations
  94. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsarXiv:2106.10199Elad Ben-Zaken, Shauli Ravfogel, Yoav Goldberg2021 · 406 citations
  95. LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical ReasoningInternational Joint Conference on Artificial IntelligenceJian Liu, Leyang Cui, Hanmeng Liu, et al.2020 · 404 citations
  96. Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Shamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, et al.2023 · 403 citations
  97. Editing Models with Task ArithmeticarXiv:2212.04089Gabriel Ilharco, Marco Tulio Ribeiro, Mitchell Wortsman, et al.2022 · 402 citations
  98. RULER: What's the Real Context Size of Your Long-Context Language Models?arXiv:2404.06654Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 400 citations
  99. A Simple Language Model for Task-Oriented DialoguearXiv:2005.00796Ehsan Hosseini-Asl, Bryan McCann, Chien-Sheng Wu, et al.2020 · 399 citations
  100. Aligning AI With Shared Human ValuesarXiv:2008.02275Dan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 395 citations

1 2 … 10 … 13

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/lysandre-debut/cited-by/