🧑‍🔬 Who cites Iñigo Lopez-Gazpio

1,199 citations of their works from 1,030 papers of our library (of the 140,884 whose bibliographies we read) · 94 with a page here, the most cited first · ← Iñigo Lopez-Gazpio

1. BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingJacob Devlin, Ming-Wei Chang, Kenton Lee, et al.2019 · 23,422 citations
2. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerColin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 7,433 citations
3. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingAlex Wang, Amanpreet Singh, Julian Michael, et al.2018 · 7,141 citations
4. LoRA: Low-Rank Adaptation of Large Language ModelsEdward J. Hu, Yelong Shen, Phillip Wallis, et al.2021 · 5,972 citations
5. Sentence-BERT: Sentence Embeddings using Siamese BERT-NetworksNils Reimers, Iryna Gurevych2019 · 4,838 citations
6. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,921 citations
7. SpanBERT: Improving Pre-training by Representing and Predicting SpansMandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,580 citations
8. SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsAlex Wang, Yada Pruksachatkun, Nikita Nangia, et al.2019 · 2,187 citations
9. Making Pre-trained Language Models Better Few-shot LearnersTianyu Gao, Adam Fisch, Danqi Chen2021 · 1,952 citations
10. DeBERTa: Decoding-enhanced BERT with Disentangled AttentionPengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,800 citations
11. Universal Sentence EncoderDaniel Cer, Yinfei Yang, Sheng-yi Kong, et al.2018 · 1,616 citations
12. Universal Sentence Encoder for EnglishDaniel Cer, Yinfei Yang, Sheng-yi Kong, et al.2018 · 1,544 citations
13. GLM: General Language Model Pretraining with Autoregressive Blank InfillingZhengxiao Du, Yujie Qian, Xiao Liu, et al.2022 · 1,449 citations
14. Language-agnostic BERT Sentence EmbeddingFangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.2020 · 1,412 citations
15. Unified Language Model Pre-training for Natural Language Understanding and GenerationLi Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,389 citations
16. Making Monolingual Sentence Embeddings Multilingual using Knowledge DistillationNils Reimers, Iryna Gurevych2020 · 1,320 citations
17. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingPengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,316 citations
18. What Makes Good In-Context Examples for GPT-3?Jiachang Liu, Dinghan Shen, Yizhe Zhang, et al.2022 · 1,235 citations
19. Bias and Fairness in Large Language Models: A SurveyIsabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.2023 · 1,072 citations
20. MTEB: Massive Text Embedding BenchmarkNiklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,021 citations
21. MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesZhiqing Sun, Hongkun Yu, Xiaodan Song, et al.2020 · 1,003 citations
22. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, et al.2020 · 944 citations
23. C-Pack: Packed Resources For General Chinese EmbeddingsShitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 920 citations
24. SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused EvaluationDaniel Cer, Mona Diab, Eneko Agirre, et al.2017 · 907 citations
25. On the Sentence Embeddings from Pre-trained Language ModelsBohan Li, Hao Zhou, Junxian He, et al.2020 · 830 citations
26. SentEval: An Evaluation Toolkit for Universal Sentence RepresentationsAlexis Conneau, Douwe Kiela2018 · 739 citations
27. Revealing the Dark Secrets of BERTOlga Kovaleva, Alexey Romanov, Anna Rogers, et al.2019 · 737 citations
28. Analysis Methods in Neural Language Processing: A SurveyYonatan Belinkov, James Glass2019 · 735 citations
29. ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation TransferYuanmeng Yan, Rumei Li, Sirui Wang, et al.2021 · 647 citations
30. Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text ModelsJianmo Ni, Gustavo Hernandez Abrego, Noah Constant, et al.2021 · 582 citations
31. Multilingual Universal Sentence Encoder for Semantic RetrievalYinfei Yang, Daniel Cer, Amin Ahmad, et al.2020 · 571 citations
32. DeCLUTR: Deep Contrastive Learning for Unsupervised Textual RepresentationsJohn Giorgi, Osvald Nitski, Bo Wang, et al.2021 · 513 citations
33. ParaNMT-50M: Pushing the Limits of Paraphrastic Sentence Embeddings with Millions of Machine TranslationsJohn Wieting, Kevin Gimpel2018 · 503 citations
34. Sentence Encoders on STILTs: Supplementary Training on Intermediate Labeled-data TasksJason Phang, Thibault Févry, Samuel R. Bowman2018 · 490 citations
35. LinkBERT: Pretraining Language Models with Document LinksMichihiro Yasunaga, Jure Leskovec, Percy Liang2022 · 452 citations
36. Pretrained Transformers Improve Out-of-Distribution RobustnessDan Hendrycks, Xiaoyuan Liu, Eric Wallace, et al.2020 · 442 citations
37. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied AgentsWenlong Huang, Pieter Abbeel, Deepak Pathak, et al.2022 · 420 citations
38. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsElad Ben-Zaken, Shauli Ravfogel, Yoav Goldberg2021 · 388 citations
39. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingHangbo Bao, Li Dong, Furu Wei, et al.2020 · 380 citations
40. Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic CoherenceFederico Bianchi, Silvia Terragni, Dirk Hovy2021 · 365 citations
41. Revisiting Few-sample BERT Fine-tuningTianyi Zhang, Felix Wu, Arzoo Katiyar, et al.2020 · 361 citations
42. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale TransformersZhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, et al.2022 · 301 citations
43. SPoT: Better Frozen Model Adaptation through Soft Prompt TransferTu Vu, Brian Lester, Noah Constant, et al.2022 · 300 citations
44. Muppet: Massive Multi-task Representations with Pre-FinetuningArmen Aghajanyan, Anchit Gupta, Akshat Shrivastava, et al.2021 · 299 citations
45. SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized OptimizationHaoming Jiang, Pengcheng He, Weizhu Chen, et al.2020 · 291 citations
46. AlignScore: Evaluating Factual Consistency with A Unified Alignment FunctionYuheng Zha, Yichi Yang, Ruichen Li, et al.2023 · 280 citations
47. BAM! Born-Again Multi-Task Networks for Natural Language UnderstandingKevin Clark, Minh-Thang Luong, Urvashi Khandelwal, et al.2019 · 279 citations
48. Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring TasksNandan Thakur, Nils Reimers, Johannes Daxenberger, et al.2021 · 275 citations
49. DiffCSE: Difference-based Contrastive Learning for Sentence EmbeddingsYung-Sung Chuang, Rumen Dangovski, Hongyin Luo, et al.2022 · 269 citations
50. A Continuously Growing Dataset of Sentential ParaphrasesWuwei Lan, Siyu Qiu, Hua He, et al.2017 · 265 citations
51. Condenser: a Pre-training Architecture for Dense RetrievalLuyu Gao, Jamie Callan2021 · 261 citations
52. Measuring and Reducing Gendered Correlations in Pre-trained ModelsKellie Webster, Xuezhi Wang, Ian Tenney, et al.2020 · 252 citations
53. Generating Datasets with Pretrained Language ModelsTimo Schick, Hinrich Schutze2021 · 250 citations
54. Curriculum Learning for Natural Language UnderstandingBenfeng Xu, Licheng Zhang, Zhendong Mao, et al.2020 · 239 citations
55. mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalXin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 236 citations
56. Self-Guided Contrastive Learning for BERT Sentence RepresentationsTaeuk Kim, Kang Min Yoo, Sang-goo Lee2021 · 234 citations
57. Beyond BLEU: Training Neural Machine Translation with Semantic SimilarityJohn Wieting, Taylor Berg-Kirkpatrick, Kevin Gimpel, et al.2019 · 220 citations
58. NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding ModelsChankyu Lee, Rajarshi Roy, Mengyao Xu, et al.2024 · 219 citations
59. Structured Pruning Learns Compact and Accurate ModelsMengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 216 citations
60. An Unsupervised Sentence Embedding Method by Mutual Information MaximizationYan Zhang, Ruidan He, Zuozhu Liu, et al.2020 · 213 citations
61. Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LunchLe Yu, Bowen Yu, Haiyang Yu, et al.2023 · 209 citations
62. AraT5: Text-to-Text Transformers for Arabic Language GenerationEl Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed2022 · 201 citations
63. COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingYu Meng, Chenyan Xiong, Payal Bajaj, et al.2021 · 196 citations
64. Structured Pruning of Large Language ModelsZiheng Wang, Jeremy Wohlwend, Tao Lei2020 · 196 citations
65. Exploring and Predicting Transferability across NLP TasksTu Vu, Tong Wang, Tsendsuren Munkhdalai, et al.2020 · 192 citations
66. Merging Models with Fisher-Weighted AveragingMichael Matena, Colin Raffel2021 · 190 citations
67. SGPT: GPT Sentence Embeddings for Semantic SearchNiklas Muennighoff2022 · 187 citations
68. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationYi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 179 citations
69. Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLPRob van der Goot, Ahmet Üstün, Alan Ramponi, et al.2021 · 177 citations
70. Debiasing Pre-trained Contextualised EmbeddingsMasahiro Kaneko, Danushka Bollegala2021 · 174 citations
71. Controllable Paraphrase Generation with a Syntactic ExemplarMingda Chen, Qingming Tang, Sam Wiseman, et al.2019 · 173 citations
72. Deduplicating Training Data Mitigates Privacy Risks in Language ModelsNikhil Kandpal, Eric Wallace, Colin Raffel2022 · 166 citations
73. Sustainable Modular Debiasing of Language ModelsAnne Lauscher, Tobias Lueken, Goran Glavaš2021 · 165 citations
74. Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and ApproachesShane Storks, Qiaozi Gao, Joyce Y. Chai2019 · 134 citations
75. Extracting Latent Steering Vectors from Pretrained Language ModelsNishant Subramani, Nivedita Suresh, Matthew Peters2022 · 131 citations
76. I-BERT: Integer-only BERT QuantizationSehoon Kim, Amir Gholami, Zhewei Yao, et al.2021 · 118 citations
77. Pretraining Language Models with Human PreferencesTomasz Korbak, Kejian Shi, Angelica Chen, et al.2023 · 117 citations
78. JGLUE: Japanese General Language Understanding EvaluationKentaro Kurihara, Daisuke Kawahara, Tomohide Shibata2022 · 90 citations
79. AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language ModelsHarish Tayyar Madabushi, Edward Gow-Smith, Carolina Scarton, et al.2021 · 86 citations
80. Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality TransferEleftheria Briakou, Sweta Agrawal, Joel Tetreault, et al.2021 · 49 citations
81. Weisfeiler-Leman in the Bamboo: Novel AMR Graph Metrics and a Benchmark for AMR Graph SimilarityJuri Opitz, Angel Daza, Anette Frank2021 · 47 citations
82. ParaAMR: A Large-Scale Syntactically Diverse Paraphrase Dataset by AMR Back-TranslationKuan-Hao Huang, Varun Iyer, I-Hung Hsu, et al.2023 · 24 citations
83. DADA: Dialect Adaptation via Dynamic Aggregation of Linguistic RulesYanchen Liu, William Held, Diyi Yang2023 · 20 citations
84. AR-ASAG An ARabic Dataset for Automatic Short Answer Grading EvaluationLeila Ouahrani, Djamal Bennouar2020 · 18 citations
85. Deep Contextualized Pairwise Semantic Similarity for Arabic Language QuestionsHesham Al-Bataineh, Wael Farhan, Ahmad Mustafa, et al.2019 · 15 citations
86. Edition 2.0 of the PARSEME shared task on multilingual identification and paraphrasing of multiword expressionsManon Scholivet, Agata Savary, Carlos Ramisch, et al.2026 · 9 citations
87. New Encoders for German Trained from Scratch: Comparing ModernGBERT with Converted LLM2Vec ModelsJulia Wunderle, Anton Ehrmanntraut, Jan Pfister, et al.2026 · 7 citations
88. GATE: General Arabic Text Embedding for Enhanced Semantic Textual Similarity with Matryoshka Representation Learning and Hybrid Loss TrainingOmer Nacar, Anis Koubaa, Serry Sibaee, et al.2025 · 7 citations
89. Challenging the Transformer-based models with a Classical Arabic dataset: Quran and HadithShatha Altammami, Eric Atwell2022 · 6 citations
90. Explainable Semantic Textual Similarity via Dissimilar Span DetectionDiego Miguel Lozano, Daryna Dementieva, Alexander Fraser2026 · 1 citation
91. Mitigating Language Bias in Multilingual Sentence Embeddings for Cross-Lingual Similarity EstimationKanade Nonomura, Keita Fukushima, Risa Kondo, et al.2026 · 1 citation
92. A Recipe for Adapting Multilingual Embedders to OCR-Error Robustness and Historical TextsAndrianos Michail, Stylianos Psychias, Juri Opitz, et al.2026
93. Detecting Experiential Intertextuality Across Migration Routes: Beyond Surface Similarity in French NarrativesSakayo Toadoum Sari, Nelly Robin, Michelle Auzanneau, et al.2026
94. Paraphrasing as Zero-shot Translation with Feature-guided Diversity EnhancementZiyue Yan, Hongying Zan, Xinglin Lyu, et al.2026

936 more citing papers of our library have no page here yet.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/inigo-lopez-gazpio/cited-by/