Elamur Research⌕
☰
home / papers / RoBERTa: A Robustly Optimized BERT Pretraining… / cited by / page 4

Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 4 of 15 · 301–400 · ← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

1 2 3 4 5 … 10 … 15

  1. LexGLUE: A Benchmark Dataset for Legal Language Understanding in EnglishAnnual Meeting of the Association for Computational Linguistics (ACL)Ilias Chalkidis, Abhik Jana, Dirk Hartung, et al.2022 · 239 citations
  2. FUDGE: Controlled Text Generation With Future DiscriminatorsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kevin Yang, Dan Klein2021 · 239 citations
  3. CoLAKE: Contextualized Language and Knowledge EmbeddingInternational Conference on Computational Linguistics (COLING)Tianxiang Sun, Yunfan Shao, Xipeng Qiu, et al.2020 · 239 citations
  4. mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Xin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 237 citations
  5. Evaluating Commonsense in Pre-trained Language ModelsProceedings of the AAAI Conference on Artificial IntelligenceXuhui Zhou, Yue Zhang, Leyang Cui, et al.2019 · 235 citations
  6. SemEval-2022 Task 5: Multimedia Automatic Misogyny IdentificationInternational Workshop on Semantic Evaluation (SemEval)Elisabetta Fersini, Francesca Gasparini, Giulia Rizzi, et al.2022 · 234 citations
  7. Self-Guided Contrastive Learning for BERT Sentence RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Taeuk Kim, Kang Min Yoo, Sang-goo Lee2021 · 234 citations
  8. Automatically Identifying Words That Can Serve as Labels for Few-Shot Text ClassificationInternational Conference on Computational Linguistics (COLING)Timo Schick, Helmut Schmid, Hinrich Schütze2020 · 234 citations
  9. How Context Affects Language Models' Factual PredictionsarXiv:2005.04611Fabio Petroni, Patrick Lewis, Aleksandra Piktus, et al.2020 · 234 citations
  10. TweepFake: about Detecting Deepfake TweetsPLoS ONETiziano Fagni, Fabrizio Falchi, Margherita Gambini, et al.2020 · 234 citations
  11. Hurdles to Progress in Long-form Question AnsweringConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kalpesh Krishna, Aurko Roy, Mohit Iyyer2021 · 233 citations
  12. Detecting Hallucinated Content in Conditional Neural Sequence GenerationFindings of the Association for Computational LinguisticsChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 232 citations
  13. Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encodersAnnual Meeting of the Association for Computational Linguistics (ACL)Terra Blevins, Luke Zettlemoyer2020 · 232 citations
  14. Coreferential Reasoning Learning for Language RepresentationConference on Empirical Methods in Natural Language Processing (EMNLP)Deming Ye, Yankai Lin, Jiaju Du, et al.2020 · 228 citations
  15. Learning to Faithfully Rationalize by ConstructionAnnual Meeting of the Association for Computational Linguistics (ACL)Sarthak Jain, Sarah Wiegreffe, Yuval Pinter, et al.2020 · 225 citations
  16. A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL)Pedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot2020 · 222 citations
  17. Reasoning Over Semantic-Level Graph for Fact CheckingAnnual Meeting of the Association for Computational Linguistics (ACL)Wanjun Zhong, Jingjing Xu, Duyu Tang, et al.2020 · 222 citations
  18. Unsupervised Question Decomposition for Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Ethan Perez, Patrick Lewis, Wen-tau Yih, et al.2020 · 222 citations
  19. Structured Pruning Learns Compact and Accurate ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Mengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 221 citations
  20. AlpaGasus: Training A Better Alpaca with Fewer DataarXiv:2307.08701Lichang Chen, Shiyang Li, Jun Yan, et al.2023 · 220 citations
  21. Multilingual Translation from Denoising Pre-TrainingFindings of the Association for Computational LinguisticsYuqing Tang, Chau Tran, Xian Li, et al.2021 · 220 citations
  22. FOLIO: Natural Language Reasoning with First-Order LogicarXiv:2209.00840Simeng Han, Hailey Schoelkopf, Yilun Zhao, et al.2022 · 219 citations
  23. Maieutic Prompting: Logically Consistent Reasoning with Recursive ExplanationsConference on Empirical Methods in Natural Language Processing (EMNLP)Jaehun Jung, Lianhui Qin, Sean Welleck, et al.2022 · 219 citations
  24. SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language ProcessingAnnual Meeting of the Association for Computational Linguistics (ACL)Junyi Ao, Rui Wang, Long Zhou, et al.2022 · 219 citations
  25. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsarXiv:2308.16149Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 218 citations
  26. Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Bill Yuchen Lin, Seyeon Lee, Rahul Khanna, et al.2020 · 218 citations
  27. Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4arXiv:2304.03439Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, et al.2023 · 217 citations
  28. Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LuncharXiv:2311.03099Le Yu, Bowen Yu, Haiyang Yu, et al.2023 · 217 citations
  29. Making Language Models Better Reasoners with Step-Aware VerifierAnnual Meeting of the Association for Computational Linguistics (ACL)Yifei Li, Zeqi Lin, Shizhuo Zhang, et al.2023 · 217 citations
  30. Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language ModelsFindings of the Association for Computational LinguisticsRobert Logan IV, Ivana Balazevic, Eric Wallace, et al.2022 · 216 citations
  31. LLM2Vec: Large Language Models Are Secretly Powerful Text EncodersarXiv:2404.05961Parishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, et al.2024 · 213 citations
  32. Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLParXiv:2103.00453Timo Schick, Sahana Udupa, Hinrich Schutze2021 · 213 citations
  33. An Unsupervised Sentence Embedding Method by Mutual Information MaximizationConference on Empirical Methods in Natural Language Processing (EMNLP)Yan Zhang, Ruidan He, Zuozhu Liu, et al.2020 · 213 citations
  34. Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!Findings of the Association for Computational LinguisticsYubo Ma, Yixin Cao, Yong Hong, et al.2023 · 212 citations
  35. Sources of Hallucination by Large Language Models on Inference TasksFindings of the Association for Computational LinguisticsNick McKenna, Tianyi Li, Liang Cheng, et al.2023 · 212 citations
  36. Explaining Answers with Entailment TreesConference on Empirical Methods in Natural Language Processing (EMNLP)Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, et al.2021 · 211 citations
  37. Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingarXiv:2202.04538Yu Meng, Jiaxin Huang, Yu Zhang, et al.2022 · 210 citations
  38. Prompting GPT-3 To Be ReliablearXiv:2210.09150Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.2022 · 210 citations
  39. Active Example Selection for In-Context LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Yiming Zhang, Shi Feng, Chenhao Tan2022 · 209 citations
  40. Merging Models with Fisher-Weighted AveragingConference on Neural Information Processing Systems (NeurIPS)Michael Matena, Colin Raffel2021 · 208 citations
  41. Optimus: Organizing Sentences via Pre-trained Modeling of a Latent SpaceConference on Empirical Methods in Natural Language Processing (EMNLP)Chunyuan Li, Xiang Gao, Yuan Li, et al.2020 · 208 citations
  42. Training Question Answering Models From Synthetic DataConference on Empirical Methods in Natural Language Processing (EMNLP)Raul Puri, Ryan Spring, Mohammad Shoeybi, et al.2020 · 208 citations
  43. Language Model Tokenizers Introduce Unfairness Between LanguagesConference on Neural Information Processing Systems (NeurIPS)Aleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr, et al.2023 · 206 citations
  44. Automated Concatenation of Embeddings for Structured PredictionAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Wang, Yong Jiang, Nguyen Bach, et al.2021 · 206 citations
  45. Improving Named Entity Recognition by External Context Retrieving and Cooperative LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Xinyu Wang, Yong Jiang, Nguyen Bach, et al.2021 · 206 citations
  46. CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From CharactersInternational Conference on Computational Linguistics (COLING)Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, et al.2020 · 206 citations
  47. On the Effectiveness of Adapter-based Tuning for Pretrained Language Model AdaptationAnnual Meeting of the Association for Computational Linguistics (ACL)Ruidan He, Linlin Liu, Hai Ye, et al.2021 · 204 citations
  48. DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationConference of the European Chapter of the Association for Computational Linguistics (EACL)Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, et al.2023 · 203 citations
  49. Structured Pruning of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ziheng Wang, Jeremy Wohlwend, Tao Lei2020 · 202 citations
  50. A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsFindings of the Association for Computational LinguisticsMd Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.2023 · 200 citations
  51. Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuningConference on Empirical Methods in Natural Language Processing (EMNLP)Runxin Xu, Fuli Luo, Zhiyuan Zhang, et al.2021 · 200 citations
  52. A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and ValidationArtificial Intelligence ReviewXiaowei Huang, Wenjie Ruan, Wei Huang, et al.2023 · 199 citations
  53. Position Information in Transformers: An OverviewComputational LinguisticsPhilipp Dufter, Martin Schmitt, Hinrich Schütze2022 · 198 citations
  54. COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingarXiv:2102.08473Yu Meng, Chenyan Xiong, Payal Bajaj, et al.2021 · 198 citations
  55. Generative Data Augmentation for Commonsense ReasoningFindings of the Association for Computational LinguisticsYiben Yang, Chaitanya Malaviya, Jared Fernandez, et al.2020 · 198 citations
  56. Towards Faithful Model Explanation in NLP: A SurveyComputational LinguisticsQing Lyu, Marianna Apidianaki, Chris Callison-Burch2024 · 197 citations
  57. The Unreliability of Explanations in Few-shot Prompting for Textual ReasoningConference on Neural Information Processing Systems (NeurIPS)Xi Ye, Greg Durrett2022 · 196 citations
  58. Q²: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Or Honovich, Leshem Choshen, Roee Aharoni, et al.2021 · 196 citations
  59. Authorship Attribution for Neural Text GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Adaku Uchendu, Thai Le, Kai Shu, et al.2020 · 196 citations
  60. What Can We Learn from Collective Human Opinions on Natural Language Inference Data?Conference on Empirical Methods in Natural Language Processing (EMNLP)Yixin Nie, Xiang Zhou, Mohit Bansal2020 · 196 citations
  61. Retrieval Augmented Code Generation and SummarizationFindings of the Association for Computational LinguisticsMd Rizwan Parvez, Wasi Ahmad, Saikat Chakraborty, et al.2021 · 193 citations
  62. That is a Known Lie: Detecting Previously Fact-Checked ClaimsAnnual Meeting of the Association for Computational Linguistics (ACL)Shaden Shaar, Nikolay Babulkov, Giovanni Da San Martino, et al.2020 · 193 citations
  63. Auto-Debias: Debiasing Masked Language Models with Automated Biased PromptsAnnual Meeting of the Association for Computational Linguistics (ACL)Yue Guo, Yi Yang, Ahmed Abbasi2022 · 191 citations
  64. Challenges in Automated Debiasing for Toxic Language DetectionConference of the European Chapter of the Association for Computational Linguistics (EACL)Xuhui Zhou, Maarten Sap, Swabha Swayamdipta, et al.2021 · 191 citations
  65. HONEST: Measuring Hurtful Sentence Completion in Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Debora Nozza, Federico Bianchi, Dirk Hovy2021 · 191 citations
  66. When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Benjamin Muller, Antonios Anastasopoulos, Benoît Sagot, et al.2021 · 191 citations
  67. CodeS: Towards Building Open-source Language Models for Text-to-SQLarXiv:2402.16347Haoyang Li, Jing Zhang, Hanbing Liu, et al.2024 · 190 citations
  68. Towards Making the Most of ChatGPT for Machine TranslationFindings of the Association for Computational LinguisticsKeqin Peng, Liang Ding, Qihuang Zhong, et al.2023 · 190 citations
  69. Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.2022 · 190 citations
  70. SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)International Workshop on Semantic Evaluation (SemEval)Shervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 190 citations
  71. Compressing Large-Scale Transformer-Based Models: A Case Study on BERTTransactions of the Association for Computational Linguistics (TACL)Prakhar Ganesh, Yao Chen, Xin Lou, et al.2021 · 190 citations
  72. Enhancing Factual Consistency of Abstractive SummarizationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chenguang Zhu, William Hinthorn, Ruochen Xu, et al.2021 · 190 citations
  73. MuTual: A Dataset for Multi-Turn Dialogue ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Leyang Cui, Yu Wu, Shujie Liu, et al.2020 · 190 citations
  74. GLiNER: Generalist Model for Named Entity Recognition using Bidirectional TransformerConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Urchade Zaratiana, Nadi Tomeh, Pierre Holat, et al.2024 · 189 citations
  75. Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction TuningarXiv:2306.14565Fuxiao Liu, Kevin Lin, Linjie Li, et al.2023 · 189 citations
  76. Packed Levitated Marker for Entity and Relation ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Deming Ye, Yankai Lin, Peng Li, et al.2022 · 189 citations
  77. SGPT: GPT Sentence Embeddings for Semantic SearcharXiv:2202.08904Niklas Muennighoff2022 · 189 citations
  78. Gradient-based Adversarial Attacks against Text TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Chuan Guo, Alexandre Sablayrolles, Hervé Jégou, et al.2021 · 189 citations
  79. Pre-training via ParaphrasingarXiv:2006.15020Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.2020 · 187 citations
  80. TABBIE: Pretrained Representations of Tabular DataConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Hiroshi Iida, Dung Thai, Varun Manjunatha, et al.2021 · 186 citations
  81. SemEval-2023 Task 10: Explainable Detection of Online SexismInternational Workshop on Semantic Evaluation (SemEval)Hannah Kirk, Wenjie Yin, Bertie Vidgen, et al.2023 · 185 citations
  82. Effective Long-Context Scaling of Foundation ModelsarXiv:2309.16039Wenhan Xiong, Jingyu Liu, Igor Molybog, et al.2023 · 184 citations
  83. NILE : Natural Language Inference with Faithful Natural Language ExplanationsAnnual Meeting of the Association for Computational Linguistics (ACL)Sawan Kumar, Partha Talukdar2020 · 184 citations
  84. Evaluating Large Language Models: A Comprehensive SurveyarXiv:2310.19736Zishan Guo, Renren Jin, Chuang Liu, et al.2023 · 182 citations
  85. Template-free Prompt Tuning for Few-shot NERConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Ruotian Ma, Xin Zhou, Tao Gui, et al.2022 · 182 citations
  86. Open Question Answering over Tables and TextarXiv:2010.10439Wenhu Chen, Ming-Wei Chang, Eva Schlinger, et al.2020 · 182 citations
  87. CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesLanguage Resources and Evaluation Conference (LREC)Thuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 181 citations
  88. Prompt-learning for Fine-grained Entity TypingFindings of the Association for Computational LinguisticsNing Ding, Yulin Chen, Xu Han, et al.2022 · 181 citations
  89. 8-bit Optimizers via Block-wise QuantizationarXiv:2110.02861Tim Dettmers, Mike Lewis, Sam Shleifer, et al.2021 · 181 citations
  90. Thinking about GPT-3 In-Context Learning for Biomedical IE? Think AgainFindings of the Association for Computational LinguisticsBernal Jimenez Gutierrez, Nikolas McNeal, Clayton Washington, et al.2022 · 180 citations
  91. On the Risk of Misinformation Pollution with Large Language ModelsFindings of the Association for Computational LinguisticsYikang Pan, Liangming Pan, Wenhu Chen, et al.2023 · 179 citations
  92. Extending Multilingual BERT to Low-Resource LanguagesarXiv:2004.13640Zihan Wang, Karthikeyan K, Stephen Mayhew, et al.2020 · 179 citations
  93. Pre-training Multilingual Neural Machine Translation by Leveraging Alignment InformationConference on Empirical Methods in Natural Language Processing (EMNLP)Zehui Lin, Xiao Pan, Mingxuan Wang, et al.2020 · 178 citations
  94. What Artificial Neural Networks Can Tell Us About Human Language AcquisitionarXiv:2208.07998Alex Warstadt, Samuel R. Bowman2022 · 177 citations
  95. BASE Layers: Simplifying Training of Large, Sparse ModelsarXiv:2103.16716Mike Lewis, Shruti Bhosale, Tim Dettmers, et al.2021 · 177 citations
  96. Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLPConference of the European Chapter of the Association for Computational Linguistics (EACL)Rob van der Goot, Ahmet Üstün, Alan Ramponi, et al.2021 · 177 citations
  97. Translation Artifacts in Cross-lingual Transfer LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Mikel Artetxe, Gorka Labaka, Eneko Agirre2020 · 176 citations
  98. Debiasing Pre-trained Contextualised EmbeddingsConference of the European Chapter of the Association for Computational Linguistics (EACL)Masahiro Kaneko, Danushka Bollegala2021 · 175 citations
  99. StructBERT: Incorporating Language Structures into Pre-training for Deep Language UnderstandingarXiv:1908.04577Wei Wang, Bin Bi, Ming Yan, et al.2019 · 175 citations
  100. Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL)Sumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, et al.2023 · 174 citations

1 2 3 4 5 … 10 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/4/