Elamur Research⌕
☰
home / papers / RoBERTa: A Robustly Optimized BERT Pretraining… / cited by / page 7

Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 7 of 15 · 601–700 · ← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

1 … 6 7 8 9 10 … 15

  1. Exploring Amharic Sentiment Analysis from Social Media Texts: Building Annotation Tools and Classification ModelsInternational Conference on Computational Linguistics (COLING)Seid Muhie Yimam, Hizkiel Mitiku Alemayehu, Abinew Ayele, et al.2020 · 87 citations
  2. Retrieval-Augmented Generation for Natural Language Processing: A SurveyArtificial Intelligence ReviewShangyu Wu, Ying Xiong, Yufei Cui, et al.2024 · 86 citations
  3. A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and EthicsarXiv:2310.05694Kai He, Rui Mao, Qika Lin, et al.2023 · 86 citations
  4. The Goldilocks of Pragmatic Understanding: Fine-Tuning Strategy Matters for Implicature Resolution by LLMsConference on Neural Information Processing Systems (NeurIPS)Laura Ruis, Akbir Khan, Stella Biderman, et al.2022 · 86 citations
  5. Diagnosing the First-Order Logical Reasoning Ability Through LogicNLIConference on Empirical Methods in Natural Language Processing (EMNLP)Jidong Tian, Yitian Li, Wenqing Chen, et al.2021 · 86 citations
  6. R^3: Reverse, Retrieve, and Rank for Sarcasm Generation with Commonsense KnowledgeAnnual Meeting of the Association for Computational Linguistics (ACL)Tuhin Chakrabarty, Debanjan Ghosh, Smaranda Muresan, et al.2020 · 86 citations
  7. Finding Skill Neurons in Pre-trained Transformer-based Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Xiaozhi Wang, Kaiyue Wen, Zhengyan Zhang, et al.2022 · 85 citations
  8. Co-GAT: A Co-Interactive Graph Attention Network for Joint Dialog Act Recognition and Sentiment ClassificationProceedings of the AAAI Conference on Artificial IntelligenceLibo Qin, Zhouyang Li, Wanxiang Che, et al.2020 · 85 citations
  9. Neural Machine Translation Doesn't Translate Gender Coreference Right Unless You Make ItWorkshop on Gender Bias in Natural Language ProcessingDanielle Saunders, Rosie Sallis, Bill Byrne2020 · 85 citations
  10. ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper ReviewingarXiv:2306.00622Ryan Liu, Nihar B. Shah2023 · 84 citations
  11. Tree of Clarifications: Answering Ambiguous Questions with Retrieval-Augmented Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Gangwoo Kim, Sungdong Kim, Byeongguk Jeon, et al.2023 · 84 citations
  12. The Geometry of Multilingual Language Model RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP)Tyler A. Chang, Zhuowen Tu, Benjamin K. Bergen2022 · 84 citations
  13. DOC: Improving Long Story Coherence With Detailed Outline ControlAnnual Meeting of the Association for Computational Linguistics (ACL)Kevin Yang, Dan Klein, Nanyun Peng, et al.2023 · 83 citations
  14. LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model DevelopmentAnnual Meeting of the Association for Computational Linguistics (ACL)Ilias Chalkidis, Nicolas Garneau, Catalina Goanta, et al.2023 · 83 citations
  15. ORCA: A Challenging Benchmark for Arabic Language UnderstandingFindings of the Association for Computational LinguisticsAbdelRahim Elmadany, ElMoatez Billah Nagoudi, Muhammad Abdul-Mageed2023 · 83 citations
  16. Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
  17. Multilingual LLMs are Better Cross-lingual In-context Learners with AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL)Eshaan Tanwar, Subhabrata Dutta, Manish Borthakur, et al.2023 · 82 citations
  18. Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language ModelsarXiv:2307.14539Erfan Shayegani, Yue Dong, Nael Abu-Ghazaleh2023 · 81 citations
  19. Are Pretrained Language Models Symbolic Reasoners over Knowledge?Conference on Computational Natural Language Learning (CoNLL)Nora Kassner, Benno Krojer, Hinrich Schütze2020 · 81 citations
  20. Large Language Models in Law: A SurveyarXiv:2312.03718Jinqi Lai, Wensheng Gan, Jiayang Wu, et al.2023 · 80 citations
  21. Mitigating Label Biases for In-context LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Yu Fei, Yifan Hou, Zeming Chen, et al.2023 · 80 citations
  22. AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive SummarizationArabic Natural Language Processing Workshop (WANLP)Moussa Kamal Eddine, Nadi Tomeh, Nizar Habash, et al.2022 · 80 citations
  23. Intrinsic Dimension Estimation for Robust Detection of AI-Generated TextsConference on Neural Information Processing Systems (NeurIPS)Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva, et al.2023 · 79 citations
  24. LEGO-Prover: Neural Theorem Proving with Growing LibrariesarXiv:2310.00656Haiming Wang, Huajian Xin, Chuanyang Zheng, et al.2023 · 79 citations
  25. Multilingual Language Models are not Multicultural: A Case Study in EmotionWorkshop on Computational Approaches to Subjectivity, Sentiment and Social Media AnalysisShreya Havaldar, Sunny Rai, Bhumika Singhal, et al.2023 · 79 citations
  26. AraGPT2: Pre-Trained Transformer for Arabic Language GenerationArabic Natural Language Processing Workshop (WANLP)Wissam Antoun, Fady Baly, Hazem Hajj2021 · 79 citations
  27. Language models are not naysayers: An analysis of language models on negation benchmarksJoint Conference on Lexical and Computational Semantics (*SEM)Thinh Hung Truong, Timothy Baldwin, Karin Verspoor, et al.2023 · 78 citations
  28. Explanation-Based Human Debugging of NLP Models: A SurveyTransactions of the Association for Computational Linguistics (TACL)Piyawat Lertvittayakumjorn, Francesca Toni2021 · 77 citations
  29. Measuring Political Bias in Large Language Models: What Is Said and How It Is SaidAnnual Meeting of the Association for Computational Linguistics (ACL)Yejin Bang, Delong Chen, Nayeon Lee, et al.2024 · 76 citations
  30. Lift Yourself Up: Retrieval-augmented Text Generation with Self MemoryConference on Neural Information Processing Systems (NeurIPS)Xin Cheng, Di Luo, Xiuying Chen, et al.2023 · 76 citations
  31. Multi-VALUE: A Framework for Cross-Dialectal English NLPCaleb Ziems, William Held, Jingfeng Yang, et al.2023 · 76 citations
  32. Domain Adaptation with Pre-trained Transformers for Query-Focused Abstractive Text SummarizationComputational LinguisticsMd Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang2022 · 76 citations
  33. WikiAsp: A Dataset for Multi-domain Aspect-based SummarizationTransactions of the Association for Computational Linguistics (TACL)Hiroaki Hayashi, Prashant Budania, Peng Wang, et al.2021 · 76 citations
  34. Benchmarking Large Language Models on Answering and Explaining Challenging Medical QuestionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Hanjie Chen, Zhouxiang Fang, Yash Singla, et al.2025 · 75 citations
  35. GPTEval: A Survey on Assessments of ChatGPT and GPT-4Language Resources and Evaluation Conference (LREC)Rui Mao, Guanyi Chen, Xulang Zhang, et al.2024 · 75 citations
  36. Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long DocumentsarXiv:2310.19923Michael Gunther, Jackmin Ong, Isabelle Mohr, et al.2023 · 75 citations
  37. ReFT: Representation Finetuning for Language ModelsConference on Neural Information Processing Systems (NeurIPS)Zhengxuan Wu, Aryaman Arora, Zheng Wang, et al.2024 · 74 citations
  38. Structural Persistence in Language Models: Priming as a Window into Abstract Language RepresentationsTransactions of the Association for Computational Linguistics (TACL)Arabella Sinclair, Jaap Jumelet, Willem Zuidema, et al.2022 · 74 citations
  39. Annotation Error Detection: Analyzing the Past and Present for a More Coherent FutureJan-Christoph Klie, Bonnie Webber, Iryna Gurevych2023 · 73 citations
  40. Skeleton-of-Thought: Prompting LLMs for Efficient Parallel GenerationarXiv:2307.15337Xuefei Ning, Zinan Lin, Zixuan Zhou, et al.2023 · 72 citations
  41. Unveiling the Implicit Toxicity in Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Jiaxin Wen, Pei Ke, Hao Sun, et al.2023 · 72 citations
  42. The SIGMORPHON 2022 Shared Task on Morpheme SegmentationKhuyagbaatar Batsuren, Gabor Bella, Aryaman Arora2022 · 71 citations
  43. CBLUE: A Chinese Biomedical Language Understanding Evaluation BenchmarkarXiv:2106.08087Ningyu Zhang, Mosha Chen, Zhen Bi, et al.2021 · 71 citations
  44. Conditional Generation with a Question-Answering BlueprintTransactions of the Association for Computational Linguistics (TACL)Shashi Narayan, Joshua Maynez, Reinald Kim Amplayo, et al.2023 · 70 citations
  45. POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance DetectionFindings of the Association for Computational LinguisticsYujian Liu, Xinliang Frederick Zhang, David Wegsman, et al.2022 · 70 citations
  46. English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer TooConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Jason Phang, Iacer Calixto, Phu Mon Htut, et al.2020 · 70 citations
  47. NormBank: A Knowledge Bank of Situational Social NormsAnnual Meeting of the Association for Computational Linguistics (ACL)Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, et al.2023 · 69 citations
  48. Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction TuningarXiv:2309.05444Ted Zadouri, Ahmet Ustun, Arash Ahmadian, et al.2023 · 69 citations
  49. It's All in the Heads: Using Attention Heads as a Baseline for Cross-Lingual Transfer in Commonsense ReasoningFindings of the Association for Computational LinguisticsAlexey Tikhonov, Max Ryabinin2021 · 69 citations
  50. CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for ChinesearXiv:2001.04351Liang Xu, Yu tong, Qianqian Dong, et al.2020 · 69 citations
  51. Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric into a Document-Level MetricConference on Machine Translation (WMT)Giorgos Vernikos, Brian Thompson, Prashant Mathur, et al.2022 · 68 citations
  52. IMPLI: Investigating NLI Models' Performance on Figurative LanguageKevin Stowe, Prasetya Utama, Iryna Gurevych2022 · 68 citations
  53. ArAIEval Shared Task: Persuasion Techniques and Disinformation Detection in Arabic TextArabic Natural Language Processing Conference (ArabicNLP)Maram Hasanain, Firoj Alam, Hamdy Mubarak, et al.2023 · 67 citations
  54. FORK: A Bite-Sized Test Set for Probing Culinary Cultural Biases in Commonsense Reasoning ModelsFindings of the Association for Computational LinguisticsShramay Palta, Rachel Rudinger2023 · 67 citations
  55. The Devil in Linear TransformerConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Qin, Xiaodong Han, Weixuan Sun, et al.2022 · 67 citations
  56. VALUE: Understanding Dialect Disparity in NLUCaleb Ziems, Jiaao Chen, Camille Harris, et al.2022 · 67 citations
  57. CREPE: Open-Domain Question Answering with False PresuppositionsXinyan Yu, Sewon Min, Luke Zettlemoyer, et al.2023 · 66 citations
  58. Dynamic Routing Transformer Network for Multimodal Sarcasm DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Yuan Tian, Nan Xu, Ruike Zhang, et al.2023 · 66 citations
  59. MMSD2.0: Towards a Reliable Multi-modal Sarcasm Detection SystemFindings of the Association for Computational LinguisticsLibo Qin, Shijue Huang, Qiguang Chen, et al.2023 · 65 citations
  60. Evaluation of OpenAI o1: Opportunities and Challenges of AGIarXiv:2409.18486Tianyang Zhong, Zhengliang Liu, Yi Pan, et al.2024 · 64 citations
  61. OpenMoE: An Early Effort on Open Mixture-of-Experts Language ModelsarXiv:2402.01739Fuzhao Xue, Zian Zheng, Yao Fu, et al.2024 · 64 citations
  62. NLPeer: A Unified Resource for the Computational Study of Peer ReviewAnnual Meeting of the Association for Computational Linguistics (ACL)Nils Dycke, Ilia Kuznetsov, Iryna Gurevych2023 · 64 citations
  63. Morphology Matters: A Multilingual Language Modeling AnalysisTransactions of the Association for Computational Linguistics (TACL)Hyunji Hayley Park, Katherine J. Zhang, Coleman Haley, et al.2021 · 64 citations
  64. The Pragmatics behind Politics: Modelling Metaphor, Framing and Emotion in Political DiscourseFindings of the Association for Computational LinguisticsPere-Lluís Huguet Cabot, Verna Dankers, David Abadi, et al.2020 · 64 citations
  65. Cross-document Coreference Resolution over Predicted MentionsFindings of the Association for Computational LinguisticsArie Cattan, Alon Eirew, Gabriel Stanovsky, et al.2021 · 63 citations
  66. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731Shuohuan Wang, Yu Sun, Yang Xiang, et al.2021 · 63 citations
  67. Figurative Language in Recognizing Textual EntailmentFindings of the Association for Computational LinguisticsTuhin Chakrabarty, Debanjan Ghosh, Adam Poliak, et al.2021 · 63 citations
  68. Understanding Transformer Memorization Recall Through IdiomsConference of the European Chapter of the Association for Computational Linguistics (EACL)Adi Haviv, Ido Cohen, Jacob Gidron, et al.2023 · 62 citations
  69. The better your Syntax, the better your Semantics? Probing Pretrained Language Models for the English Comparative CorrelativeConference on Empirical Methods in Natural Language Processing (EMNLP)Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, et al.2022 · 62 citations
  70. Building a Bridge: A Method for Image-Text Sarcasm Detection Without Pretraining on Image-Text DataProceedings of the First International Workshop on Natural Language Processing Beyond TextXinyu Wang, Xiaowen Sun, Tan Yang, et al.2020 · 62 citations
  71. SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online PolarizationInternational Workshop on Semantic Evaluation (SemEval)Usman Naseem, Robert Geislinger, Ada Ren, et al.2026 · 61 citations
  72. Automatic Story Generation: Challenges and AttemptsWorkshop on Narrative UnderstandingAmal Alabdulkarim, Siyan Li, Xiangyu Peng2021 · 61 citations
  73. A Family of Pretrained Transformer Language Models for RussianLanguage Resources and Evaluation Conference (LREC)Dmitry Zmitrovich, Aleksandr Abramov, Andrey Kalmykov, et al.2024 · 60 citations
  74. Making Text Embedders Few-Shot LearnersarXiv:2409.15700Chaofan Li, MingHao Qin, Shitao Xiao, et al.2024 · 60 citations
  75. Evidentiality-guided Generation for Knowledge-Intensive NLP TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Akari Asai, Matt Gardner, Hannaneh Hajishirzi2022 · 60 citations
  76. Improving Multi-Party Dialogue Discourse Parsing via Domain IntegrationWorkshop on Computational Approaches to Discourse (CODI)Zhengyuan Liu, Nancy Chen2021 · 60 citations
  77. mmBERT: A Modern Multilingual Encoder with Annealed Language LearningarXiv:2509.06888Marc Marone, Orion Weller, William Fleshman, et al.2025 · 59 citations
  78. Rho-1: Not All Tokens Are What You NeedarXiv:2404.07965Zhenghao Lin, Zhibin Gou, Yeyun Gong, et al.2024 · 59 citations
  79. Temporal Reasoning in Natural Language InferenceSiddharth Vashishtha, Adam Poliak, Yash Kumar Lal, et al.2020 · 59 citations
  80. LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuningarXiv:2308.03303Longteng Zhang, Lin Zhang, Shaohuai Shi, et al.2023 · 58 citations
  81. Stance Detection on Social Media with Background KnowledgeConference on Empirical Methods in Natural Language Processing (EMNLP)Ang Li, Bin Liang, Jingqian Zhao, et al.2023 · 58 citations
  82. What Does My QA Model Know? Devising Controlled Probes Using Expert KnowledgeTransactions of the Association for Computational Linguistics (TACL)Kyle Richardson, Ashish Sabharwal2020 · 58 citations
  83. Dialect prejudice predicts AI decisions about people's character, employability, and criminalityarXiv:2403.00742Valentin Hofmann, Pratyusha Ria Kalluri, Dan Jurafsky, et al.2024 · 57 citations
  84. AlephBERT: Language Model Pre-training and Evaluation from Sub-Word to Sentence LevelAmit Seker, Elron Bandel, Dan Bareket, et al.2022 · 57 citations
  85. AlephBERT: A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application WithAmit Seker, Elron Bandel, Dan Bareket, et al.2021 · 57 citations
  86. Target-Aware Data Augmentation for Stance DetectionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yingjie Li, Cornelia Caragea2021 · 56 citations
  87. Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNsConference on Empirical Methods in Natural Language Processing (EMNLP)Kanishka Misra, Kyle Mahowald2024 · 55 citations
  88. SciAgent: Tool-augmented Language Models for Scientific ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Yubo Ma, Zhibin Gou, Junheng Hao, et al.2024 · 55 citations
  89. DERA: Enhancing Large Language Model Completions with Dialog-Enabled Resolving AgentsWorkshop on Clinical Natural Language Processing (Clinical NLP) @ LRECVarun Nair, Elliot Schumacher, Geoffrey Tso, et al.2023 · 55 citations
  90. In-context Learning with Retrieved Demonstrations for Language Models: A SurveyarXiv:2401.11624Man Luo, Xin Xu, Yue Liu, et al.2024 · 54 citations
  91. Revise and Resubmit: An Intertextual Model of Text-based Collaboration in Peer ReviewComputational LinguisticsIlia Kuznetsov, Jan Buchmann, Max Eichler, et al.2022 · 54 citations
  92. FewCLUE: A Chinese Few-shot Learning Evaluation BenchmarkarXiv:2107.07498Liang Xu, Xiaojing Lu, Chenyang Yuan, et al.2021 · 54 citations
  93. Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models — A SurveyarXiv:2404.01869Philipp Mondorf, Barbara Plank2024 · 53 citations
  94. A Better Way to Do Masked Language Model ScoringAnnual Meeting of the Association for Computational Linguistics (ACL)Carina Kauf, Anna A. Ivanova2023 · 53 citations
  95. From English To Foreign Languages: Transferring Pre-trained Language ModelsarXiv:2002.07306Ke Tran2020 · 53 citations
  96. Explore, Establish, Exploit: Red Teaming Language Models from ScratcharXiv:2306.09442Stephen Casper, Jason Lin, Joe Kwon, et al.2023 · 52 citations
  97. Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMRJuri Opitz, Anette Frank2021 · 51 citations
  98. ConjNLI: Natural Language Inference Over Conjunctive SentencesConference on Empirical Methods in Natural Language Processing (EMNLP)Swarnadeep Saha, Yixin Nie, Mohit Bansal2020 · 51 citations
  99. Theory-Grounded Measurement of U.S. Social Stereotypes in English Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yang Trista Cao, Anna Sotnikova, Hal Daumé III, et al.2022 · 50 citations
  100. From Word Types to Tokens and Back: A Survey of Approaches to Word Meaning Representation and InterpretationComputational LinguisticsMarianna Apidianaki2023 · 49 citations

1 … 6 7 8 9 10 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/7/