Elamur Research⌕
☰
home / papers / RoBERTa: A Robustly Optimized BERT Pretraining… / cited by / page 5

Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 5 of 15 · 401–500 · ← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

1 … 4 5 6 … 10 … 15

  1. Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy OptimizationarXiv:2210.01241Rajkumar Ramamurthy, Prithviraj Ammanabrolu, Kiante Brantley, et al.2022 · 174 citations
  2. KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Yu Su, Xifeng Yan, et al.2020 · 174 citations
  3. AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-TuningarXiv:2303.10512Qingru Zhang, Minshuo Chen, Alexander Bukharin, et al.2023 · 173 citations
  4. DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated TextFindings of the Association for Computational LinguisticsJinyan Su, Terry Zhuo, Di Wang, et al.2023 · 172 citations
  5. ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Zhiyu Chen, Shiyang Li, Charese Smiley, et al.2022 · 172 citations
  6. Self-training Improves Pre-training for Natural Language UnderstandingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Jingfei Du, Edouard Grave, Beliz Gunel, et al.2021 · 172 citations
  7. SemEval-2021 Task 5: Toxic Spans DetectionInternational Workshop on Semantic Evaluation (SemEval)John Pavlopoulos, Jeffrey Sorensen, Léo Laugier, et al.2021 · 172 citations
  8. Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-SpecificityarXiv:2310.07521Cunxiang Wang, Xiaoze Liu, Yuanhao Yue, et al.2023 · 171 citations
  9. The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive RemediationsConference on Empirical Methods in Natural Language Processing (EMNLP)Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, et al.2023 · 171 citations
  10. Binding Language Models in Symbolic LanguagesarXiv:2210.02875Zhoujun Cheng, Tianbao Xie, Peng Shi, et al.2022 · 170 citations
  11. On Generative Spoken Language Modeling from Raw AudioTransactions of the Association for Computational Linguistics (TACL)Kushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, et al.2021 · 170 citations
  12. GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak PromptsarXiv:2309.10253Jiahao Yu, Xingwei Lin, Zheng Yu, et al.2023 · 169 citations
  13. Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge DistillationFindings of the Association for Computational LinguisticsQingyu Tan, Ruidan He, Lidong Bing, et al.2022 · 169 citations
  14. COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 PandemicAnnual Meeting of the Association for Computational Linguistics (ACL)Arkadiy Saakyan, Tuhin Chakrabarty, Smaranda Muresan2021 · 169 citations
  15. Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingMinh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, et al.2021 · 169 citations
  16. GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via CipherarXiv:2308.06463Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, et al.2023 · 168 citations
  17. Factuality Enhanced Language Models for Open-Ended Text GenerationConference on Neural Information Processing Systems (NeurIPS)Nayeon Lee, Wei Ping, Peng Xu, et al.2022 · 168 citations
  18. QuALITY: Question Answering with Long Input Texts, Yes!Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi, et al.2022 · 167 citations
  19. “I'm sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor DatasetConference on Empirical Methods in Natural Language Processing (EMNLP)Eric Michael Smith, Melissa Hall, Melanie Kambadur, et al.2022 · 167 citations
  20. Label Verbalization and Entailment for Effective Zero and Few-Shot Relation ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP)Oscar Sainz, Oier Lopez de Lacalle, Gorka Labaka, et al.2021 · 167 citations
  21. Structure-Grounded Pretraining for Text-to-SQLConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, et al.2021 · 167 citations
  22. MiniCheck: Efficient Fact-Checking of LLMs on Grounding DocumentsConference on Empirical Methods in Natural Language Processing (EMNLP)Liyan Tang, Philippe Laban, Greg Durrett2024 · 166 citations
  23. AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL)Abteen Ebrahimi, Manuel Mager, Arturo Oncevay, et al.2022 · 164 citations
  24. BabyBERTa: Learning More Grammar With Small-Scale Child-Directed LanguageConference on Computational Natural Language Learning (CoNLL)Philip A. Huebner, Elior Sulem, Fisher Cynthia, et al.2021 · 164 citations
  25. ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language GenerationInternational Joint Conference on Artificial IntelligenceDongling Xiao, Han Zhang, Yukun Li, et al.2020 · 163 citations
  26. On Negative Interference in Multilingual Models: Findings and A Meta-Learning TreatmentConference on Empirical Methods in Natural Language Processing (EMNLP)Zirui Wang, Zachary C. Lipton, Yulia Tsvetkov2020 · 162 citations
  27. ChatGPT as a Factual Inconsistency Evaluator for Text SummarizationarXiv:2303.15621Zheheng Luo, Qianqian Xie, Sophia Ananiadou2023 · 161 citations
  28. Larger-Scale Transformers for Multilingual Masked Language ModelingWorkshop on Representation Learning for NLPNaman Goyal, Jingfei Du, Myle Ott, et al.2021 · 161 citations
  29. PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel ComputationarXiv:2104.12369Wei Zeng, Xiaozhe Ren, Teng Su, et al.2021 · 161 citations
  30. Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionPaloma Jeretic, Alex Warstadt, Suvrat Bhooshan, et al.2020 · 161 citations
  31. MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transferConference on Empirical Methods in Natural Language Processing (EMNLP)Ilias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos2021 · 160 citations
  32. A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
  33. Pix2Struct: Screenshot Parsing as Pretraining for Visual Language UnderstandingarXiv:2210.03347Kenton Lee, Mandar Joshi, Iulia Turc, et al.2022 · 158 citations
  34. SemEval-2020 Task 4: Commonsense Validation and ExplanationInternational Workshop on Semantic Evaluation (SemEval)Cunxiang Wang, Shuailong Liang, Yili Jin, et al.2020 · 158 citations
  35. Understanding tables with intermediate pre-trainingFindings of the Association for Computational LinguisticsJulian Eisenschlos, Syrine Krichene, Thomas Müller2020 · 158 citations
  36. Lawyer LLaMA Technical ReportarXiv:2305.15062Quzhe Huang, Mingxu Tao, Chen Zhang, et al.2023 · 157 citations
  37. RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain DatabasesComputational LinguisticsDongHyun Choi, Myeong Cheol Shin, EungGyun Kim, et al.2021 · 157 citations
  38. Probing Pre-Trained Language Models for Cross-Cultural Differences in ValuesWorkshop on Cross-Cultural Considerations in NLPArnav Arora, Lucie-aimée Kaffee, Isabelle Augenstein2023 · 156 citations
  39. Towards a Cleaner Document-Oriented Multilingual Crawled CorpusLanguage Resources and Evaluation Conference (LREC)Julien Abadji, Pedro Ortiz Suarez, Laurent Romary, et al.2022 · 156 citations
  40. ROSCOE: A Suite of Metrics for Scoring Step-by-Step ReasoningarXiv:2212.07919Olga Golovneva, Moya Chen, Spencer Poff, et al.2022 · 155 citations
  41. CLEVE: Contrastive Pre-training for Event ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Ziqi Wang, Xiaozhi Wang, Xu Han, et al.2021 · 155 citations
  42. Explaining NLP Models via Minimal Contrastive Editing (MiCE)Findings of the Association for Computational LinguisticsAlexis Ross, Ana Marasović, Matthew Peters2021 · 155 citations
  43. Fine-Tuning Language Models with Just Forward PassesConference on Neural Information Processing Systems (NeurIPS)Sadhika Malladi, Tianyu Gao, Eshaan Nichani, et al.2023 · 153 citations
  44. Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path GroundingConference on Empirical Methods in Natural Language Processing (EMNLP)Nouha Dziri, Andrea Madotto, Osmar Zaïane, et al.2021 · 152 citations
  45. Exploring Versatile Generative Language Model Via Parameter-Efficient Transfer LearningFindings of the Association for Computational LinguisticsZhaojiang Lin, Andrea Madotto, Pascale Fung2020 · 152 citations
  46. TORQUE: A Reading Comprehension Dataset of Temporal Ordering QuestionsQiang Ning, Hao Wu, Rujun Han, et al.2020 · 152 citations
  47. Revisiting DocRED - Addressing the False Negative Problem in Relation ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP)Qingyu Tan, Lu Xu, Lidong Bing, et al.2022 · 151 citations
  48. Investigating Pretrained Language Models for Graph-to-Text GenerationWorkshop on Natural Language Processing for Conversational AILeonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, et al.2021 · 151 citations
  49. A Review on Language Models as Knowledge BasesarXiv:2204.06031Badr AlKhamissi, Millicent Li, Asli Celikyilmaz, et al.2022 · 150 citations
  50. CPM: A Large-scale Generative Chinese Pre-trained Language ModelAI OpenZhengyan Zhang, Xu Han, Hao Zhou, et al.2020 · 150 citations
  51. INFOTABS: Inference on Tables as Semi-structured DataAnnual Meeting of the Association for Computational Linguistics (ACL)Vivek Gupta, Maitrey Mehta, Pegah Nokhiz, et al.2020 · 150 citations
  52. BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized DataAnnual Meeting of the Association for Computational Linguistics (ACL)Haoyu Song, Yan Wang, Kaiyan Zhang, et al.2021 · 149 citations
  53. Context-faithful Prompting for Large Language ModelsFindings of the Association for Computational LinguisticsWenxuan Zhou, Sheng Zhang, Hoifung Poon, et al.2023 · 148 citations
  54. Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability CurvaturearXiv:2310.05130Guangsheng Bao, Yanbin Zhao, Zhiyang Teng, et al.2023 · 148 citations
  55. Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and EvaluationFindings of the Association for Computational LinguisticsMarius Mosbach, Tiago Pimentel, Shauli Ravfogel, et al.2023 · 148 citations
  56. Out of Order: How important is the sequential order of words in a sentence in Natural Language Understanding tasks?Findings of the Association for Computational LinguisticsThang Pham, Trung Bui, Long Mai, et al.2021 · 148 citations
  57. OCNLI: Original Chinese Natural Language InferencearXiv:2010.05444Hai Hu, Kyle Richardson, Liang Xu, et al.2020 · 148 citations
  58. AudioLDM: Text-to-Audio Generation with Latent Diffusion ModelsarXiv:2301.12503Haohe Liu, Zehua Chen, Yi Yuan, et al.2023 · 147 citations
  59. Is GPT-3 a Good Data Annotator?arXiv:2212.10450Bosheng Ding, Chengwei Qin, Linlin Liu, et al.2022 · 147 citations
  60. Fast, Effective, and Self-Supervised: Transforming Masked Language Models into Universal Lexical and Sentence EncodersConference on Empirical Methods in Natural Language Processing (EMNLP)Fangyu Liu, Ivan Vulić, Anna Korhonen, et al.2021 · 147 citations
  61. Fact-Checking Complex Claims with Program-Guided ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Liangming Pan, Xiaobao Wu, Xinyuan Lu, et al.2023 · 146 citations
  62. Unified Demonstration Retriever for In-Context LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaonan Li, Kai Lv, Hang Yan, et al.2023 · 146 citations
  63. Quantifying Privacy Risks of Masked Language Models Using Membership Inference AttacksConference on Empirical Methods in Natural Language Processing (EMNLP)Fatemehsadat Mireshghallah, Kartik Goyal, Archit Uniyal, et al.2022 · 146 citations
  64. SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and ArabicIbrahim Abu Farha, Silviu Vlad Oprea, Steven Wilson, et al.2022 · 146 citations
  65. Word-Level Coreference ResolutionConference on Empirical Methods in Natural Language Processing (EMNLP)Vladimir Dobrovolskii2021 · 146 citations
  66. RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-EncoderConference on Empirical Methods in Natural Language Processing (EMNLP)Shitao Xiao, Zheng Liu, Yingxia Shao, et al.2022 · 145 citations
  67. UNQOVERing Stereotyping Biases via Underspecified QuestionsFindings of the Association for Computational LinguisticsTao Li, Daniel Khashabi, Tushar Khot, et al.2020 · 145 citations
  68. MiniLLM: On-Policy Distillation of Large Language ModelsarXiv:2306.08543Yuxian Gu, Li Dong, Furu Wei, et al.2023 · 144 citations
  69. In-Context Learning for Few-Shot Dialogue State TrackingFindings of the Association for Computational LinguisticsYushi Hu, Chia-Hsuan Lee, Tianbao Xie, et al.2022 · 144 citations
  70. Iteratively Prompt Pre-trained Language Models for Chain of ThoughtConference on Empirical Methods in Natural Language Processing (EMNLP)Boshi Wang, Xiang Deng, Huan Sun2022 · 144 citations
  71. Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question GenerationConference of the European Chapter of the Association for Computational Linguistics (EACL)Ji Ma, Ivan Korotkov, Yinfei Yang, et al.2021 · 144 citations
  72. Rethinking with Retrieval: Faithful Large Language Model InferencearXiv:2301.00303Hangfeng He, Hongming Zhang, Dan Roth2023 · 143 citations
  73. Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and FaithfulnessarXiv:2304.11633Bo Li, Gexiang Fang, Yang Yang, et al.2023 · 142 citations
  74. A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Tianyu Liu, Yizhe Zhang, Chris Brockett, et al.2022 · 142 citations
  75. SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and OffenseInternational Workshop on Semantic Evaluation (SemEval)J. A. Meaney, Steven Wilson, Luis Chiruzzo, et al.2021 · 142 citations
  76. Rethinking embedding coupling in pre-trained language modelsarXiv:2010.12821Hyung Won Chung, Thibault Févry, Henry Tsai, et al.2020 · 142 citations
  77. Increasing Faithfulness in Knowledge-Grounded Dialogue with Controllable FeaturesAnnual Meeting of the Association for Computational Linguistics (ACL)Hannah Rashkin, David Reitter, Gaurav Singh Tomar, et al.2021 · 141 citations
  78. Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge BasesAnnual Meeting of the Association for Computational Linguistics (ACL)Boxi Cao, Hongyu Lin, Xianpei Han, et al.2021 · 141 citations
  79. Beat the AI: Investigating Adversarial Human Annotation for Reading ComprehensionTransactions of the Association for Computational Linguistics (TACL)Max Bartolo, Alastair Roberts, Johannes Welbl, et al.2020 · 141 citations
  80. TURINGBENCH: A Benchmark Environment for Turing Test in the Age of Neural Text GenerationFindings of the Association for Computational LinguisticsAdaku Uchendu, Zeyu Ma, Thai Le, et al.2021 · 140 citations
  81. All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational QualityConference on Empirical Methods in Natural Language Processing (EMNLP)William Timkey, Marten van Schijndel2021 · 139 citations
  82. ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Yujia Qin, Yankai Lin, Ryuichi Takanobu, et al.2021 · 139 citations
  83. FaithDial: A Faithful Benchmark for Information-Seeking DialogueTransactions of the Association for Computational Linguistics (TACL)Nouha Dziri, Ehsan Kamalloo, Sivan Milton, et al.2022 · 138 citations
  84. AdaMix: Mixture-of-Adaptations for Parameter-efficient Model TuningConference on Empirical Methods in Natural Language Processing (EMNLP)Yaqing Wang, Sahaj Agarwal, Subhabrata Mukherjee, et al.2022 · 135 citations
  85. Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Wenkai Yang, Lei Li, Zhiyuan Zhang, et al.2021 · 135 citations
  86. UnNatural Language InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, et al.2021 · 135 citations
  87. Affective and Contextual Embedding for Sarcasm DetectionInternational Conference on Computational Linguistics (COLING)Nastaran Babanejad, Heidar Davoudi, Aijun An, et al.2020 · 135 citations
  88. Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and ApproachesarXiv:1904.01172Shane Storks, Qiaozi Gao, Joyce Y. Chai2019 · 135 citations
  89. SAILER: Structure-aware Pre-trained Language Model for Legal Case RetrievalInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Haitao Li, Qingyao Ai, Jia Chen, et al.2023 · 134 citations
  90. When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD DatasetarXiv:2104.08671Lucia Zheng, Neel Guha, Brandon R. Anderson, et al.2021 · 134 citations
  91. Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal DatasetConference on Neural Information Processing Systems (NeurIPS)Peter Henderson, Mark S. Krass, Lucia Zheng, et al.2022 · 133 citations
  92. Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness MetricsTransactions of the Association for Computational Linguistics (TACL)Paula Czarnowska, Yogarshi Vyas, Kashif Shah2021 · 133 citations
  93. Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt CompletionFindings of the Association for Computational LinguisticsKurt Shuster, Mojtaba Komeili, Leonard Adolphs, et al.2022 · 132 citations
  94. What to Pre-Train on? Efficient Intermediate Task SelectionConference on Empirical Methods in Natural Language Processing (EMNLP)Clifton Poth, Jonas Pfeiffer, Andreas Rücklé, et al.2021 · 132 citations
  95. Generalization in NLI: Ways (Not) To Go Beyond Simple HeuristicsWorkshop on Insights from Negative Results in NLPPrajjwal Bhargava, Aleksandr Drozd, Anna Rogers2021 · 131 citations
  96. Syntax-Guided Controlled Generation of ParaphrasesTransactions of the Association for Computational Linguistics (TACL)Ashutosh Kumar, Kabir Ahuja, Raghuram Vadapalli, et al.2020 · 131 citations
  97. A Survey on Recent Advances in LLM-Based Multi-turn Dialogue SystemsACM Computing SurveysZihao Yi, Jiarui Ouyang, Zhe Xu, et al.2024 · 130 citations
  98. Analyzing Transformers in Embedding SpaceAnnual Meeting of the Association for Computational Linguistics (ACL)Guy Dar, Mor Geva, Ankit Gupta, et al.2023 · 130 citations
  99. Controllable Natural Language Generation with Contrastive PrefixesFindings of the Association for Computational LinguisticsJing Qian, Li Dong, Yelong Shen, et al.2022 · 130 citations
  100. An Analysis of Natural Language Inference Benchmarks through the Lens of NegationMd Mosharaf Hossain, Venelin Kovatchev, Pranoy Dutta, et al.2020 · 130 citations

1 … 4 5 6 … 10 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/5/