Elamur Research⌕
☰
home / papers / RoBERTa: A Robustly Optimized BERT Pretraining… / cited by / page 6

Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 6 of 15 · 501–600 · ← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

1 … 5 6 7 … 10 … 15

  1. MAGE: Machine-generated Text Detection in the WildAnnual Meeting of the Association for Computational Linguistics (ACL)Yafu Li, Qintong Li, Leyang Cui, et al.2024 · 129 citations
  2. Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction BenchmarkNatural Legal Language Processing WorkshopJoel Niklaus, Ilias Chalkidis, Matthias Stürmer2021 · 129 citations
  3. Open-Domain Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Danqi Chen, Wen-tau Yih2020 · 129 citations
  4. Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled DataFindings of the Association for Computational LinguisticsKashun Shum, Shizhe Diao, Tong Zhang2023 · 128 citations
  5. MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual DataAnnual Meeting of the Association for Computational Linguistics (ACL)Yilun Zhao, Yunxiang Li, Chenying Li, et al.2022 · 128 citations
  6. A Comprehensive Assessment of Dialog Evaluation MetricsThe First Workshop on Evaluations and Assessments of Neural Conversation SystemsYi-Ting Yeh, Maxine Eskenazi, Shikib Mehri2021 · 128 citations
  7. Zero-shot Event Extraction via Transfer Learning: Challenges and InsightsAnnual Meeting of the Association for Computational Linguistics (ACL)Qing Lyu, Hongming Zhang, Elior Sulem, et al.2021 · 128 citations
  8. NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment AnalysisLanguage Resources and Evaluation Conference (LREC)Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, et al.2022 · 127 citations
  9. Exposing the limits of Zero-shot Cross-lingual Hate Speech DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Debora Nozza2021 · 127 citations
  10. Nomic Embed: Training a Reproducible Long Context Text EmbedderarXiv:2402.01613Zach Nussbaum, John X. Morris, Brandon Duderstadt, et al.2024 · 126 citations
  11. LEVER: Learning to Verify Language-to-Code Generation with ExecutionarXiv:2302.08468Ansong Ni, Srini Iyer, Dragomir Radev, et al.2023 · 126 citations
  12. H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language ModelsarXiv:2306.14048Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.2023 · 124 citations
  13. Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
  14. An Improved Baseline for Sentence-level Relation ExtractionConference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)Wenxuan Zhou, Muhao Chen2022 · 124 citations
  15. ATTEMPT: Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft PromptsConference on Empirical Methods in Natural Language Processing (EMNLP)Akari Asai, Mohammadreza Salehi, Matthew Peters, et al.2022 · 122 citations
  16. Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in ColorConference on Computational Natural Language Learning (CoNLL)Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich, et al.2021 · 122 citations
  17. I-BERT: Integer-only BERT QuantizationInternational Conference on Machine Learning (ICML)Sehoon Kim, Amir Gholami, Zhewei Yao, et al.2021 · 122 citations
  18. Pretraining Language Models with Human PreferencesarXiv:2302.08582Tomasz Korbak, Kejian Shi, Angelica Chen, et al.2023 · 121 citations
  19. ParaDetox: Detoxification with Parallel DataAnnual Meeting of the Association for Computational Linguistics (ACL)Varvara Logacheva, Daryna Dementieva, Sergey Ustyantsev, et al.2022 · 121 citations
  20. DocNLI: A Large-scale Dataset for Document-level Natural Language InferenceFindings of the Association for Computational LinguisticsWenpeng Yin, Dragomir Radev, Caiming Xiong2021 · 121 citations
  21. Spotting LLMs With Binoculars: Zero-Shot Detection of Machine-Generated TextarXiv:2401.12070Abhimanyu Hans, Avi Schwarzschild, Valeriia Cherepanova, et al.2024 · 120 citations
  22. Knowledge of cultural moral norms in large language modelsAnnual Meeting of the Association for Computational Linguistics (ACL)Aida Ramezani, Yang Xu2023 · 120 citations
  23. Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer ReviewsarXiv:2403.07183Weixin Liang, Zachary Izzo, Yaohui Zhang, et al.2024 · 119 citations
  24. Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question AnsweringarXiv:2306.04136Jinheon Baek, Alham Fikri Aji, Amir Saffari2023 · 119 citations
  25. Logical Fallacy DetectionFindings of the Association for Computational LinguisticsZhijing Jin, Abhinav Lalwani, Tejas Vaidhya, et al.2022 · 119 citations
  26. Knowledge Enhanced Masked Language Model for Stance DetectionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kornraphop Kawintiranon, Lisa Singh2021 · 119 citations
  27. Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation ExtractorsFindings of the Association for Computational LinguisticsKai Zhang, Bernal Jimenez Gutierrez, Yu Su2023 · 118 citations
  28. Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human EvaluationarXiv:2212.07981Yixin Liu, Alexander R. Fabbri, Pengfei Liu, et al.2022 · 117 citations
  29. Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language ModelarXiv:1912.09637Wenhan Xiong, Jingfei Du, William Yang Wang, et al.2019 · 117 citations
  30. Physics of Language Models: Part 3.1, Knowledge Storage and ExtractionarXiv:2309.14316Zeyuan Allen-Zhu, Yuanzhi Li2023 · 116 citations
  31. Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender BiasWorkshop on Gender Bias in Natural Language ProcessingMarion Bartl, Malvina Nissim, Albert Gatt2020 · 116 citations
  32. Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic FeaturesConference on Empirical Methods in Natural Language Processing (EMNLP)Bruce W. Lee, Yoo Sung Jang, Jason Lee2021 · 115 citations
  33. WNUT-2020 Task 2: Identification of Informative COVID-19 English TweetsWorkshop on Noisy User-generated TextDat Quoc Nguyen, Thanh Vu, Afshin Rahimi, et al.2020 · 115 citations
  34. Testing the Ability of Language Models to Interpret Figurative LanguageConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Emmy Liu, Chenxuan Cui, Kenneth Zheng, et al.2022 · 114 citations
  35. Aspect-Controllable Opinion SummarizationConference on Empirical Methods in Natural Language Processing (EMNLP)Reinald Kim Amplayo, Stefanos Angelidis, Mirella Lapata2021 · 114 citations
  36. WiCE: Real-World Entailment for Claims in WikipediaConference on Empirical Methods in Natural Language Processing (EMNLP)Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, et al.2023 · 113 citations
  37. Efficient Large Scale Language Modeling with Mixtures of ExpertsarXiv:2112.10684Mikel Artetxe, Shruti Bhosale, Naman Goyal, et al.2021 · 113 citations
  38. Logic-Guided Data Augmentation and Regularization for Consistent Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Akari Asai, Hannaneh Hajishirzi2020 · 113 citations
  39. On the Ability and Limitations of Transformers to Recognize Formal LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP)Satwik Bhattamishra, Kabir Ahuja, Navin Goyal2020 · 113 citations
  40. RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Wenkai Yang, Yankai Lin, Peng Li, et al.2021 · 112 citations
  41. Transformer Language Models without Positional Encodings Still Learn Positional InformationarXiv:2203.16634Adi Haviv, Ori Ram, Ofir Press, et al.2022 · 111 citations
  42. Building and Evaluating Open-Domain Dialogue Corpora with Clarifying QuestionsConference on Empirical Methods in Natural Language Processing (EMNLP)Mohammad Aliannejadi, Julia Kiseleva, Aleksandr Chuklin, et al.2021 · 111 citations
  43. RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text DetectorsAnnual Meeting of the Association for Computational Linguistics (ACL)Liam Dugan, Alyssa Hwang, Filip Trhlík, et al.2024 · 110 citations
  44. GPTAraEval: A Comprehensive Evaluation of ChatGPT on Arabic NLPConference on Empirical Methods in Natural Language Processing (EMNLP)Md Tawkat Islam Khondaker, Abdul Waheed, El Moatez Billah Nagoudi, et al.2023 · 110 citations
  45. Copyright Violations and Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Antonia Karamolegkou, Jiaang Li, Li Zhou, et al.2023 · 109 citations
  46. ConSeC: Word Sense Disambiguation as Continuous Sense ComprehensionConference on Empirical Methods in Natural Language Processing (EMNLP)Edoardo Barba, Luigi Procopio, Roberto Navigli2021 · 109 citations
  47. CausaLM: Causal Model Explanation Through Counterfactual Language ModelsComputational LinguisticsAmir Feder, Nadav Oved, Uri Shalit, et al.2021 · 107 citations
  48. An Empirical Study of Pre-trained Transformers for Arabic Information ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP)Wuwei Lan, Yang Chen, Wei Xu, et al.2020 · 107 citations
  49. SimLM: Pre-training with Representation Bottleneck for Dense Passage RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Liang Wang, Nan Yang, Xiaolong Huang, et al.2023 · 106 citations
  50. CDLM: Cross-Document Language ModelingFindings of the Association for Computational LinguisticsAvi Caciularu, Arman Cohan, Iz Beltagy, et al.2021 · 106 citations
  51. Evaluating the Evaluation of Diversity in Natural Language GenerationConference of the European Chapter of the Association for Computational Linguistics (EACL)Guy Tevet, Jonathan Berant2021 · 106 citations
  52. Multi-SimLex: A Large-Scale Evaluation of Multilingual and Crosslingual Lexical Semantic SimilarityComputational LinguisticsIvan Vulić, Simon Baker, Edoardo Maria Ponti, et al.2020 · 106 citations
  53. Towards Generalizable Neuro-Symbolic Systems for Commonsense Question AnsweringProceedings of the First Workshop on Commonsense Inference in Natural Language ProcessingKaixin Ma, Jonathan Francis, Quanyang Lu, et al.2019 · 105 citations
  54. A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & ToxicityarXiv:2305.13169Shayne Longpre, Gregory Yauney, Emily Reif, et al.2023 · 104 citations
  55. LENS: A Learnable Evaluation Metric for Text SimplificationAnnual Meeting of the Association for Computational Linguistics (ACL)Mounica Maddela, Yao Dou, David Heineman, et al.2023 · 104 citations
  56. Investigating Reasons for Disagreement in Natural Language InferenceTransactions of the Association for Computational Linguistics (TACL)Nan-Jiang Jiang, Marie-Catherine de Marneffe2022 · 104 citations
  57. Parsing with Multilingual BERT, a Small Corpus, and a Small TreebankFindings of the Association for Computational LinguisticsEthan C. Chau, Lucy H. Lin, Noah A. Smith2020 · 104 citations
  58. Who Wrote this Code? Watermarking for Code GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Taehyun Lee, Seokhee Hong, Jaewoo Ahn, et al.2024 · 103 citations
  59. AnglE-optimized Text EmbeddingsarXiv:2309.12871Xianming Li, Jing Li2023 · 103 citations
  60. PRover: Proof Generation for Interpretable Reasoning over RulesConference on Empirical Methods in Natural Language Processing (EMNLP)Swarnadeep Saha, Sayan Ghosh, Shashank Srivastava, et al.2020 · 103 citations
  61. Learning to Reason Deductively: Math Word Problem Solving as Complex Relation ExtractionZhanming Jie, Jierui Li, Wei Lu2022 · 102 citations
  62. minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language ModelsarXiv:2203.13112Kanishka Misra2022 · 102 citations
  63. On the Safety of Conversational Models: Taxonomy, Dataset, and BenchmarkFindings of the Association for Computational LinguisticsHao Sun, Guangxuan Xu, Jiawen Deng, et al.2022 · 102 citations
  64. Compression, Transduction, and Creation: A Unified Framework for Evaluating Natural Language GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Mingkai Deng, Bowen Tan, Zhengzhong Liu, et al.2021 · 102 citations
  65. Dataless Knowledge Fusion by Merging Weights of Language ModelsarXiv:2212.09849Xisen Jin, Xiang Ren, Daniel Preotiuc-Pietro, et al.2022 · 101 citations
  66. I like fish, especially dolphins: Addressing Contradictions in Dialogue ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Yixin Nie, Mary Williamson, Mohit Bansal, et al.2021 · 101 citations
  67. Evaluating Attribution in Dialogue Systems: The BEGIN BenchmarkTransactions of the Association for Computational Linguistics (TACL)Nouha Dziri, Hannah Rashkin, Tal Linzen, et al.2022 · 100 citations
  68. VeRA: Vector-based Random Matrix AdaptationarXiv:2310.11454Dawid J. Kopiczko, Tijmen Blankevoort, Yuki M. Asano2023 · 99 citations
  69. Generating Data to Mitigate Spurious Correlations in Natural Language Inference DatasetsAnnual Meeting of the Association for Computational Linguistics (ACL)Yuxiang Wu, Matt Gardner, Pontus Stenetorp, et al.2022 · 99 citations
  70. Provable Robust Watermarking for AI-Generated TextarXiv:2306.17439Xuandong Zhao, Prabhanjan Ananth, Lei Li, et al.2023 · 98 citations
  71. Understanding by Understanding Not: Modeling Negation in Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, et al.2021 · 98 citations
  72. Leap-Of-Thought: Teaching Pre-Trained Models to Systematically Reason Over Implicit KnowledgearXiv:2006.06609Alon Talmor, Oyvind Tafjord, Peter Clark, et al.2020 · 98 citations
  73. LoRA+: Efficient Low Rank Adaptation of Large ModelsarXiv:2402.12354Soufiane Hayou, Nikhil Ghosh, Bin Yu2024 · 97 citations
  74. A Survey of Confidence Estimation and Calibration in Large Language ModelsarXiv:2311.08298Jiahui Geng, Fengyu Cai, Yuxia Wang, et al.2023 · 97 citations
  75. AraELECTRA: Pre-Training Text Discriminators for Arabic Language UnderstandingArabic Natural Language Processing Workshop (WANLP)Wissam Antoun, Fady Baly, Hazem Hajj2021 · 97 citations
  76. Modeling Framing in Immigration Discourse on Social MediaConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Julia Mendelsohn, Ceren Budak, David Jurgens2021 · 97 citations
  77. Are Transformers universal approximators of sequence-to-sequence functions?arXiv:1912.10077Chulhee Yun, Srinadh Bhojanapalli, Ankit Singh Rawat, et al.2019 · 97 citations
  78. The Platonic Representation HypothesisarXiv:2405.07987Minyoung Huh, Brian Cheung, Tongzhou Wang, et al.2024 · 96 citations
  79. MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP)Xiaozhi Wang, Yulin Chen, Ning Ding, et al.2022 · 96 citations
  80. True Few-Shot Learning with Prompts–-A Real-World PerspectiveTransactions of the Association for Computational Linguistics (TACL)Timo Schick, Hinrich Schütze2022 · 96 citations
  81. Cross-Domain Label-Adaptive Stance DetectionConference on Empirical Methods in Natural Language Processing (EMNLP)Momchil Hardalov, Arnav Arora, Preslav Nakov, et al.2021 · 96 citations
  82. Probing Across Time: What Does RoBERTa Know and When?Findings of the Association for Computational LinguisticsLeo Z. Liu, Yizhong Wang, Jungo Kasai, et al.2021 · 96 citations
  83. ChatGPT: Beginning of an End of Manual Linguistic Data Annotation? Use Case of Automatic Genre IdentificationarXiv:2303.03953Taja Kuzman, Igor Mozetič, Nikola Ljubešic2023 · 95 citations
  84. Auto-GPT for Online Decision Making: Benchmarks and Additional OpinionsarXiv:2306.02224Hui Yang, Sifu Yue, Yunzhong He2023 · 94 citations
  85. Efficient Long-Text Understanding with Short-Text ModelsTransactions of the Association for Computational Linguistics (TACL)Maor Ivgi, Uri Shaham, Jonathan Berant2023 · 94 citations
  86. CommonsenseQA 2.0: Exposing the Limits of AI through GamificationarXiv:2201.05320Alon Talmor, Ori Yoran, Ronan Le Bras, et al.2022 · 94 citations
  87. SciFact-Open: Towards open-domain scientific claim verificationFindings of the Association for Computational LinguisticsDavid Wadden, Kyle Lo, Bailey Kuehl, et al.2022 · 94 citations
  88. Tailor: Generating and Perturbing Text with Semantic ControlsAnnual Meeting of the Association for Computational Linguistics (ACL)Alexis Ross, Tongshuang Wu, Hao Peng, et al.2022 · 93 citations
  89. Exploring the Potential of ChatGPT on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse RelationsFindings of the Association for Computational LinguisticsChunkit Chan, Cheng Jiayang, Weiqi Wang, et al.2024 · 92 citations
  90. A Report on the 2020 Sarcasm Detection Shared TaskWorkshop on Figurative Language ProcessingDebanjan Ghosh, Avijit Vajpayee, Smaranda Muresan2020 · 92 citations
  91. WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language modelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Benjamin Minixhofer, Fabian Paischer, Navid Rekabsaz2022 · 91 citations
  92. TransQuest: Translation Quality Estimation with Cross-lingual TransformersInternational Conference on Computational Linguistics (COLING)Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov2020 · 91 citations
  93. Cross-Lingual Consistency of Factual Knowledge in Multilingual Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Jirui Qi, Raquel Fernández, Arianna Bisazza2023 · 90 citations
  94. BERT Busters: Outlier Dimensions that Disrupt TransformersFindings of the Association for Computational LinguisticsOlga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, et al.2021 · 90 citations
  95. Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion CausesConference on Empirical Methods in Natural Language Processing (EMNLP)Hyunwoo Kim, Byeongchang Kim, Gunhee Kim2021 · 90 citations
  96. Mapping the Increasing Use of LLMs in Scientific PapersarXiv:2404.01268Weixin Liang, Yaohui Zhang, Zhengxuan Wu, et al.2024 · 89 citations
  97. Dimensional Modeling of Emotions in Text with Appraisal Theories: Corpus Creation, Annotation Reliability, and PredictionComputational LinguisticsEnrica Troiano, Laura Oberländer, Roman Klinger2023 · 89 citations
  98. Small Language Models: Survey, Measurements, and InsightsarXiv:2409.15790Zhenyan Lu, Xiang Li, Dongqi Cai, et al.2024 · 88 citations
  99. Retrieval-Augmented Generation with Graphs (GraphRAG)arXiv:2501.00309Haoyu Han, Yu Wang, Harry Shomer, et al.2025 · 87 citations
  100. A Survey of Large Language Models in Medicine: Progress, Application, and ChallengearXiv:2311.05112Hongjian Zhou, Fenglin Liu, Boyang Gu, et al.2023 · 87 citations

1 … 5 6 7 … 10 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/6/