Elamur Research⌕
☰
home / papers / RoBERTa: A Robustly Optimized BERT Pretraining… / cited by / page 8

Who cites «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

9,837 papers of our library cite it (of the 149,439 whose bibliographies we read) · 1406 with a page here, the most cited first · page 8 of 15 · 701–800 · ← back to «RoBERTa: A Robustly Optimized BERT Pretraining Approach»

1 … 7 8 9 10 … 15

  1. The DISRPT 2021 Shared Task on Elementary Discourse Unit Segmentation, Connective Detection, and Relation ClassificationShared Task on Discourse Relation Parsing and TreebankingAmir Zeldes, Yang Janet Liu, Mikel Iruskieta, et al.2021 · 49 citations
  2. Puzzle Solving using Reasoning of Large Language Models: A SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Panagiotis Giadikiaroglou, Maria Lymperaiou, Giorgos Filandrianos, et al.2024 · 48 citations
  3. Resolving Knowledge Conflicts in Large Language ModelsarXiv:2310.00935Yike Wang, Shangbin Feng, Heng Wang, et al.2023 · 48 citations
  4. ANLIzing the Adversarial Natural Language Inference DatasetSociety for Computation in Linguistics (SCiL)Adina Williams, Tristan Thrush, Douwe Kiela2022 · 48 citations
  5. Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Taiqiang Wu, Chaofan Tao, Jiahao Wang, et al.2025 · 47 citations
  6. Parameter-Efficient Fine-Tuning Design SpacesarXiv:2301.01821Jiaao Chen, Aston Zhang, Xingjian Shi, et al.2023 · 47 citations
  7. WEC: Deriving a Large-scale Cross-document Event Coreference dataset from WikipediaConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Alon Eirew, Arie Cattan, Ido Dagan2021 · 47 citations
  8. AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-TuningTransactions of the Association for Computational Linguistics (TACL)Han Zhou, Xingchen Wan, Ivan Vulić, et al.2024 · 46 citations
  9. Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
  10. Fact Checking with Insufficient EvidenceTransactions of the Association for Computational Linguistics (TACL)Pepa Atanasova, Jakob Grue Simonsen, Christina Lioma, et al.2022 · 46 citations
  11. Long-Context Language Modeling with Parallel Context EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Howard Yen, Tianyu Gao, Danqi Chen2024 · 44 citations
  12. End-to-end Argument Mining with Cross-corpora Multi-task LearningTransactions of the Association for Computational Linguistics (TACL)Gaku Morio, Hiroaki Ozaki, Terufumi Morishita, et al.2022 · 43 citations
  13. Facilitating Contrastive Learning of Discourse Relational Senses by Exploiting the Hierarchy of Sense RelationsConference on Empirical Methods in Natural Language Processing (EMNLP)Wanqiu Long, Bonnie Webber2022 · 43 citations
  14. SciNLI: A Corpus for Natural Language Inference on Scientific TextAnnual Meeting of the Association for Computational Linguistics (ACL)Mobashir Sadat, Cornelia Caragea2022 · 43 citations
  15. Speaker Turn Modeling for Dialogue Act ClassificationZihao He, Leili Tavabi, Kristina Lerman, et al.2021 · 43 citations
  16. BIG5-CHAT: Shaping LLM Personalities Through Training on Human-Grounded DataAnnual Meeting of the Association for Computational Linguistics (ACL)Wenkai Li, Jiarui Liu, Andy Liu, et al.2025 · 42 citations
  17. Knowledge Distillation in Automated Annotation: Supervised Text Classification with LLM-Generated Training LabelsarXiv:2406.17633Nicholas Pangakis, Samuel Wolken2024 · 42 citations
  18. Goal Driven Discovery of Distributional Differences via Language DescriptionsarXiv:2302.14233Ruiqi Zhong, Peter Zhang, Steve Li, et al.2023 · 42 citations
  19. Facebook AI's WMT21 News Translation Task SubmissionConference on Machine Translation (WMT)Chau Tran, Shruti Bhosale, James Cross, et al.2021 · 42 citations
  20. Pragmatic competence of pre-trained language models through the lens of discourse connectivesConference on Computational Natural Language Learning (CoNLL)Lalchand Pandia, Yan Cong, Allyson Ettinger2021 · 42 citations
  21. DeepSeek: Paradigm Shifts and Technical Evolution in Large AI ModelsarXiv:2507.09955Luolin Xiong, Haofen Wang, Xi Chen, et al.2025 · 41 citations
  22. Do Language Models Enjoy Their Own Stories? Prompting Large Language Models for Automatic Story EvaluationTransactions of the Association for Computational Linguistics (TACL)Cyril Chhun, Fabian M. Suchanek, Chloé Clavel2024 · 41 citations
  23. MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment TasksConference on Neural Information Processing Systems (NeurIPS)Allen Nie, Yuhui Zhang, Atharva Amdekar, et al.2023 · 41 citations
  24. Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for MalteseProceedings of the Third Workshop on Deep Learning for Low-Resource Natural Language ProcessingKurt Micallef, Albert Gatt, Marc Tanti, et al.2022 · 41 citations
  25. Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change AnalysisMario Giulianelli, Iris Luden, Raquel Fernandez, et al.2023 · 40 citations
  26. ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document UnderstandingarXiv:2210.06155Qiming Peng, Yinxu Pan, Wenjin Wang, et al.2022 · 40 citations
  27. A Few Topical Tweets are Enough for Effective User Stance DetectionConference of the European Chapter of the Association for Computational Linguistics (EACL)Younes Samih, Kareem Darwish2021 · 40 citations
  28. NOPE: A Corpus of Naturally-Occurring Presuppositions in EnglishAlicia Parrish, Sebastian Schuster, Alex Warstadt, et al.2021 · 40 citations
  29. LitSearch: A Retrieval Benchmark for Scientific Literature SearchConference on Empirical Methods in Natural Language Processing (EMNLP)Anirudh Ajith, Mengzhou Xia, Alexis Chevalier, et al.2024 · 39 citations
  30. Do large language models resemble humans in language use?arXiv:2303.08014Zhenguang G. Cai, Xufeng Duan, David A. Haslett, et al.2023 · 39 citations
  31. Improving Stance Detection with Multi-Dataset Learning and Knowledge DistillationConference on Empirical Methods in Natural Language Processing (EMNLP)Yingjie Li, Chenye Zhao, Cornelia Caragea2021 · 39 citations
  32. STARC: Structured Annotations for Reading ComprehensionYevgeni Berzak, Jonathan Malmaud, Roger Levy2020 · 39 citations
  33. DziriBERT: a Pre-trained Language Model for the Algerian DialectarXiv:2109.12346Amine Abdaoui, Mohamed Berrimi, Mourad Oussalah, et al.2021 · 38 citations
  34. A Transformer Approach to Contextual Sarcasm Detection in TwitterWorkshop on Figurative Language ProcessingHunter Gregory, Steven Li, Pouya Mohammadi, et al.2020 · 38 citations
  35. C-Net: Contextual Network for Sarcasm DetectionWorkshop on Figurative Language ProcessingAmit Kumar Jena, Aman Sinha, Rohit Agarwal2020 · 38 citations
  36. Prompt-based Connective Prediction Method for Fine-grained Implicit Discourse Relation RecognitionFindings of the Association for Computational LinguisticsHao Zhou, Man Lan, Yuanbin Wu, et al.2022 · 37 citations
  37. An Empirical Study on Model-agnostic Debiasing Strategies for Robust Natural Language InferenceConference on Computational Natural Language Learning (CoNLL)Tianyu Liu, Xin Zheng, Xiaoan Ding, et al.2020 · 37 citations
  38. Distributed NLI: Learning to Predict Human Opinion Distributions for Language ReasoningFindings of the Association for Computational LinguisticsXiang Zhou, Yixin Nie, Mohit Bansal2022 · 36 citations
  39. SarcasmBench: Towards Evaluating Large Language Models on Sarcasm UnderstandingarXiv:2408.11319Yazhou Zhang, Chunwang Zou, Zheng Lian, et al.2024 · 35 citations
  40. Transformer-based Context-aware Sarcasm Detection in Conversation Threads from Social MediaWorkshop on Figurative Language ProcessingXiangjue Dong, Changmao Li, Jinho D. Choi2020 · 35 citations
  41. EuroBERT: Scaling Multilingual Encoders for European LanguagesarXiv:2503.05500Nicolas Boizard, Hippolyte Gisserot-Boukhlef, Duarte M. Alves, et al.2025 · 34 citations
  42. M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language ModelsarXiv:2305.10263Chuang Liu, Renren Jin, Yuqi Ren, et al.2023 · 34 citations
  43. Focus on what matters: Applying Discourse Coherence Theory to Cross Document CoreferenceConference on Empirical Methods in Natural Language Processing (EMNLP)William Held, Dan Iter, Dan Jurafsky2021 · 34 citations
  44. Transformers on Sarcasm Detection with ContextWorkshop on Figurative Language ProcessingAmardeep Kumar, Vivek Anand2020 · 34 citations
  45. Unveiling Privacy Risks in LLM Agent MemoryAnnual Meeting of the Association for Computational Linguistics (ACL)Bo Wang, Weiyi He, Shenglai Zeng, et al.2025 · 33 citations
  46. Leveraging Generative Large Language Models with Visual Instruction and Demonstration Retrieval for Multimodal Sarcasm DetectionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Binghao Tang, Boda Lin, Haolong Yan, et al.2024 · 33 citations
  47. Compositional Evaluation on Japanese Textual Entailment and SimilarityTransactions of the Association for Computational Linguistics (TACL)Hitomi Yanaka, Koji Mineshima2022 · 33 citations
  48. Probing Contextual Language Models for Common Ground with Visual RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Gabriel Ilharco, Rowan Zellers, Ali Farhadi, et al.2021 · 33 citations
  49. ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming LanguagesarXiv:2212.06742Yekun Chai, Shuohuan Wang, Chao Pang, et al.2022 · 32 citations
  50. MaTESe: Machine Translation Evaluation as a Sequence Tagging ProblemConference on Machine Translation (WMT)Stefano Perrella, Lorenzo Proietti, Alessandro Scirè, et al.2022 · 32 citations
  51. OpenStance: Real-world Zero-shot Stance DetectionConference on Computational Natural Language Learning (CoNLL)Hanzi Xu, Slobodan Vucetic, Wenpeng Yin2022 · 32 citations
  52. RST Discourse Parsing with Second-Stage EDU-Level Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Nan Yu, Meishan Zhang, Guohong Fu, et al.2022 · 32 citations
  53. Neural Sarcasm Detection using Conversation ContextWorkshop on Figurative Language ProcessingNikhil Jaiswal2020 · 32 citations
  54. Annotation-Inspired Implicit Discourse Relation Classification with Auxiliary Discourse Connective GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Wei Liu, Michael Strube2023 · 31 citations
  55. The Life Cycle of Knowledge in Big Language Models: A SurveyarXiv:2303.07616 · Machine Intelligence Research. vol. 21, no. 2, pp. 217-238, 2024Boxi Cao, Hongyu Lin, Xianpei Han, et al.2023 · 31 citations
  56. Pairwise Representation Learning for Event CoreferenceJoint Conference on Lexical and Computational Semantics (*SEM)Xiaodong Yu, Wenpeng Yin, Dan Roth2022 · 31 citations
  57. A Multi-Task Learning Framework for Multi-Target Stance DetectionFindings of the Association for Computational LinguisticsYingjie Li, Cornelia Caragea2021 · 31 citations
  58. Realistic Evaluation Principles for Cross-document Coreference ResolutionJoint Conference on Lexical and Computational Semantics (*SEM)Arie Cattan, Alon Eirew, Gabriel Stanovsky, et al.2021 · 31 citations
  59. SemEval-2025 Task 1: AdMIRe - Advancing Multimodal Idiomaticity RepresentationInternational Workshop on Semantic Evaluation (SemEval)Thomas Pickard, Aline Villavicencio, Maggie Mi, et al.2025 · 30 citations
  60. C-STANCE: A Large Dataset for Chinese Zero-Shot Stance DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Chenye Zhao, Yingjie Li, Cornelia Caragea2023 · 30 citations
  61. Measuring and Modifying Factual Knowledge in Large Language ModelsarXiv:2306.06264Pouya Pezeshkpour2023 · 30 citations
  62. Multi-task Active Learning for Pre-trained Transformer-based ModelsTransactions of the Association for Computational Linguistics (TACL)Guy Rotman, Roi Reichart2022 · 30 citations
  63. Evaluating Document Coherence ModelingTransactions of the Association for Computational Linguistics (TACL)Aili Shen, Meladel Mistica, Bahar Salehi, et al.2021 · 30 citations
  64. Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling ApproachKoren Lazar, Benny Saret, Asaf Yehudai, et al.2021 · 30 citations
  65. CoIR: A Comprehensive Benchmark for Code Information Retrieval ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiangyang Li, Kuicai Dong, Yi Quan Lee, et al.2025 · 29 citations
  66. Click: Controllable Text Generation with Sequence Likelihood Contrastive LearningFindings of the Association for Computational LinguisticsChujie Zheng, Pei Ke, Zheng Zhang, et al.2023 · 29 citations
  67. How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument StructureTransactions of the Association for Computational Linguistics (TACL)Michael Wilson, Jackson Petty, Robert Frank2023 · 29 citations
  68. Mind the instructions: a holistic evaluation of consistency and interactions in prompt-based learningConference on Computational Natural Language Learning (CoNLL)Lucas Weber, Elia Bruni, Dieuwke Hupkes2023 · 29 citations
  69. Sub-Character Tokenization for Chinese Pretrained Language ModelsTransactions of the Association for Computational Linguistics (TACL)Chenglei Si, Zhengyan Zhang, Yingfa Chen, et al.2023 · 29 citations
  70. TyDiP: A Dataset for Politeness Classification in Nine Typologically Diverse LanguagesFindings of the Association for Computational LinguisticsAnirudh Srinivasan, Eunsol Choi2022 · 29 citations
  71. DisCoDisCo at the DISRPT2021 Shared Task: A System for Discourse Segmentation, Classification, and Connective DetectionShared Task on Discourse Relation Parsing and TreebankingLuke Gessler, Shabnam Behzad, Yang Janet Liu, et al.2021 · 29 citations
  72. Syntax Role for Neural Semantic Role LabelingComputational LinguisticsZuchao Li, Hai Zhao, Shexia He, et al.2021 · 29 citations
  73. Multi-modal Stance Detection: New Datasets and ModelFindings of the Association for Computational LinguisticsBin Liang, Ang Li, Jingqian Zhao, et al.2024 · 28 citations
  74. On the Role of Morphological Information for Contextual LemmatizationOlia Toporkov, Rodrigo Agerri2024 · 28 citations
  75. A Technical Report for Polyglot-Ko: Open-Source Large-Scale Korean Language ModelsarXiv:2306.02254Hyunwoong Ko, Kichang Yang, Minho Ryu, et al.2023 · 28 citations
  76. Chain-of-Thought Embeddings for Stance Detection on Social MediaFindings of the Association for Computational LinguisticsJoseph Gatto, Omar Sharif, Sarah M. Preum2023 · 28 citations
  77. Global and Local Hierarchy-aware Contrastive Framework for Implicit Discourse Relation RecognitionFindings of the Association for Computational LinguisticsYuxin Jiang, Linhan Zhang, Wei Wang2023 · 28 citations
  78. Pushing the Limits of ChatGPT on NLP TasksarXiv:2306.09719Xiaofei Sun, Linfeng Dong, Xiaoya Li, et al.2023 · 28 citations
  79. Context Matters: A Pragmatic Study of PLMs' Negation UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Reto Gubelmann, Siegfried Handschuh2022 · 28 citations
  80. KACE: Generating Knowledge Aware Contrastive Explanations for Natural Language InferenceAnnual Meeting of the Association for Computational Linguistics (ACL)Qianglong Chen, Feng Ji, Xiangji Zeng, et al.2021 · 28 citations
  81. HypoNLI: Exploring the Artificial Patterns of Hypothesis-only Bias in Natural Language InferenceLanguage Resources and Evaluation Conference (LREC)Tianyu Liu, Xin Zheng, Baobao Chang, et al.2020 · 28 citations
  82. Can Large Language Models Unlock Novel Scientific Research Ideas?Conference on Empirical Methods in Natural Language Processing (EMNLP)Sandeep Kumar, Tirthankar Ghosal, Vinayak Goyal, et al.2025 · 27 citations
  83. Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
  84. DQ-LoRe: Dual Queries with Low Rank Approximation Re-ranking for In-Context LearningarXiv:2310.02954Jing Xiong, Zixuan Li, Chuanyang Zheng, et al.2023 · 27 citations
  85. Evaluating ChatGPT and Bard AI on Arabic Sentiment AnalysisArabic Natural Language Processing Conference (ArabicNLP)Abdulmohsen Al-Thubaity, Sakhar Alkhereyf, Hanan Murayshid, et al.2023 · 27 citations
  86. Logical Reasoning over Natural Language as Knowledge Representation: A SurveyarXiv:2303.12023Zonglin Yang, Xinya Du, Rui Mao, et al.2023 · 27 citations
  87. Performance Comparison of Large Language Models on VNHSGE English Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google BardarXiv:2307.02288Xuan-Quy Dao2023 · 27 citations
  88. Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language ModelsarXiv:2310.00836Man Luo, Shrinidhi Kumbhar, Ming shen, et al.2023 · 27 citations
  89. DuReader_retrieval: A Large-scale Chinese Benchmark for Passage Retrieval from Web Search EngineConference on Empirical Methods in Natural Language Processing (EMNLP)Yifu Qiu, Hongyu Li, Yingqi Qu, et al.2022 · 27 citations
  90. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 27 citations
  91. ERNIE-Doc: A Retrospective Long-Document Modeling TransformerarXiv:2012.15688Siyu Ding, Junyuan Shang, Shuohuan Wang, et al.2020 · 27 citations
  92. New Protocols and Negative Results for Textual Entailment Data CollectionConference on Empirical Methods in Natural Language Processing (EMNLP)Samuel R. Bowman, Jennimaria Palomaki, Livio Baldini Soares, et al.2020 · 27 citations
  93. Construction Grammar Provides Unique Insight into Neural Language ModelsInternational Workshop on Construction Grammars and NLPLeonie Weissweiler, Taiqi He, Naoki Otani, et al.2023 · 26 citations
  94. Morphosyntactic probing of multilingual BERT modelsNatural Language EngineeringJudit Acs, Endre Hamerlik, Roy Schwartz, et al.2023 · 26 citations
  95. A Dependency Treebank of Spoken Second Language EnglishKristopher Kyle, Masaki Eguchi, Aaron Miller, et al.2022 · 26 citations
  96. Generative Data Augmentation with Contrastive Learning for Zero-Shot Stance DetectionConference on Empirical Methods in Natural Language Processing (EMNLP)Yang Li, Jiawei Yuan2022 · 26 citations
  97. Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African ArabiziarXiv:2005.00318Benjamin Muller, Benoit Sagot, Djame Seddah2020 · 26 citations
  98. A New Direction in Stance Detection: Target-Stance Extraction in the WildAnnual Meeting of the Association for Computational Linguistics (ACL)Yingjie Li, Krishna Garg, Cornelia Caragea2023 · 25 citations
  99. PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) PlanningarXiv:2305.19472Faeze Brahman, Chandra Bhagavatula, Valentina Pyatkin, et al.2023 · 25 citations
  100. Sentiment Analysis through LLM NegotiationsarXiv:2311.01876Xiaofei Sun, Xiaoya Li, Shengyu Zhang, et al.2023 · 25 citations

1 … 7 8 9 10 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/cited-by/page/8/