Elamur Research⌕
☰
home / papers / BERT: Pre-training of Deep Bidirectional… / cited by / page 8

Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 8 of 15 · 701–800 · ← the paper

1 … 7 8 9 … 15

  1. SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)Shervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 190 citations
  2. HONEST: Measuring Hurtful Sentence Completion in Language ModelsDebora Nozza, Federico Bianchi, Dirk Hovy2021 · 190 citations
  3. Merging Models with Fisher-Weighted AveragingMichael Matena, Colin Raffel2021 · 190 citations
  4. GLiNER: Generalist Model for Named Entity Recognition using Bidirectional TransformerUrchade Zaratiana, Nadi Tomeh, Pierre Holat, et al.2024 · 189 citations
  5. PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning OptimizationYidong Wang, Zhuohao Yu, Zhengran Zeng, et al.2023 · 189 citations
  6. MuTual: A Dataset for Multi-Turn Dialogue ReasoningLeyang Cui, Yu Wu, Shujie Liu, et al.2020 · 189 citations
  7. Language Modelling Makes Sense: Propagating Representations through WordNet for Full-Coverage Word Sense DisambiguationDaniel Loureiro, Alípio Jorge2019 · 189 citations
  8. Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style TransferFanchao Qi, Yangyi Chen, Xurui Zhang, et al.2021 · 188 citations
  9. SGPT: GPT Sentence Embeddings for Semantic SearchNiklas Muennighoff2022 · 187 citations
  10. Gradient-based Adversarial Attacks against Text TransformersChuan Guo, Alexandre Sablayrolles, Hervé Jégou, et al.2021 · 187 citations
  11. SemEval-2023 Task 10: Explainable Detection of Online SexismHannah Kirk, Wenjie Yin, Bertie Vidgen, et al.2023 · 185 citations
  12. Re2G: Retrieve, Rerank, GenerateMichael Glass, Gaetano Rossiello, Md Faisal Mahbub Chowdhury, et al.2022 · 183 citations
  13. MultiCoNER: A Large-scale Multilingual Dataset for Complex Named Entity RecognitionShervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 181 citations
  14. Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge GraphsHouyu Zhang, Zhenghao Liu, Chenyan Xiong, et al.2020 · 181 citations
  15. Modeling Intra and Inter-modality Incongruity for Multi-Modal Sarcasm DetectionHongliang Pan, Zheng Lin, Peng Fu, et al.2020 · 181 citations
  16. Pre-training via ParaphrasingMike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.2020 · 181 citations
  17. Planning with Learned Entity Prompts for Abstractive SummarizationShashi Narayan, Yao Zhao, Joshua Maynez, et al.2021 · 180 citations
  18. Explaining Black Box Predictions and Unveiling Data Artifacts through Influence FunctionsXiaochuang Han, Byron C. Wallace, Yulia Tsvetkov2020 · 180 citations
  19. CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 LanguagesThuat Nguyen, Chien Van Nguyen, Viet Dac Lai, et al.2023 · 179 citations
  20. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationYi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 179 citations
  21. Evaluating Large Language Models: A Comprehensive SurveyZishan Guo, Renren Jin, Chuang Liu, et al.2023 · 177 citations
  22. 8-bit Optimizers via Block-wise QuantizationTim Dettmers, Mike Lewis, Sam Shleifer, et al.2021 · 177 citations
  23. ContractNLI: A Dataset for Document-level Natural Language Inference for ContractsYuta Koreeda, Christopher Manning2021 · 177 citations
  24. Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLPRob van der Goot, Ahmet Üstün, Alan Ramponi, et al.2021 · 177 citations
  25. Pre-training Multilingual Neural Machine Translation by Leveraging Alignment InformationZehui Lin, Xiao Pan, Mingxuan Wang, et al.2020 · 177 citations
  26. RealTime QA: What's the Answer Right Now?Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, et al.2022 · 176 citations
  27. Coreference Resolution with Entity EqualizationBen Kantor, Amir Globerson2019 · 176 citations
  28. Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIsAlex Warstadt, Yu Cao, Ioana Grosu, et al.2019 · 176 citations
  29. Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language ModelsNora Kassner, Philipp Dufter, Hinrich Schütze2021 · 175 citations
  30. Translation Artifacts in Cross-lingual Transfer LearningMikel Artetxe, Gorka Labaka, Eneko Agirre2020 · 175 citations
  31. Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesSumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, et al.2023 · 174 citations
  32. Debiasing Pre-trained Contextualised EmbeddingsMasahiro Kaneko, Danushka Bollegala2021 · 174 citations
  33. UNKs Everywhere: Adapting Multilingual Language Models to New ScriptsJonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2021 · 174 citations
  34. Stance Detection in COVID-19 TweetsKyle Glandt, Sarthak Khanal, Yingjie Li, et al.2021 · 173 citations
  35. BillSum: A Corpus for Automatic Summarization of US LegislationAnastassia Kornilova, Vladimir Eidelman2019 · 173 citations
  36. Findings of the WMT 2019 Shared Tasks on Quality EstimationErick Fonseca, Lisa Yankovskaya, André F. T. Martins, et al.2019 · 173 citations
  37. Lifting the Curse of Multilinguality by Pre-training Modular TransformersJonas Pfeiffer, Naman Goyal, Xi Victoria Lin, et al.2022 · 172 citations
  38. Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional NetworkBin Liang, Chenwei Lou, Xiang Li, et al.2022 · 172 citations
  39. SemEval-2021 Task 5: Toxic Spans DetectionJohn Pavlopoulos, Jeffrey Sorensen, Léo Laugier, et al.2021 · 172 citations
  40. ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question AnsweringZhiyu Chen, Shiyang Li, Charese Smiley, et al.2022 · 171 citations
  41. Reasoning Over Paragraph Effects in SituationsKevin Lin, Oyvind Tafjord, Peter Clark, et al.2019 · 171 citations
  42. Do Llamas Work in English? On the Latent Language of Multilingual TransformersChris Wendler, Veniamin Veselovsky, Giovanni Monea, et al.2024 · 170 citations
  43. AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-TuningQingru Zhang, Minshuo Chen, Alexander Bukharin, et al.2023 · 170 citations
  44. Generating Sequences by Learning to Self-CorrectSean Welleck, Ximing Lu, Peter West, et al.2022 · 170 citations
  45. AudioPaLM: A Large Language Model That Can Speak and ListenPaul K. Rubenstein, Chulayuth Asawaroengchai, Duc Dung Nguyen, et al.2023 · 169 citations
  46. Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-SpecificityCunxiang Wang, Xiaoze Liu, Yuanhao Yue, et al.2023 · 169 citations
  47. Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingMinh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, et al.2021 · 169 citations
  48. COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 PandemicArkadiy Saakyan, Tuhin Chakrabarty, Smaranda Muresan2021 · 168 citations
  49. Simple Entity-Centric Questions Challenge Dense RetrieversChristopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, et al.2021 · 168 citations
  50. AMR Parsing via Graph-Sequence Iterative InferenceDeng Cai, Wai Lam2020 · 168 citations
  51. Offensive Language Identification in GreekZesis Pitenis, Marcos Zampieri, Tharindu Ranasinghe2020 · 168 citations
  52. ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectXin Men, Mingyu Xu, Qingyu Zhang, et al.2024 · 167 citations
  53. Promptagator: Few-shot Dense Retrieval From 8 ExamplesZhuyun Dai, Vincent Y. Zhao, Ji Ma, et al.2022 · 167 citations
  54. Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights CasesIlias Chalkidis, Manos Fergadiotis, Dimitrios Tsarapatsanis, et al.2021 · 167 citations
  55. Neural Syntactic Preordering for Controlled Paraphrase GenerationTanya Goyal, Greg Durrett2020 · 167 citations
  56. Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-4Kent K. Chang, Mackenzie Cramer, Sandeep Soni, et al.2023 · 166 citations
  57. Structure-Grounded Pretraining for Text-to-SQLXiang Deng, Ahmed Hassan Awadallah, Christopher Meek, et al.2021 · 166 citations
  58. Towards Controllable Biases in Language GenerationEmily Sheng, Kai-Wei Chang, Prem Natarajan, et al.2020 · 166 citations
  59. Generative Representational Instruction TuningNiklas Muennighoff, Hongjin Su, Liang Wang, et al.2024 · 165 citations
  60. Binding Language Models in Symbolic LanguagesZhoujun Cheng, Tianbao Xie, Peng Shi, et al.2022 · 165 citations
  61. Arabic Offensive Language on Twitter: Analysis and ExperimentsHamdy Mubarak, Ammar Rashed, Kareem Darwish, et al.2021 · 165 citations
  62. On Generative Spoken Language Modeling from Raw AudioKushal Lakhotia, Eugene Kharitonov, Wei-Ning Hsu, et al.2021 · 165 citations
  63. Sustainable Modular Debiasing of Language ModelsAnne Lauscher, Tobias Lueken, Goran Glavaš2021 · 165 citations
  64. Large Language Diffusion ModelsShen Nie, Fengqi Zhu, Zebin You, et al.2025 · 164 citations
  65. Controllable Text Simplification with Explicit ParaphrasingMounica Maddela, Fernando Alva-Manchego, Wei Xu2021 · 164 citations
  66. BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex InstructionsTerry Yue Zhuo, Minh Chien Vu, Jenny Chim, et al.2024 · 163 citations
  67. Promptbreeder: Self-Referential Self-Improvement Via Prompt EvolutionChrisantha Fernando, Dylan Banarse, Henryk Michalewski, et al.2023 · 163 citations
  68. AmericasNLI: Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource LanguagesAbteen Ebrahimi, Manuel Mager, Arturo Oncevay, et al.2022 · 163 citations
  69. Tuning Multilingual Transformers for Language-Specific Named Entity RecognitionMikhail Arkhipov, Maria Trofimova, Yuri Kuratov, et al.2019 · 163 citations
  70. LooGLE: Can Long-Context Language Models Understand Long Contexts?Jiaqi Li, Mengmeng Wang, Zilong Zheng, et al.2023 · 162 citations
  71. SCROLLS: Standardized CompaRison Over Long Language SequencesUri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 162 citations
  72. Explanations for CommonsenseQA: New Dataset and ModelsShourya Aggarwal, Divyanshu Mandowara, Vishwajeet Agrawal, et al.2021 · 162 citations
  73. Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESuppositionPaloma Jeretic, Alex Warstadt, Suvrat Bhooshan, et al.2020 · 161 citations
  74. On Negative Interference in Multilingual Models: Findings and A Meta-Learning TreatmentZirui Wang, Zachary C. Lipton, Yulia Tsvetkov2020 · 161 citations
  75. Probing What Different NLP Tasks Teach Machines about Function Word ComprehensionNajoung Kim, Roma Patel, Adam Poliak, et al.2019 · 161 citations
  76. Larger-Scale Transformers for Multilingual Masked Language ModelingNaman Goyal, Jingfei Du, Myle Ott, et al.2021 · 160 citations
  77. MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transferIlias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos2021 · 160 citations
  78. Enhancing Cross-target Stance Detection with Transferable Semantic-Emotion KnowledgeBowen Zhang, Min Yang, Xutao Li, et al.2020 · 160 citations
  79. Findings of the WMT 2020 Shared Task on Quality EstimationLucia Specia, Frédéric Blain, Marina Fomicheva, et al.2020 · 160 citations
  80. LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt CompressionZhuoshi Pan, Qianhui Wu, Huiqiang Jiang, et al.2024 · 159 citations
  81. PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel ComputationWei Zeng, Xiaozhe Ren, Teng Su, et al.2021 · 159 citations
  82. Testing the Predictions of Surprisal Theory in 11 LanguagesEthan G. Wilcox, Tiago Pimentel, Clara Meister, et al.2023 · 158 citations
  83. A Sentiment Analysis Dataset for Code-Mixed Malayalam-EnglishBharathi Raja Chakravarthi, Navya Jose, Shardul Suryawanshi, et al.2020 · 158 citations
  84. I Feel Offended, Don't Be Abusive! Implicit/Explicit Messages in Offensive and Abusive LanguageTommaso Caselli, Valerio Basile, Jelena Mitrović, et al.2020 · 157 citations
  85. Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationJonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 156 citations
  86. The (Un)Suitability of Automatic Evaluation Metrics for Text SimplificationFernando Alva-Manchego, Carolina Scarton, Lucia Specia2021 · 156 citations
  87. Toxic, Hateful, Offensive or Abusive? What Are We Really Classifying? An Empirical Analysis of Hate Speech DatasetsPaula Fortuna, Juan Soler, Leo Wanner2020 · 156 citations
  88. Unsupervised Translation of Programming LanguagesMarie-Anne Lachaux, Baptiste Roziere, Lowik Chanussot, et al.2020 · 156 citations
  89. Commonsense Knowledge Mining from Pretrained ModelsJoe Davison, Joshua Feldman, Alexander Rush2019 · 156 citations
  90. A Span-Extraction Dataset for Chinese Machine Reading ComprehensionYiming Cui, Ting Liu, Wanxiang Che, et al.2018 · 156 citations
  91. Probing Pre-Trained Language Models for Cross-Cultural Differences in ValuesArnav Arora, Lucie-aimée Kaffee, Isabelle Augenstein2023 · 155 citations
  92. GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense RetrievalKexin Wang, Nandan Thakur, Nils Reimers, et al.2022 · 155 citations
  93. Moshi: a speech-text foundation model for real-time dialogueAlexandre Defossez, Laurent Mazare, Manu Orsini, et al.2024 · 154 citations
  94. Large Language Models with Controllable Working MemoryDaliang Li, Ankit Singh Rawat, Manzil Zaheer, et al.2023 · 154 citations
  95. Leveraging Large Language Models for Multiple Choice Question AnsweringJoshua Robinson, Christopher Michael Rytting, David Wingate2022 · 154 citations
  96. Towards a Cleaner Document-Oriented Multilingual Crawled CorpusJulien Abadji, Pedro Ortiz Suarez, Laurent Romary, et al.2022 · 154 citations
  97. Stop Overthinking: A Survey on Efficient Reasoning for Large Language ModelsYang Sui, Yu-Neng Chuang, Guanchu Wang, et al.2025 · 153 citations
  98. Can GPT-3 Perform Statutory Reasoning?Andrew Blair-Stanek, Nils Holzenberger, Benjamin Van Durme2023 · 153 citations
  99. Graph Pre-training for AMR Parsing and GenerationXuefeng Bai, Yulong Chen, Yue Zhang2022 · 153 citations
  100. Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language ModelsTianyi Tang, Wenyang Luo, Haoyang Huang, et al.2024 · 151 citations

1 … 7 8 9 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/8/