Elamur Research⌕
☰
home / papers / BERT: Pre-training of Deep Bidirectional… / cited by / page 5

Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 5 of 15 · 401–500 · ← the paper

1 … 4 5 6 … 15

  1. BERTje: A Dutch BERT ModelWietse de Vries, Andreas van Cranenburgh, Arianna Bisazza, et al.2019 · 357 citations
  2. XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and GenerationYaobo Liang, Nan Duan, Yeyun Gong, et al.2020 · 356 citations
  3. Multilingual Constituency Parsing with Self-Attention and Pre-TrainingNikita Kitaev, Steven Cao, Dan Klein2019 · 356 citations
  4. Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary SentenceChi Sun, Luyao Huang, Xipeng Qiu2019 · 356 citations
  5. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 355 citations
  6. QuestEval: Summarization Asks for Fact-based EvaluationThomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, et al.2021 · 353 citations
  7. ChatEval: Towards Better LLM-based Evaluators through Multi-Agent DebateChi-Min Chan, Weize Chen, Yusheng Su, et al.2023 · 351 citations
  8. SemEval-2020 Task 1: Unsupervised Lexical Semantic Change DetectionDominik Schlechtweg, Barbara McGillivray, Simon Hengchen, et al.2020 · 351 citations
  9. FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive SummarizationEsin Durmus, He He, Mona Diab2020 · 350 citations
  10. Reformulating Unsupervised Style Transfer as Paraphrase GenerationKalpesh Krishna, John Wieting, Mohit Iyyer2020 · 348 citations
  11. Do NLP Models Know Numbers? Probing Numeracy in EmbeddingsEric Wallace, Yizhong Wang, Sujian Li, et al.2019 · 348 citations
  12. RobBERT: a Dutch RoBERTa-based Language ModelPieter Delobelle, Thomas Winters, Bettina Berendt2020 · 346 citations
  13. Directed Acyclic Graph Network for Conversational Emotion RecognitionWeizhou Shen, Siyue Wu, Yunyi Yang, et al.2021 · 344 citations
  14. Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary SpaceMor Geva, Avi Caciularu, Kevin Ro Wang, et al.2022 · 342 citations
  15. Simple BERT Models for Relation Extraction and Semantic Role LabelingPeng Shi, Jimmy Lin2019 · 340 citations
  16. Information-Theoretic Probing with Minimum Description LengthElena Voita, Ivan Titov2020 · 339 citations
  17. Word-level Textual Adversarial Attacking as Combinatorial OptimizationYuan Zang, Fanchao Qi, Chenghao Yang, et al.2020 · 338 citations
  18. Visualizing and Measuring the Geometry of BERTAndy Coenen, Emily Reif, Ann Yuan, et al.2019 · 338 citations
  19. Large Language Models for Information Retrieval: A SurveyYutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen2023 · 335 citations
  20. MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking BaselinesXiaoxue Zang, Abhinav Rastogi, Srinivas Sunkara, et al.2020 · 335 citations
  21. SemEval-2019 Task 4: Hyperpartisan News DetectionJohannes Kiesel, Maria Mestre, Rishabh Shukla, et al.2019 · 335 citations
  22. UL2: Unifying Language Learning ParadigmsYi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 334 citations
  23. Efficient Attentions for Long Document SummarizationLuyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 334 citations
  24. Few-NERD: A Few-shot Named Entity Recognition DatasetNing Ding, Guangwei Xu, Yulin Chen, et al.2021 · 334 citations
  25. Combining Automatic Labelers and Expert Annotations for Accurate Radiology Report Labeling Using BERTAkshay Smit, Saahil Jain, Pranav Rajpurkar, et al.2020 · 334 citations
  26. Neural Unsupervised Domain Adaptation in NLP–-A SurveyAlan Ramponi, Barbara Plank2020 · 334 citations
  27. Neural Codec Language Models are Zero-Shot Text to Speech SynthesizersChengyi Wang, Sanyuan Chen, Yu Wu, et al.2023 · 333 citations
  28. Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!Xiangyu Qi, Yi Zeng, Tinghao Xie, et al.2023 · 331 citations
  29. Scaling Speech Technology to 1,000+ LanguagesVineel Pratap, Andros Tjandra, Bowen Shi, et al.2023 · 331 citations
  30. TimeLMs: Diachronic Language Models from TwitterDaniel Loureiro, Francesco Barbieri, Leonardo Neves, et al.2022 · 331 citations
  31. Unsupervised Corpus Aware Language Model Pre-training for Dense Passage RetrievalLuyu Gao, Jamie Callan2022 · 328 citations
  32. GraphCodeBERT: Pre-training Code Representations with Data FlowDaya Guo, Shuo Ren, Shuai Lu, et al.2021 · 328 citations
  33. RLPrompt: Optimizing Discrete Text Prompts with Reinforcement LearningMingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, et al.2022 · 327 citations
  34. Unsupervised Domain Clusters in Pretrained Language ModelsRoee Aharoni, Yoav Goldberg2020 · 326 citations
  35. CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared TaskRicardo Rei, Marcos Treviso, Nuno M. Guerreiro, et al.2022 · 325 citations
  36. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationYu Sun, Shuohuan Wang, Shikun Feng, et al.2021 · 324 citations
  37. Quantifying the Carbon Emissions of Machine LearningAlexandre Lacoste, Alexandra Luccioni, Victor Schmidt, et al.2019 · 324 citations
  38. LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init AttentionRenrui Zhang, Jiaming Han, Chris Liu, et al.2023 · 322 citations
  39. Probing Pretrained Language Models for Lexical SemanticsIvan Vulić, Edoardo Maria Ponti, Robert Litschko, et al.2020 · 320 citations
  40. Compressive Transformers for Long-Range Sequence ModellingJack W. Rae, Anna Potapenko, Siddhant M. Jayakumar, et al.2019 · 320 citations
  41. MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of ClaimsIsabelle Augenstein, Christina Lioma, Dongsheng Wang, et al.2019 · 318 citations
  42. Document Expansion by Query PredictionRodrigo Nogueira, Wei Yang, Jimmy Lin, et al.2019 · 317 citations
  43. Text and Code Embeddings by Contrastive Pre-TrainingArvind Neelakantan, Tao Xu, Raul Puri, et al.2022 · 316 citations
  44. Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation ModelsChenfei Wu, Shengming Yin, Weizhen Qi, et al.2023 · 315 citations
  45. How many data points is a prompt worth?Teven Le Scao, Alexander Rush2021 · 315 citations
  46. Explainable Automated Fact-Checking for Public Health ClaimsNeema Kotonya, Francesca Toni2020 · 314 citations
  47. Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)Santiago Castro, Devamanyu Hazarika, Verónica Pérez-Rosas, et al.2019 · 313 citations
  48. A Transformer-based approach to Irony and Sarcasm detectionRolandos Alexandros Potamias, Georgios Siolas, Andreas - Georgios Stafylopatis2019 · 312 citations
  49. MEDITRON-70B: Scaling Medical Pretraining for Large Language ModelsZeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.2023 · 307 citations
  50. TIES-Merging: Resolving Interference When Merging ModelsPrateek Yadav, Derek Tam, Leshem Choshen, et al.2023 · 306 citations
  51. Multi-hop Reading Comprehension through Question Decomposition and RescoringSewon Min, Victor Zhong, Luke Zettlemoyer, et al.2019 · 306 citations
  52. From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP ModelsShangbin Feng, Chan Young Park, Yuhan Liu, et al.2023 · 305 citations
  53. Challenges and frontiers in abusive content detectionBertie Vidgen, Alex Harris, Dong Nguyen, et al.2019 · 305 citations
  54. Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question AnsweringZhiguo Wang, Patrick Ng, Xiaofei Ma, et al.2019 · 304 citations
  55. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)Zhengyuan Yang, Linjie Li, Kevin Lin, et al.2023 · 303 citations
  56. AugGPT: Leveraging ChatGPT for Text Data AugmentationHaixing Dai; Zhengliang Liu; Wenxiong Liao; Xiaoke Huang; Yihan Cao; Zihao Wu; Lin Zhao; Shaochen Xu; Wei Liu; Ninghao Liu; Sheng Li; Dajiang Zhu; Hongmin Cai; Lichao Sun; Quanzheng Li; Dinggang Shen; Tianming Liu;, Xiang Li2023 · 302 citations
  57. ZeRO-Offload: Democratizing Billion-Scale Model TrainingJie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.2021 · 302 citations
  58. ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale TransformersZhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, et al.2022 · 301 citations
  59. Abductive Commonsense ReasoningChandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, et al.2019 · 301 citations
  60. Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
  61. SPoT: Better Frozen Model Adaptation through Soft Prompt TransferTu Vu, Brian Lester, Noah Constant, et al.2022 · 300 citations
  62. Style Transformer: Unpaired Text Style Transfer without Disentangled Latent RepresentationNing Dai, Jianze Liang, Xipeng Qiu, et al.2019 · 300 citations
  63. Muppet: Massive Multi-task Representations with Pre-FinetuningArmen Aghajanyan, Anchit Gupta, Akshat Shrivastava, et al.2021 · 299 citations
  64. Multi-step Jailbreaking Privacy Attacks on ChatGPTHaoran Li, Dadi Guo, Wei Fan, et al.2023 · 298 citations
  65. Want To Reduce Labeling Cost? GPT-3 Can HelpShuohang Wang, Yang Liu, Yichong Xu, et al.2021 · 298 citations
  66. S2ORC: The Semantic Scholar Open Research CorpusKyle Lo, Lucy Lu Wang, Mark Neumann, et al.2019 · 297 citations
  67. BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in BanglaAbhik Bhattacharjee, Tahmid Hasan, Wasi Ahmad, et al.2022 · 296 citations
  68. Towards Debiasing Fact Verification ModelsTal Schuster, Darsh Shah, Yun Jie Serene Yeo, et al.2019 · 296 citations
  69. Document-Level Machine Translation with Large Language ModelsLongyue Wang, Chenyang Lyu, Tianbo Ji, et al.2023 · 295 citations
  70. Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question AnsweringYanlin Feng, Xinyue Chen, Bill Yuchen Lin, et al.2020 · 295 citations
  71. AdapterDrop: On the Efficiency of Adapters in TransformersAndreas Rücklé, Gregor Geigle, Max Glockner, et al.2021 · 294 citations
  72. Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency ParsingTal Schuster, Ori Ram, Regina Barzilay, et al.2019 · 294 citations
  73. Matching the Blanks: Distributional Similarity for Relation LearningLivio Baldini Soares, Nicholas FitzGerald, Jeffrey Ling, et al.2019 · 294 citations
  74. Prompting Large Language Model for Machine Translation: A Case StudyBiao Zhang, Barry Haddow, Alexandra Birch2023 · 293 citations
  75. Information-Theoretic Probing for Linguistic StructureTiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, et al.2020 · 293 citations
  76. FlauBERT: Unsupervised Language Model Pre-training for FrenchHang Le, Loïc Vial, Jibril Frej, et al.2019 · 293 citations
  77. Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, et al.2023 · 292 citations
  78. Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for LittleKoustuv Sinha, Robin Jia, Dieuwke Hupkes, et al.2021 · 292 citations
  79. SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized OptimizationHaoming Jiang, Pengcheng He, Weizhu Chen, et al.2020 · 291 citations
  80. Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human AttackEmily Dinan, Samuel Humeau, Bharath Chintagunta, et al.2019 · 291 citations
  81. Challenges and Strategies in Cross-Cultural NLPDaniel Hershcovich, Stella Frank, Heather Lent, et al.2022 · 290 citations
  82. SemEval-2019 Task 7: RumourEval, Determining Rumour Veracity and Support for RumoursGenevieve Gorrell, Elena Kochkina, Maria Liakata, et al.2019 · 290 citations
  83. Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceTal Schuster, Adam Fisch, Regina Barzilay2021 · 289 citations
  84. From Words to Watts: Benchmarking the Energy Costs of Large Language Model InferenceSiddharth Samsi, Dan Zhao, Joseph McDonald, et al.2023 · 288 citations
  85. QAFactEval: Improved QA-Based Factual Consistency Evaluation for SummarizationAlexander Fabbri, Chien-Sheng Wu, Wenhao Liu, et al.2022 · 288 citations
  86. CAMeL Tools: An Open Source Python Toolkit for Arabic Natural Language ProcessingOssama Obeid, Nasser Zalmout, Salam Khalifa, et al.2020 · 288 citations
  87. Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend SkillsEric Michael Smith, Mary Williamson, Kurt Shuster, et al.2020 · 288 citations
  88. Structural Scaffolds for Citation Intent Classification in Scientific PublicationsArman Cohan, Waleed Ammar, Madeleine van Zuylen, et al.2019 · 287 citations
  89. PAQ: 65 Million Probably-Asked Questions and What You Can Do With ThemPatrick Lewis, Yuxiang Wu, Linqing Liu, et al.2021 · 286 citations
  90. Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence EncodersJue Wang, Wei Lu2020 · 286 citations
  91. Efficient and Effective Text Encoding for Chinese LLaMA and AlpacaYiming Cui, Ziqing Yang, Xin Yao2023 · 285 citations
  92. Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguageAndy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 285 citations
  93. ReClor: A Reading Comprehension Dataset Requiring Logical ReasoningWeihao Yu, Zihang Jiang, Yanfei Dong, et al.2020 · 283 citations
  94. USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationShikib Mehri, Maxine Eskenazi2020 · 283 citations
  95. PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase IdentificationYinfei Yang, Yuan Zhang, Chris Tar, et al.2019 · 283 citations
  96. Contextualized Perturbation for Textual Adversarial AttackDianqi Li, Yizhe Zhang, Hao Peng, et al.2021 · 282 citations
  97. Fine-grained Fact Verification with Kernel Graph Attention NetworkZhenghao Liu, Chenyan Xiong, Maosong Sun, et al.2020 · 282 citations
  98. Is ChatGPT a Good NLG Evaluator? A Preliminary StudyJiaan Wang, Yunlong Liang, Fandong Meng, et al.2023 · 281 citations
  99. MEGA: Multilingual Evaluation of Generative AIKabir Ahuja, Harshita Diddee, Rishav Hada, et al.2023 · 281 citations
  100. Multi-Sentence Argument LinkingSeth Ebner, Patrick Xia, Ryan Culkin, et al.2020 · 281 citations

1 … 4 5 6 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/5/