Elamur Research⌕
☰
home / papers / BERT: Pre-training of Deep Bidirectional… / cited by / page 4

Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 4 of 15 · 301–400 · ← the paper

1 2 3 4 5 … 15

  1. FinGPT: Open-Source Financial Large Language ModelsHongyang Yang, Xiao-Yang Liu, Christina Dan Wang2023 · 445 citations
  2. How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language ModelsPhillip Rust, Jonas Pfeiffer, Ivan Vulić, et al.2021 · 444 citations
  3. Masked Language Model ScoringJulian Salazar, Davis Liang, Toan Q. Nguyen, et al.2020 · 444 citations
  4. Ranking Generated Summaries by Correctness: An Interesting but Challenging Application for Natural Language InferenceTobias Falke, Leonardo F. R. Ribeiro, Prasetya Ajie Utama, et al.2019 · 444 citations
  5. FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingChen Zhu, Yu Cheng, Zhe Gan, et al.2019 · 443 citations
  6. The Faiss libraryMatthijs Douze, Alexandr Guzhva, Chengqi Deng, et al.2024 · 442 citations
  7. Pretrained Transformers Improve Out-of-Distribution RobustnessDan Hendrycks, Xiaoyuan Liu, Eric Wallace, et al.2020 · 442 citations
  8. MVBench: A Comprehensive Multi-modal Video Understanding BenchmarkKunchang Li, Yali Wang, Yinan He, et al.2023 · 441 citations
  9. ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 441 citations
  10. Entity-Relation Extraction as Multi-Turn Question AnsweringXiaoya Li, Fan Yin, Zijun Sun, et al.2019 · 437 citations
  11. GPT-NER: Named Entity Recognition via Large Language ModelsShuhe Wang, Xiaofei Sun, Xiaoya Li, et al.2025 · 436 citations
  12. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  13. Improving Text Embeddings with Large Language ModelsLiang Wang, Nan Yang, Xiaolong Huang, et al.2024 · 433 citations
  14. Self-Alignment Pretraining for Biomedical Entity RepresentationsFangyu Liu, Ehsan Shareghi, Zaiqiao Meng, et al.2021 · 432 citations
  15. oLMpics — On what Language Model Pre-training CapturesAlon Talmor, Yanai Elazar, Yoav Goldberg, et al.2019 · 432 citations
  16. Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot FlyNora Kassner, Hinrich Schütze2020 · 431 citations
  17. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object DetectionShilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.2023 · 430 citations
  18. Analyzing the Structure of Attention in a Transformer Language ModelJesse Vig, Yonatan Belinkov2019 · 430 citations
  19. Experience Grounds LanguageYonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 429 citations
  20. C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation ModelsYuzhen Huang, Yuzhuo Bai, Zhihao Zhu, et al.2023 · 427 citations
  21. Benchmarking Retrieval-Augmented Generation for MedicineGuangzhi Xiong, Qiao Jin, Zhiyong Lu, et al.2024 · 426 citations
  22. Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware SamplingSebastian Hofstatter, Sheng-Chieh Lin, Jheng-Hong Yang, et al.2021 · 425 citations
  23. Security and Privacy Challenges of Large Language Models: A SurveyBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 422 citations
  24. Diffusion-LM Improves Controllable Text GenerationXiang Lisa Li, John Thickstun, Ishaan Gulrajani, et al.2022 · 421 citations
  25. Ethical and social risks of harm from Language ModelsLaura Weidinger, John Mellor, Maribeth Rauh, et al.2021 · 421 citations
  26. Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied AgentsWenlong Huang, Pieter Abbeel, Deepak Pathak, et al.2022 · 420 citations
  27. Template-Based Named Entity Recognition Using BARTLeyang Cui, Yu Wu, Jian Liu, et al.2021 · 420 citations
  28. Event Extraction as Machine Reading ComprehensionJian Liu, Yubo Chen, Kang Liu, et al.2020 · 420 citations
  29. ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual LearningViet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, et al.2023 · 418 citations
  30. Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsArtidoro Pagnoni, Vidhisha Balachandran, Yulia Tsvetkov2021 · 417 citations
  31. 75 Languages, 1 Model: Parsing Universal Dependencies UniversallyDan Kondratyuk, Milan Straka2019 · 415 citations
  32. Weight Poisoning Attacks on Pretrained ModelsKeita Kurita, Paul Michel, Graham Neubig2020 · 414 citations
  33. Are Sixteen Heads Really Better than One?Paul Michel, Omer Levy, Graham Neubig2019 · 412 citations
  34. Factual Probing Is [MASK]: Learning vs. Learning to RecallZexuan Zhong, Dan Friedman, Danqi Chen2021 · 411 citations
  35. mPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityQinghao Ye, Haiyang Xu, Guohai Xu, et al.2023 · 410 citations
  36. InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksZhe Chen, Jiannan Wu, Wenhai Wang, et al.2023 · 409 citations
  37. KUISAIL at SemEval-2020 Task 12: BERT-CNN for Offensive Speech Identification in Social MediaAli Safaya, Moutasem Abdullatif, Deniz Yuret2020 · 409 citations
  38. A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health SupportAshish Sharma, Adam Miner, David Atkins, et al.2020 · 408 citations
  39. BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical DomainsYanis Labrak, Adrien Bazoge, Emmanuel Morin, et al.2024 · 406 citations
  40. Automatic Detection of Generated Text is Easiest when Humans are FooledDaphne Ippolito, Daniel Duckworth, Chris Callison-Burch, et al.2019 · 406 citations
  41. Training data-efficient image transformers & distillation through attentionHugo Touvron, Matthieu Cord, Matthijs Douze, et al.2020 · 405 citations
  42. AgentBench: Evaluating LLMs as AgentsXiao Liu, Hao Yu, Hanchen Zhang, et al.2023 · 404 citations
  43. Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question AnsweringShamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, et al.2023 · 403 citations
  44. True Few-Shot Learning with Language ModelsEthan Perez, Douwe Kiela, Kyunghyun Cho2021 · 403 citations
  45. The Hateful Memes Challenge: Detecting Hate Speech in Multimodal MemesDouwe Kiela, Hamed Firooz, Aravind Mohan, et al.2020 · 403 citations
  46. Social Biases in NLP Models as Barriers for Persons with DisabilitiesBen Hutchinson, Vinodkumar Prabhakaran, Emily Denton, et al.2020 · 402 citations
  47. Compressing BERT: Studying the Effects of Weight Pruning on Transfer LearningMitchell Gordon, Kevin Duh, Nicholas Andrews2020 · 400 citations
  48. How to Fine-Tune BERT for Text Classification?Chi Sun, Xipeng Qiu, Yige Xu, et al.2019 · 400 citations
  49. Neural Architectures for Nested NER through LinearizationJana Straková, Milan Straka, Jan Hajic2019 · 400 citations
  50. A Survey on Recent Approaches for Natural Language Processing in Low-Resource ScenariosMichael A. Hedderich, Lukas Lange, Heike Adel, et al.2021 · 399 citations
  51. LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language ModelsZhiqiang Hu, Lei Wang, Yihuai Lan, et al.2023 · 398 citations
  52. LongT5: Efficient Text-To-Text Transformer for Long SequencesMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 398 citations
  53. DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-CorrectionMohammadreza Pourreza, Davood Rafiei2023 · 397 citations
  54. A Unified Generative Framework for Aspect-based Sentiment AnalysisHang Yan, Junqi Dai, Tuo Ji, et al.2021 · 396 citations
  55. TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in FinanceFengbin Zhu, Wenqiang Lei, Youcheng Huang, et al.2021 · 396 citations
  56. Long Range Arena: A Benchmark for Efficient TransformersYi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 396 citations
  57. A Challenge Dataset and Effective Models for Aspect-Based Sentiment AnalysisQingnan Jiang, Lei Chen, Ruifeng Xu, et al.2019 · 393 citations
  58. A Unified Generative Framework for Various NER SubtasksHang Yan, Tao Gui, Junqi Dai, et al.2021 · 392 citations
  59. Cross-lingual Transfer Learning for Multilingual Task Oriented DialogSebastian Schuster, Sonal Gupta, Rushin Shah, et al.2019 · 390 citations
  60. BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelsElad Ben-Zaken, Shauli Ravfogel, Yoav Goldberg2021 · 388 citations
  61. Combating Adversarial Misspellings with Robust Word RecognitionDanish Pruthi, Bhuwan Dhingra, Zachary C. Lipton2019 · 388 citations
  62. WebShop: Towards Scalable Real-World Web Interaction with Grounded Language AgentsShunyu Yao, Howard Chen, John Yang, et al.2022 · 387 citations
  63. Representation Engineering: A Top-Down Approach to AI TransparencyAndy Zou, Long Phan, Sarah Chen, et al.2023 · 386 citations
  64. German's Next Language ModelBranden Chan, Stefan Schweter, Timo Möller2020 · 385 citations
  65. Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation MetricsNitika Mathur, Timothy Baldwin, Trevor Cohn2020 · 385 citations
  66. Pooled Contextualized Embeddings for Named Entity RecognitionAlan Akbik, Tanja Bergmann, Roland Vollgraf2019 · 385 citations
  67. A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language UnderstandingLibo Qin, Wanxiang Che, Yangming Li, et al.2019 · 384 citations
  68. Query Rewriting in Retrieval-Augmented Large Language ModelsXinbei Ma, Yeyun Gong, Pengcheng He, et al.2023 · 383 citations
  69. Retrieval Augmentation Reduces Hallucination in ConversationKurt Shuster, Spencer Poff, Moya Chen, et al.2021 · 382 citations
  70. Aligning AI With Shared Human ValuesDan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 382 citations
  71. Discourse-Aware Neural Extractive Text SummarizationJiacheng Xu, Zhe Gan, Yu Cheng, et al.2019 · 382 citations
  72. PyTorch Distributed: Experiences on Accelerating Data Parallel TrainingShen Li, Yanli Zhao, Rohan Varma, et al.2020 · 380 citations
  73. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingHangbo Bao, Li Dong, Furu Wei, et al.2020 · 380 citations
  74. LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language ModelsNeel Guha; Julian Nyarko; Daniel E. Ho; Christopher Re; Adam Chilton; Aditya Narayana; Alex Chohlas-Wood; Austin Peters; Brandon Waldon; Daniel N. Rockmore; Diego Zambrano; Dmitry Talisman; Enam Hoque; Faiz Surani; Frank Fagan; Galit Sarfaty; Gregory M. Dickinson; Haggai Porat; Jason Hegland; Jessica Wu; Joe Nudell; Joel Niklaus; John Nay; Jonathan H. Choi; Kevin Tobia; Margaret Hagan; Megan Ma; Michael Livermore; Nikon Rasumov-Rahe; Nils Holzenberger; Noam Kolt; Peter Henderson; Sean Rehaag; Sharad Goel; Shang Gao; Spencer Williams; Sunny Gandhi; Tom Zur; Varun Iyer;, Zehua Li2023 · 379 citations
  75. Reasoning with Latent Structure Refinement for Document-Level Relation ExtractionGuoshun Nan, Zhijiang Guo, Ivan Sekulic, et al.2020 · 379 citations
  76. Fine-Grained Analysis of Propaganda in News ArticlesGiovanni Da San Martino, Seunghak Yu, Alberto Barrón-Cedeño, et al.2019 · 379 citations
  77. Open Sesame: Getting inside BERT's Linguistic KnowledgeYongjie Lin, Yi Chern Tan, Robert Frank2019 · 379 citations
  78. Towards General Text Embeddings with Multi-stage Contrastive LearningZehan Li, Xin Zhang, Yanzhao Zhang, et al.2023 · 378 citations
  79. Emerging Cross-lingual Structure in Pretrained Language ModelsAlexis Conneau, Shijie Wu, Haoran Li, et al.2020 · 378 citations
  80. ETC: Encoding Long and Structured Inputs in TransformersJoshua Ainslie, Santiago Ontañón, Chris Alberti, et al.2020 · 377 citations
  81. Tool Learning with Foundation ModelsYujia Qin, Shengding Hu, Yankai Lin, et al.2023 · 376 citations
  82. HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual DataWenhu Chen, Hanwen Zha, Zhiyu Chen, et al.2020 · 376 citations
  83. Editing Models with Task ArithmeticGabriel Ilharco, Marco Tulio Ribeiro, Mitchell Wortsman, et al.2022 · 374 citations
  84. FastBERT: a Self-distilling BERT with Adaptive Inference TimeWeijie Liu, Peng Zhou, Zhiruo Wang, et al.2020 · 374 citations
  85. A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersPradeep Dasigi, Kyle Lo, Iz Beltagy, et al.2021 · 372 citations
  86. Position-Aware Tagging for Aspect Sentiment Triplet ExtractionLu Xu, Hao Li, Wei Lu, et al.2020 · 370 citations
  87. Green AIRoy Schwartz, Jesse Dodge, Noah A. Smith, et al.2019 · 370 citations
  88. Invariant Risk MinimizationMartin Arjovsky, Léon Bottou, Ishaan Gulrajani, et al.2019 · 370 citations
  89. Knowledge-Enriched Transformer for Emotion Detection in Textual ConversationsPeixiang Zhong, Di Wang, Chunyan Miao2019 · 370 citations
  90. Heterogeneous Graph Neural Networks for Extractive Document SummarizationDanqing Wang, Pengfei Liu, Yining Zheng, et al.2020 · 368 citations
  91. A Survey on Large Language Models for Code GenerationJuyong Jiang, Fan Wang, Jiasi Shen, et al.2024 · 366 citations
  92. Pre-training is a Hot Topic: Contextualized Document Embeddings Improve Topic CoherenceFederico Bianchi, Silvia Terragni, Dirk Hovy2021 · 365 citations
  93. The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language ModelsGo Inoue, Bashar Alhafni, Nurpeiis Baimukan, et al.2021 · 365 citations
  94. GlossBERT: BERT for Word Sense Disambiguation with Gloss KnowledgeLuyao Huang, Chi Sun, Xipeng Qiu, et al.2019 · 364 citations
  95. Augmented Language Models: a SurveyGrégoire Mialon, Roberto Dessì, Maria Lomeli, et al.2023 · 362 citations
  96. Revisiting Few-sample BERT Fine-tuningTianyi Zhang, Felix Wu, Arzoo Katiyar, et al.2020 · 361 citations
  97. Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text ClassificationShengding Hu, Ning Ding, Huadong Wang, et al.2022 · 360 citations
  98. TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented DialogueChien-Sheng Wu, Steven C.H. Hoi, Richard Socher, et al.2020 · 360 citations
  99. Datasets: A Community Library for Natural Language ProcessingQuentin Lhoest, Albert Villanova del Moral, Yacine Jernite, et al.2021 · 358 citations
  100. BRIO: Bringing Order to Abstractive SummarizationYixin Liu, Pengfei Liu, Dragomir Radev, et al.2022 · 357 citations

1 2 3 4 5 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/4/