Elamur Research⌕
☰
home / papers / BERT: Pre-training of Deep Bidirectional… / cited by / page 2

Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 2 of 15 · 101–200 · ← the paper

1 2 3 … 15

  1. What Makes Good In-Context Examples for GPT-3?Jiachang Liu, Dinghan Shen, Yizhe Zhang, et al.2022 · 1,235 citations
  2. Latent Retrieval for Weakly Supervised Open Domain Question AnsweringKenton Lee, Ming-Wei Chang, Kristina Toutanova2019 · 1,234 citations
  3. A Structural Probe for Finding Syntax in Word RepresentationsJohn Hewitt, Christopher D. Manning2019 · 1,228 citations
  4. PIQA: Reasoning about Physical Commonsense in Natural LanguageYonatan Bisk, Rowan Zellers, Ronan Le Bras, et al.2019 · 1,218 citations
  5. Publicly Available Clinical BERT EmbeddingsEmily Alsentzer, John R. Murphy, Willie Boag, et al.2019 · 1,209 citations
  6. Recipes for Building an Open-Domain ChatbotStephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,206 citations
  7. Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order SensitivityYao Lu, Max Bartolo, Alastair Moore, et al.2022 · 1,187 citations
  8. A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the UglyYifan Yao, Jinhao Duan, Kaidi Xu, et al.2023 · 1,181 citations
  9. On the Cross-lingual Transferability of Monolingual RepresentationsMikel Artetxe, Sebastian Ruder, Dani Yogatama2020 · 1,168 citations
  10. BERTweet: A pre-trained language model for English TweetsDat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen2020 · 1,139 citations
  11. Program Synthesis with Large Language ModelsJacob Austin, Augustus Odena, Maxwell Nye, et al.2021 · 1,136 citations
  12. StereoSet: Measuring stereotypical bias in pretrained language modelsMoin Nadeem, Anna Bethke, Siva Reddy2021 · 1,131 citations
  13. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze2021 · 1,118 citations
  14. Prompt Programming for Large Language Models: Beyond the Few-Shot ParadigmLaria Reynolds, Kyle McDonell2021 · 1,111 citations
  15. MASS: Masked Sequence to Sequence Pre-training for Language GenerationKaitao Song, Xu Tan, Tao Qin, et al.2019 · 1,109 citations
  16. SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)Marcos Zampieri, Shervin Malmasi, Preslav Nakov, et al.2019 · 1,109 citations
  17. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,105 citations
  18. Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemMirac Suzgun, Nathan Scales, Nathanael Schärli, et al.2023 · 1,094 citations
  19. Bias and Fairness in Large Language Models: A SurveyIsabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.2023 · 1,072 citations
  20. RoFormer: Enhanced Transformer with Rotary Position EmbeddingJianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 1,072 citations
  21. Quantifying Attention Flow in TransformersSamira Abnar, Willem Zuidema2020 · 1,049 citations
  22. GPT Understands, TooXiao Liu, Yanan Zheng, Zhengxiao Du, et al.2021 · 1,039 citations
  23. MTEB: Massive Text Embedding BenchmarkNiklas Muennighoff, Nouamane Tazi, Loïc Magne, et al.2022 · 1,021 citations
  24. P-Tuning: Prompt Tuning Can Be Comparable to Fine-tuning Across Scales and TasksXiao Liu, Kaixuan Ji, Yicheng Fu, et al.2022 · 1,013 citations
  25. Linguistic Knowledge and Transferability of Contextual RepresentationsNelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,011 citations
  26. VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsWeijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,008 citations
  27. A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language ModelsWenqi Fan; Yujuan Ding; Liangbo Ning; Shijie Wang; Hengyun Li; Dawei Yin; Tat-Seng Chua;, Qing Li2024 · 1,006 citations
  28. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, et al.2019 · 1,006 citations
  29. MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesZhiqing Sun, Hongkun Yu, Xiaodan Song, et al.2020 · 1,003 citations
  30. Big Bird: Transformers for Longer SequencesManzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.2020 · 992 citations
  31. ERNIE 2.0: A Continual Pre-training Framework for Language UnderstandingYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 976 citations
  32. PaLM 2 Technical ReportRohan Anil, Andrew M. Dai, Orhan Firat, et al.2023 · 971 citations
  33. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 962 citations
  34. TweetEval: Unified Benchmark and Comparative Evaluation for Tweet ClassificationFrancesco Barbieri, Jose Camacho-Collados, Leonardo Neves, et al.2020 · 952 citations
  35. ERNIE: Enhanced Representation through Knowledge IntegrationYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 949 citations
  36. AdapterFusion: Non-Destructive Task Composition for Transfer LearningJonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé, et al.2020 · 948 citations
  37. MPNet: Masked and Permuted Pre-training for Language UnderstandingKaitao Song, Xu Tan, Tao Qin, et al.2020 · 944 citations
  38. DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over ParagraphsDheeru Dua, Yizhong Wang, Pradeep Dasigi, et al.2019 · 941 citations
  39. Patient Knowledge Distillation for BERT Model CompressionSiqi Sun, Yu Cheng, Zhe Gan, et al.2019 · 939 citations
  40. A Survey of Data Augmentation Approaches for NLPSteven Y. Feng, Varun Gangal, Jason Wei, et al.2021 · 935 citations
  41. C-Pack: Packed Resources For General Chinese EmbeddingsShitao Xiao, Zheng Liu, Peitian Zhang, et al.2023 · 920 citations
  42. Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 901 citations
  43. LayoutLM: Pre-training of Text and Layout for Document Image UnderstandingYiheng Xu, Minghao Li, Lei Cui, et al.2019 · 889 citations
  44. Do As I Can, Not As I Say: Grounding Language in Robotic AffordancesMichael Ahn, Anthony Brohan, Noah Brown, et al.2022 · 873 citations
  45. ChatGPT: Jack of all trades, master of noneJan Kocon, Igor Cichecki, Oliwier Kaszyca, et al.2023 · 863 citations
  46. TaPas: Weakly Supervised Table Parsing via Pre-trainingJonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, et al.2020 · 844 citations
  47. UNIFIEDQA: Crossing Format Boundaries with a Single QA SystemDaniel Khashabi, Sewon Min, Tushar Khot, et al.2020 · 843 citations
  48. BERT-ATTACK: Adversarial Attack Against BERT Using BERTLinyang Li, Ruotian Ma, Qipeng Guo, et al.2020 · 840 citations
  49. A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, et al.2020 · 833 citations
  50. MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferJonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 831 citations
  51. On the Sentence Embeddings from Pre-trained Language ModelsBohan Li, Hao Zhou, Junxian He, et al.2020 · 830 citations
  52. Unsupervised Dense Information Retrieval with Contrastive LearningGautier Izacard, Mathilde Caron, Lucas Hosseini, et al.2021 · 824 citations
  53. MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover DistanceWei Zhao, Maxime Peyrard, Fei Liu, et al.2019 · 822 citations
  54. DocVQA: A Dataset for VQA on Document ImagesMinesh Mathew, Dimosthenis Karatzas, C.V. Jawahar2020 · 820 citations
  55. ERASER: A Benchmark to Evaluate Rationalized NLP ModelsJay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, et al.2020 · 820 citations
  56. Is ChatGPT a General-Purpose Natural Language Processing Task Solver?Chengwei Qin, Aston Zhang, Zhuosheng Zhang, et al.2023 · 818 citations
  57. GPT-NeoX-20B: An Open-Source Autoregressive Language ModelSidney Black, Stella Biderman, Eric Hallahan, et al.2022 · 818 citations
  58. Entity, Relation, and Event Extraction with Contextualized Span RepresentationsDavid Wadden, Ulme Wennberg, Yi Luan, et al.2019 · 818 citations
  59. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 806 citations
  60. BARTScore: Evaluating Generated Text as Text GenerationWeizhe Yuan, Graham Neubig, Pengfei Liu2021 · 806 citations
  61. XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 799 citations
  62. Learning Deep Transformer Models for Machine TranslationQiang Wang, Bei Li, Tong Xiao, et al.2019 · 798 citations
  63. Calibrate Before Use: Improving Few-Shot Performance of Language ModelsTony Z. Zhao, Eric Wallace, Shi Feng, et al.2021 · 791 citations
  64. Revisiting Pre-Trained Models for Chinese Natural Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, et al.2020 · 788 citations
  65. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital ReadmissionKexin Huang, Jaan Altosaar, Rajesh Ranganath2019 · 788 citations
  66. Explainability for Large Language Models: A SurveyHaiyan Zhao, Hanjie Chen, Fan Yang, et al.2023 · 785 citations
  67. Towards Reasoning in Large Language Models: A SurveyJie Huang, Kevin Chen-Chuan Chang2023 · 775 citations
  68. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
  69. Relational Graph Attention Network for Aspect-based Sentiment AnalysisKai Wang, Weizhou Shen, Yunyi Yang, et al.2020 · 775 citations
  70. LayoutLMv3: Pre-training for Document AI with Unified Text and Image MaskingYupan Huang, Tengchao Lv, Lei Cui, et al.2022 · 774 citations
  71. Reformer: The Efficient TransformerNikita Kitaev, Łukasz Kaiser, Anselm Levskaya2020 · 774 citations
  72. ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionWonjae Kim, Bokyung Son, Ildoo Kim2021 · 762 citations
  73. On Measuring Social Biases in Sentence EncodersChandler May, Alex Wang, Shikha Bordia, et al.2019 · 761 citations
  74. Reproducible scaling laws for contrastive language-image learningMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 750 citations
  75. EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification TasksJason Wei, Kai Zou2019 · 750 citations
  76. ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 744 citations
  77. Integrating Multimodal Information in Large Pretrained TransformersWasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.2020 · 742 citations
  78. Revealing the Dark Secrets of BERTOlga Kovaleva, Alexey Romanov, Anna Rogers, et al.2019 · 737 citations
  79. Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context LearningHaokun Liu, Derek Tam, Mohammed Muqeeth, et al.2022 · 735 citations
  80. Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning StepsXanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, et al.2020 · 735 citations
  81. MLQA: Evaluating Cross-lingual Extractive Question AnsweringPatrick Lewis, Barlas Oğuz, Ruty Rinott, et al.2019 · 735 citations
  82. A Novel Cascade Binary Tagging Framework for Relational Triple ExtractionZhepei Wei, Jianlin Su, Yue Wang, et al.2020 · 732 citations
  83. Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment ApproachWenpeng Yin, Jamaal Hay, Dan Roth2019 · 731 citations
  84. IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian LanguagesDivyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.2020 · 730 citations
  85. Learning To Retrieve Prompts for In-Context LearningOhad Rubin, Jonathan Herzig, Jonathan Berant2021 · 717 citations
  86. A Multiscale Visualization of Attention in the Transformer ModelJesse Vig2019 · 708 citations
  87. Fact or Fiction: Verifying Scientific ClaimsDavid Wadden, Shanchuan Lin, Kyle Lo, et al.2020 · 706 citations
  88. Capabilities of GPT-4 on Medical Challenge ProblemsHarsha Nori, Nicholas King, Scott Mayer McKinney, et al.2023 · 700 citations
  89. Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 692 citations
  90. GLTR: Statistical Detection and Visualization of Generated TextSebastian Gehrmann, Hendrik Strobelt, Alexander M. Rush2019 · 691 citations
  91. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, et al.2020 · 690 citations
  92. TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, et al.2020 · 690 citations
  93. Explain Yourself! Leveraging Language Models for Commonsense ReasoningNazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.2019 · 690 citations
  94. CORD-19: The COVID-19 Open Research DatasetLucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, et al.2020 · 685 citations
  95. Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model SizesCheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, et al.2023 · 684 citations
  96. DialoGPT: Large-Scale Generative Pre-training for Conversational Response GenerationYizhe Zhang, Siqi Sun, Michel Galley, et al.2019 · 684 citations
  97. ELI5: Long Form Question AnsweringAngela Fan, Yacine Jernite, Ethan Perez, et al.2019 · 682 citations
  98. Large Language Models Are Human-Level Prompt EngineersYongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.2022 · 677 citations
  99. Mask-Predict: Parallel Decoding of Conditional Masked Language ModelsMarjan Ghazvininejad, Omer Levy, Yinhan Liu, et al.2019 · 671 citations
  100. Well-Read Students Learn Better: On the Importance of Pre-training Compact ModelsIulia Turc, Ming-Wei Chang, Kenton Lee, et al.2019 · 671 citations

1 2 3 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/2/