🔗 Who cites «Deep Contextualized Word Representations»

3,240 papers of our library cite it (of the 140,884 whose bibliographies we read) · 388 with a page here, the most cited first · page 1 of 4 · 1–100 · ← the paper

1 2 3 4 next →

1. BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingJacob Devlin, Ming-Wei Chang, Kenton Lee, et al.2019 · 23,422 citations
2. Transformers: State-of-the-Art Natural Language ProcessingThomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,591 citations
3. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionMike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,752 citations
4. Chain-of-Thought Prompting Elicits Reasoning in Large Language ModelsJason Wei, Xuezhi Wang, Dale Schuurmans, et al.2022 · 11,278 citations
5. Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,295 citations
6. BioBERT: a pre-trained biomedical language representation model for biomedical text miningJinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.2019 · 8,281 citations
7. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerColin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 7,433 citations
8. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language UnderstandingAlex Wang, Amanpreet Singh, Julian Michael, et al.2018 · 7,141 citations
9. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,375 citations
10. Energy and Policy Considerations for Deep Learning in NLPEmma Strubell, Ananya Ganesh, Andrew McCallum2019 · 4,049 citations
11. XLNet: Generalized Autoregressive Pretraining for Language UnderstandingZhilin Yang, Zihang Dai, Yiming Yang, et al.2019 · 3,740 citations
12. SciBERT: A Pretrained Language Model for Scientific TextIz Beltagy, Kyle Lo, Arman Cohan2019 · 3,548 citations
13. HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden UnitsWei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, et al.2021 · 3,441 citations
14. Know What You Don't Know: Unanswerable Questions for SQuADPranav Rajpurkar, Robin Jia, Percy Liang2018 · 3,360 citations
15. On the Opportunities and Risks of Foundation ModelsRishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,044 citations
16. Language Models as Knowledge Bases?Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.2019 · 2,977 citations
17. CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesZhangyin Feng, Daya Guo, Duyu Tang, et al.2020 · 2,954 citations
18. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
19. LXMERT: Learning Cross-Modality Encoder Representations from TransformersHao Tan, Mohit Bansal2019 · 2,714 citations
20. Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingYu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon2020 · 2,636 citations
21. SpanBERT: Improving Pre-training by Representing and Predicting SpansMandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,580 citations
22. Evaluating Large Language Models Trained on CodeMark Chen, Jerry Tworek, Heewoo Jun, et al.2021 · 2,529 citations
23. UNITER: UNiversal Image-TExt Representation LearningYen-Chun Chen, Linjie Li, Licheng Yu, et al.2019 · 2,344 citations
24. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language TasksJiasen Lu, Dhruv Batra, Devi Parikh, et al.2019 · 2,217 citations
25. SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsAlex Wang, Yada Pruksachatkun, Nikita Nangia, et al.2019 · 2,187 citations
26. How Multilingual is Multilingual BERT?Telmo Pires, Eva Schlinger, Dan Garrette2019 · 2,095 citations
27. BERT Rediscovers the Classical NLP PipelineIan Tenney, Dipanjan Das, Ellie Pavlick2019 · 1,993 citations
28. AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated PromptsTaylor Shin, Yasaman Razeghi, Robert L. Logan IV, et al.2020 · 1,879 citations
29. Unsupervised Data Augmentation for Consistency TrainingQizhe Xie, Zihang Dai, Eduard Hovy, et al.2019 · 1,837 citations
30. AllenNLP: A Deep Semantic Natural Language Processing PlatformMatt Gardner, Joel Grus, Mark Neumann, et al.2018 · 1,804 citations
31. COMET: A Neural Framework for MT EvaluationRicardo Rei, Craig Stewart, Ana C Farinha, et al.2020 · 1,784 citations
32. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTOmar Khattab, Matei Zaharia2020 · 1,776 citations
33. Pre-trained Models for Natural Language Processing: A SurveyXipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,740 citations
34. Longformer: The Long-Document TransformerIz Beltagy, Matthew E. Peters, Arman Cohan2020 · 1,737 citations
35. Leveraging Passage Retrieval with Generative Models for Open Domain Question AnsweringGautier Izacard, Edouard Grave2021 · 1,674 citations
36. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,548 citations
37. Unifying Large Language Models and Knowledge Graphs: A RoadmapShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,545 citations
38. VisualBERT: A Simple and Performant Baseline for Vision and LanguageLiunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,510 citations
39. Multi-Task Deep Neural Networks for Natural Language UnderstandingXiaodong Liu, Pengcheng He, Weizhu Chen, et al.2019 · 1,501 citations
40. How Can We Know What Language Models Know?Zhengbao Jiang, Frank F. Xu, Jun Araki, et al.2020 · 1,493 citations
41. Contextual String Embeddings for Sequence LabelingAlan Akbik, Duncan Blythe, Roland Vollgraf2018 · 1,390 citations
42. Unified Language Model Pre-training for Natural Language Understanding and GenerationLi Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,389 citations
43. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsAlexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.2020 · 1,355 citations
44. LaMDA: Language Models for Dialog ApplicationsRomal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,314 citations
45. VideoBERT: A Joint Model for Video and Language Representation LearningChen Sun, Austin Myers, Carl Vondrick, et al.2019 · 1,305 citations
46. BoolQ: Exploring the Surprising Difficulty of Natural Yes/No QuestionsChristopher Clark, Kenton Lee, Ming-Wei Chang, et al.2019 · 1,299 citations
47. AraBERT: Transformer-based Model for Arabic Language UnderstandingWissam Antoun, Fady Baly, Hazem Hajj2020 · 1,297 citations
48. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
49. COMET: Commonsense Transformers for Automatic Knowledge Graph ConstructionAntoine Bosselut, Hannah Rashkin, Maarten Sap, et al.2019 · 1,282 citations
50. CTRL: A Conditional Transformer Language Model for Controllable GenerationNitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.2019 · 1,273 citations
51. The Rise and Potential of Large Language Model Based Agents: A SurveyZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,262 citations
52. CamemBERT: a Tasty French Language ModelLouis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,262 citations
53. Latent Retrieval for Weakly Supervised Open Domain Question AnsweringKenton Lee, Ming-Wei Chang, Kristina Toutanova2019 · 1,234 citations
54. A Structural Probe for Finding Syntax in Word RepresentationsJohn Hewitt, Christopher D. Manning2019 · 1,228 citations
55. Publicly Available Clinical BERT EmbeddingsEmily Alsentzer, John R. Murphy, Willie Boag, et al.2019 · 1,209 citations
56. Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order SensitivityYao Lu, Max Bartolo, Alastair Moore, et al.2022 · 1,187 citations
57. PubMedQA: A Dataset for Biomedical Research Question AnsweringQiao Jin, Bhuwan Dhingra, Zhengping Liu, et al.2019 · 1,152 citations
58. CommonsenseQA: A Question Answering Challenge Targeting Commonsense KnowledgeAlon Talmor, Jonathan Herzig, Nicholas Lourie, et al.2019 · 1,146 citations
59. Program Synthesis with Large Language ModelsJacob Austin, Augustus Odena, Maxwell Nye, et al.2021 · 1,136 citations
60. StereoSet: Measuring stereotypical bias in pretrained language modelsMoin Nadeem, Anna Bethke, Siva Reddy2021 · 1,131 citations
61. MASS: Masked Sequence to Sequence Pre-training for Language GenerationKaitao Song, Xu Tan, Tao Qin, et al.2019 · 1,109 citations
62. SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)Marcos Zampieri, Shervin Malmasi, Preslav Nakov, et al.2019 · 1,109 citations
63. QuAC: Question Answering in ContextEunsol Choi, He He, Mohit Iyyer, et al.2018 · 1,057 citations
64. Linguistic Knowledge and Transferability of Contextual RepresentationsNelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,011 citations
65. K-BERT: Enabling Language Representation with Knowledge GraphWeijie Liu, Peng Zhou, Zhe Zhao, et al.2019 · 1,006 citations
66. MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited DevicesZhiqing Sun, Hongkun Yu, Xiaodan Song, et al.2020 · 1,003 citations
67. ERNIE 2.0: A Continual Pre-training Framework for Language UnderstandingYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 976 citations
68. ERNIE: Enhanced Representation through Knowledge IntegrationYu Sun, Shuohuan Wang, Yukun Li, et al.2019 · 949 citations
69. DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over ParagraphsDheeru Dua, Yizhong Wang, Pradeep Dasigi, et al.2019 · 941 citations
70. Patient Knowledge Distillation for BERT Model CompressionSiqi Sun, Yu Cheng, Zhe Gan, et al.2019 · 939 citations
71. Bottom-Up Abstractive SummarizationSebastian Gehrmann, Yuntian Deng, Alexander Rush2018 · 939 citations
72. Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph ConstructionYi Luan, Luheng He, Mari Ostendorf, et al.2018 · 933 citations
73. Extracting Training Data from Large Language ModelsNicholas Carlini, Florian Tramer, Eric Wallace, et al.2020 · 901 citations
74. CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language ModelsNikita Nangia, Clara Vania, Rasika Bhalerao, et al.2020 · 886 citations
75. TaPas: Weakly Supervised Table Parsing via Pre-trainingJonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, et al.2020 · 844 citations
76. A Unified MRC Framework for Named Entity RecognitionXiaoya Li, Jingrong Feng, Yuxian Meng, et al.2020 · 833 citations
77. MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover DistanceWei Zhao, Maxime Peyrard, Fei Liu, et al.2019 · 822 citations
78. Entity, Relation, and Event Extraction with Contextualized Span RepresentationsDavid Wadden, Ulme Wennberg, Yi Luan, et al.2019 · 818 citations
79. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 806 citations
80. Learning Deep Transformer Models for Machine TranslationQiang Wang, Bei Li, Tong Xiao, et al.2019 · 798 citations
81. ClinicalBERT: Modeling Clinical Notes and Predicting Hospital ReadmissionKexin Huang, Jaan Altosaar, Rajesh Ranganath2019 · 788 citations
82. On Measuring Social Biases in Sentence EncodersChandler May, Alex Wang, Shikha Bordia, et al.2019 · 761 citations
83. Constituency Parsing with a Self-Attentive EncoderNikita Kitaev, Dan Klein2018 · 759 citations
84. EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification TasksJason Wei, Kai Zou2019 · 750 citations
85. Integrating Multimodal Information in Large Pretrained TransformersWasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.2020 · 742 citations
86. Dice Loss for Data-imbalanced NLP TasksXiaoya Li, Xiaofei Sun, Yuxian Meng, et al.2020 · 734 citations
87. IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian LanguagesDivyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.2020 · 730 citations
88. Mitigating Gender Bias in Natural Language Processing: Literature ReviewTony Sun, Andrew Gaut, Shirlyn Tang, et al.2019 · 716 citations
89. Transfer Learning in Natural Language ProcessingSebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, et al.2019 · 700 citations
90. GLTR: Statistical Detection and Visualization of Generated TextSebastian Gehrmann, Hendrik Strobelt, Alexander M. Rush2019 · 691 citations
91. SPECTER: Document-level Representation Learning using Citation-informed TransformersArman Cohan, Sergey Feldman, Iz Beltagy, et al.2020 · 690 citations
92. TaBERT: Pretraining for Joint Understanding of Textual and Tabular DataPengcheng Yin, Graham Neubig, Wen-tau Yih, et al.2020 · 690 citations
93. Explain Yourself! Leveraging Language Models for Commonsense ReasoningNazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.2019 · 690 citations
94. DialoGPT: Large-Scale Generative Pre-training for Conversational Response GenerationYizhe Zhang, Siqi Sun, Michel Galley, et al.2019 · 684 citations
95. Well-Read Students Learn Better: On the Importance of Pre-training Compact ModelsIulia Turc, Ming-Wei Chang, Kenton Lee, et al.2019 · 671 citations
96. K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersRuize Wang, Duyu Tang, Nan Duan, et al.2020 · 662 citations
97. CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataGuillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.2020 · 650 citations
98. FLAIR: An Easy-to-Use Framework for State-of-the-Art NLPAlan Akbik, Tanja Bergmann, Duncan Blythe, et al.2019 · 645 citations
99. Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and BeyondMikel Artetxe, Holger Schwenk2018 · 627 citations
100. Efficient Intent Detection with Dual Sentence EncodersIñigo Casanueva, Tadas Temčinas, Daniela Gerz, et al.2020 · 622 citations

1 2 3 4 next →

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/