Elamur Research⌕
☰
home / papers / BERT: Pre-training of Deep Bidirectional… / cited by / page 7

Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 7 of 15 · 601–700 · ← the paper

1 … 6 7 8 … 15

  1. Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-trainingOshin Agarwal, Heming Ge, Siamak Shakeri, et al.2021 · 238 citations
  2. Multimodal Few-Shot Learning with Frozen Language ModelsMaria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.2021 · 238 citations
  3. Perceiver: General Perception with Iterative AttentionAndrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 238 citations
  4. mGTE: Generalized Long-Context Text Representation and Reranking Models for Multilingual Text RetrievalXin Zhang, Yanzhao Zhang, Dingkun Long, et al.2024 · 236 citations
  5. COMET-ATOMIC 2020: On Symbolic and Neural Commonsense Knowledge GraphsJena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, et al.2020 · 235 citations
  6. Generative Language Modeling for Automated Theorem ProvingStanislas Polu, Ilya Sutskever2020 · 235 citations
  7. SemEval-2022 Task 5: Multimedia Automatic Misogyny IdentificationElisabetta Fersini, Francesca Gasparini, Giulia Rizzi, et al.2022 · 234 citations
  8. Self-Guided Contrastive Learning for BERT Sentence RepresentationsTaeuk Kim, Kang Min Yoo, Sang-goo Lee2021 · 234 citations
  9. The Importance of Modeling Social Factors of Language: Theory and PracticeDirk Hovy, Diyi Yang2021 · 234 citations
  10. Corpus Creation for Sentiment Analysis in Code-Mixed Tamil-English TextBharathi Raja Chakravarthi, Vigneshwaran Muralidaran, Ruba Priyadharshini, et al.2020 · 234 citations
  11. MultiQA: An Empirical Investigation of Generalization and Transfer in Reading ComprehensionAlon Talmor, Jonathan Berant2019 · 234 citations
  12. CONTaiNER: Few-Shot Named Entity Recognition via Contrastive LearningSarkar Snigdha Sarathi Das, Arzoo Katiyar, Rebecca Passonneau, et al.2022 · 233 citations
  13. A Discrete Hard EM Approach for Weakly Supervised Question AnsweringSewon Min, Danqi Chen, Hannaneh Hajishirzi, et al.2019 · 233 citations
  14. Dialog State Tracking: A Neural Reading Comprehension ApproachShuyang Gao, Abhishek Sethi, Sanchit Agarwal, et al.2019 · 233 citations
  15. Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human SupervisionZhiqing Sun, Yikang Shen, Qinhong Zhou, et al.2023 · 232 citations
  16. Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph InformationMichele Bevilacqua, Roberto Navigli2020 · 232 citations
  17. Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encodersTerra Blevins, Luke Zettlemoyer2020 · 232 citations
  18. How Context Affects Language Models' Factual PredictionsFabio Petroni, Patrick Lewis, Aleksandra Piktus, et al.2020 · 231 citations
  19. Compositional Questions Do Not Necessitate Multi-hop ReasoningSewon Min, Eric Wallace, Sameer Singh, et al.2019 · 231 citations
  20. Detecting Hallucinated Content in Conditional Neural Sequence GenerationChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 229 citations
  21. Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language TechnologiesSunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, et al.2021 · 228 citations
  22. CCAligned: A Massive Collection of Cross-Lingual Web-Document PairsAhmed El-Kishky, Vishrav Chaudhary, Francisco Guzmán, et al.2020 · 228 citations
  23. AlBERTo: Italian BERT Language Understanding Model for NLP Challenging Tasks Based on TweetsMarco Polignano, Pierpaolo Basile, Marco de Gemmis, et al.2019 · 228 citations
  24. Hurdles to Progress in Long-form Question AnsweringKalpesh Krishna, Aurko Roy, Mohit Iyyer2021 · 227 citations
  25. Neural CRF Model for Sentence Alignment in Text SimplificationChao Jiang, Mounica Maddela, Wuwei Lan, et al.2020 · 227 citations
  26. Overview of the TREC 2019 deep learning trackNick Craswell, Bhaskar Mitra, Emine Yilmaz, et al.2020 · 224 citations
  27. Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought PromptingHaoyang Huang, Tianyi Tang, Dongdong Zhang, et al.2023 · 223 citations
  28. Unsupervised Evaluation of Interactive Dialog with DialoGPTShikib Mehri, Maxine Eskenazi2020 · 223 citations
  29. Learning to Faithfully Rationalize by ConstructionSarthak Jain, Sarah Wiegreffe, Yuval Pinter, et al.2020 · 222 citations
  30. Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level Neural Machine TranslationMarcin Junczys-Dowmunt2019 · 222 citations
  31. The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling ObjectivesElena Voita, Rico Sennrich, Ivan Titov2019 · 222 citations
  32. HoVer: A Dataset for Many-Hop Fact Extraction And Claim VerificationYichen Jiang, Shikha Bordia, Zheng Zhong, et al.2020 · 221 citations
  33. Reasoning Over Semantic-Level Graph for Fact CheckingWanjun Zhong, Jingjing Xu, Duyu Tang, et al.2020 · 221 citations
  34. Transformer Memory as a Differentiable Search IndexYi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.2022 · 220 citations
  35. NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding ModelsChankyu Lee, Rajarshi Roy, Mengyao Xu, et al.2024 · 219 citations
  36. Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentYang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 219 citations
  37. Multilingual Translation from Denoising Pre-TrainingYuqing Tang, Chau Tran, Xian Li, et al.2021 · 219 citations
  38. A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource LanguagesPedro Javier Ortiz Suárez, Laurent Romary, Benoît Sagot2020 · 219 citations
  39. Generating Fact Checking ExplanationsPepa Atanasova, Jakob Grue Simonsen, Christina Lioma, et al.2020 · 219 citations
  40. What Happens To BERT Embeddings During Fine-tuning?Amil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, et al.2020 · 219 citations
  41. Head-Driven Phrase Structure Grammar Parsing on Penn TreebankJunru Zhou, Hai Zhao2019 · 219 citations
  42. Break It Down: A Question Understanding BenchmarkTomer Wolfson, Mor Geva, Ankit Gupta, et al.2020 · 218 citations
  43. Unsupervised Question Decomposition for Question AnsweringEthan Perez, Patrick Lewis, Wen-tau Yih, et al.2020 · 218 citations
  44. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsNeha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 217 citations
  45. FOLIO: Natural Language Reasoning with First-Order LogicSimeng Han, Hailey Schoelkopf, Yilun Zhao, et al.2022 · 217 citations
  46. Structured Pruning Learns Compact and Accurate ModelsMengzhou Xia, Zexuan Zhong, Danqi Chen2022 · 216 citations
  47. Birds have four legs?! NumerSense: Probing Numerical Commonsense Knowledge of Pre-Trained Language ModelsBill Yuchen Lin, Seyeon Lee, Rahul Khanna, et al.2020 · 216 citations
  48. Real-Time Open-Domain Question Answering with Dense-Sparse Phrase IndexMinjoon Seo, Jinhyuk Lee, Tom Kwiatkowski, et al.2019 · 216 citations
  49. YiSi - a Unified Semantic MT Quality Evaluation and Estimation Metric for Languages with Different Levels of Available ResourcesChi-kiu Lo2019 · 216 citations
  50. Annotating and Modeling Fine-grained Factuality in SummarizationTanya Goyal, Greg Durrett2021 · 215 citations
  51. Syntactic Data Augmentation Increases Robustness to Inference HeuristicsJunghyun Min, R. Thomas McCoy, Dipanjan Das, et al.2020 · 215 citations
  52. An Unsupervised Sentence Embedding Method by Mutual Information MaximizationYan Zhang, Ruidan He, Zuozhu Liu, et al.2020 · 213 citations
  53. Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, et al.2023 · 212 citations
  54. TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction TaskChristoph Alt, Aleksandra Gabryszak, Leonhard Hennig2020 · 212 citations
  55. MADLAD-400: A Multilingual And Document-Level Large Audited DatasetSneha Kudugunta, Isaac Caswell, Biao Zhang, et al.2023 · 211 citations
  56. Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?Byung-Doh Oh, William Schuler2023 · 211 citations
  57. An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language ModelsNicholas Meade, Elinor Poole-Dayan, Siva Reddy2022 · 211 citations
  58. Answers Unite! Unsupervised Metrics for Reinforced Summarization ModelsThomas Scialom, Sylvain Lamprier, Benjamin Piwowarski, et al.2019 · 210 citations
  59. LLM2Vec: Large Language Models Are Secretly Powerful Text EncodersParishad BehnamGhader, Vaibhav Adlakha, Marius Mosbach, et al.2024 · 209 citations
  60. Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free LunchLe Yu, Bowen Yu, Haiyang Yu, et al.2023 · 209 citations
  61. Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical ReasoningPan Lu, Liang Qiu, Kai-Wei Chang, et al.2022 · 209 citations
  62. Logical Natural Language Generation from Open-Domain TablesWenhu Chen, Jianshu Chen, Yu Su, et al.2020 · 209 citations
  63. Active Example Selection for In-Context LearningYiming Zhang, Shi Feng, Chenhao Tan2022 · 207 citations
  64. Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLPTimo Schick, Sahana Udupa, Hinrich Schutze2021 · 207 citations
  65. Enabling Language Models to Fill in the BlanksChris Donahue, Mina Lee, Percy Liang2020 · 207 citations
  66. Generating Training Data with Language Models: Towards Zero-Shot Language UnderstandingYu Meng, Jiaxin Huang, Yu Zhang, et al.2022 · 206 citations
  67. Prompting GPT-3 To Be ReliableChenglei Si, Zhe Gan, Zhengyuan Yang, et al.2022 · 206 citations
  68. Challenges in Detoxifying Language ModelsJohannes Welbl, Amelia Glaese, Jonathan Uesato, et al.2021 · 206 citations
  69. Explaining Answers with Entailment TreesBhavana Dalvi, Peter Jansen, Oyvind Tafjord, et al.2021 · 206 citations
  70. Training Question Answering Models From Synthetic DataRaul Puri, Ryan Spring, Mohammad Shoeybi, et al.2020 · 206 citations
  71. Entities as Experts: Sparse Memory Access with Entity SupervisionThibault Févry, Livio Baldini Soares, Nicholas FitzGerald, et al.2020 · 205 citations
  72. LLM+P: Empowering Large Language Models with Optimal Planning ProficiencyBo Liu, Yuqian Jiang, Xiaohan Zhang, et al.2023 · 204 citations
  73. Towards a Unified Multi-Dimensional Evaluator for Text GenerationMing Zhong, Yang Liu, Da Yin, et al.2022 · 204 citations
  74. Entity-level Factual Consistency of Abstractive Text SummarizationFeng Nan, Ramesh Nallapati, Zhiguo Wang, et al.2021 · 204 citations
  75. On the Effectiveness of Adapter-based Tuning for Pretrained Language Model AdaptationRuidan He, Linlin Liu, Hai Ye, et al.2021 · 204 citations
  76. mGPT: Few-Shot Learners Go MultilingualOleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
  77. Contextualizing Hate Speech Classifiers with Post-hoc ExplanationBrendan Kennedy, Xisen Jin, Aida Mostafazadeh Davani, et al.2020 · 203 citations
  78. DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationMojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, et al.2023 · 201 citations
  79. AraT5: Text-to-Text Transformers for Arabic Language GenerationEl Moatez Billah Nagoudi, AbdelRahim Elmadany, Muhammad Abdul-Mageed2022 · 201 citations
  80. Evaluating Factuality in Generation with Dependency-level EntailmentTanya Goyal, Greg Durrett2020 · 201 citations
  81. CTRLsum: Towards Generic Controllable Text SummarizationJunxian He, Wojciech Kryscinski, Bryan McCann, et al.2022 · 199 citations
  82. A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsMd Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.2023 · 198 citations
  83. Large Language Model as Attributed Training Data Generator: A Tale of Diversity and BiasYue Yu, Yuchen Zhuang, Jieyu Zhang, et al.2023 · 198 citations
  84. Model Tells You What to Discard: Adaptive KV Cache Compression for LLMsSuyu Ge, Yunan Zhang, Liyuan Liu, et al.2023 · 198 citations
  85. Toxicity Detection: Does Context Really Matter?John Pavlopoulos, Jeffrey Sorensen, Lucas Dixon, et al.2020 · 198 citations
  86. Improved Lexically Constrained Decoding for Translation and Monolingual RewritingJ. Edward Hu, Huda Khayrallah, Ryan Culkin, et al.2019 · 198 citations
  87. Improving Passage Retrieval with Zero-Shot Question GenerationDevendra Sachan, Mike Lewis, Mandar Joshi, et al.2022 · 197 citations
  88. COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingYu Meng, Chenyan Xiong, Payal Bajaj, et al.2021 · 196 citations
  89. Structured Pruning of Large Language ModelsZiheng Wang, Jeremy Wohlwend, Tao Lei2020 · 196 citations
  90. Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-TuningJesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, et al.2022 · 195 citations
  91. Results of the WMT20 Metrics Shared TaskNitika Mathur, Johnny Wei, Markus Freitag, et al.2020 · 195 citations
  92. InstructUIE: Multi-task Instruction Tuning for Unified Information ExtractionXiao Wang, Weikang Zhou, Can Zu, et al.2023 · 194 citations
  93. Time-Aware Language Models as Temporal Knowledge BasesBhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, et al.2022 · 194 citations
  94. End-to-End Slot Alignment and Recognition for Cross-Lingual NLUWeijia Xu, Batool Haider, Saab Mansour2020 · 194 citations
  95. Generative Data Augmentation for Commonsense ReasoningYiben Yang, Chaitanya Malaviya, Jared Fernandez, et al.2020 · 194 citations
  96. What Can We Learn from Collective Human Opinions on Natural Language Inference Data?Yixin Nie, Xiang Zhou, Mohit Bansal2020 · 193 citations
  97. MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningJun Chen, Deyao Zhu, Xiaoqian Shen, et al.2023 · 192 citations
  98. Exploring and Predicting Transferability across NLP TasksTu Vu, Tong Wang, Tsendsuren Munkhdalai, et al.2020 · 192 citations
  99. Auto-Debias: Debiasing Masked Language Models with Automated Biased PromptsYue Guo, Yi Yang, Ahmed Abbasi2022 · 191 citations
  100. Towards Making the Most of ChatGPT for Machine TranslationKeqin Peng, Liang Ding, Qihuang Zhong, et al.2023 · 190 citations

1 … 6 7 8 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/7/