Elamur Research⌕
☰
home / papers / BERT: Pre-training of Deep Bidirectional… / cited by / page 9

Who cites «BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding»

23,422 papers of our library cite it (of the 140,884 whose bibliographies we read) · 1500 with a page here, the most cited first · page 9 of 15 · 801–900 · ← the paper

1 … 8 9 10 … 15

  1. MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity RecognitionDavid Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, et al.2022 · 150 citations
  2. Pre-Training BERT on Arabic Tweets: Practical ConsiderationsAhmed Abdelali, Sabit Hassan, Hamdy Mubarak, et al.2021 · 150 citations
  3. Generation-Augmented Retrieval for Open-domain Question AnsweringYuning Mao, Pengcheng He, Xiaodong Liu, et al.2020 · 150 citations
  4. Language Model Tokenizers Introduce Unfairness Between LanguagesAleksandar Petrov, Emanuele La Malfa, Philip H. S. Torr, et al.2023 · 149 citations
  5. HyperTree Proof Search for Neural Theorem ProvingGuillaume Lample, Marie-Anne Lachaux, Thibaut Lavril, et al.2022 · 149 citations
  6. ProsocialDialog: A Prosocial Backbone for Conversational AgentsHyunwoo Kim, Youngjae Yu, Liwei Jiang, et al.2022 · 149 citations
  7. Investigating Pretrained Language Models for Graph-to-Text GenerationLeonardo F. R. Ribeiro, Martin Schmitt, Hinrich Schütze, et al.2021 · 149 citations
  8. TORQUE: A Reading Comprehension Dataset of Temporal Ordering QuestionsQiang Ning, Hao Wu, Rujun Han, et al.2020 · 149 citations
  9. Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative DecodingJun Zhang, Jue Wang, Huan Li, et al.2024 · 146 citations
  10. SemEval-2022 Task 6: iSarcasmEval, Intended Sarcasm Detection in English and ArabicIbrahim Abu Farha, Silviu Vlad Oprea, Steven Wilson, et al.2022 · 146 citations
  11. Word-Level Coreference ResolutionVladimir Dobrovolskii2021 · 146 citations
  12. Fact-Checking Complex Claims with Program-Guided ReasoningLiangming Pan, Xiaobao Wu, Xinyuan Lu, et al.2023 · 145 citations
  13. The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual DatasetHugo Laurençon, Lucile Saulnier, Thomas Wang, et al.2023 · 145 citations
  14. Efficient Second-Order TreeCRF for Neural Dependency ParsingYu Zhang, Zhenghua Li, Min Zhang2020 · 145 citations
  15. Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with NothingZhangchen Xu, Fengqing Jiang, Luyao Niu, et al.2024 · 144 citations
  16. Unified Demonstration Retriever for In-Context LearningXiaonan Li, Kai Lv, Hang Yan, et al.2023 · 144 citations
  17. Is GPT-3 a Good Data Annotator?Bosheng Ding, Chengwei Qin, Linlin Liu, et al.2022 · 144 citations
  18. GLUCOSE: GeneraLized and COntextualized Story ExplanationsNasrin Mostafazadeh, Aditya Kalyanpur, Lori Moon, et al.2020 · 144 citations
  19. Revealing the Myth of Higher-Order Inference in Coreference ResolutionLiyan Xu, Jinho D. Choi2020 · 144 citations
  20. UNQOVERing Stereotyping Biases via Underspecified QuestionsTao Li, Daniel Khashabi, Tushar Khot, et al.2020 · 144 citations
  21. Rethinking embedding coupling in pre-trained language modelsHyung Won Chung, Thibault Févry, Henry Tsai, et al.2020 · 142 citations
  22. A Token-level Reference-free Hallucination Detection Benchmark for Free-form Text GenerationTianyu Liu, Yizhe Zhang, Chris Brockett, et al.2022 · 140 citations
  23. Paragraph-level Simplification of Medical TextsAshwin Devaraj, Iain Marshall, Byron Wallace, et al.2021 · 139 citations
  24. A Report on the 2020 VUA and TOEFL Metaphor Detection Shared TaskChee Wee (Ben) Leong, Beata Beigman Klebanov, Chris Hamill, et al.2020 · 138 citations
  25. Efficient Training of Language Models to Fill in the MiddleMohammad Bavarian, Heewoo Jun, Nikolas Tezak, et al.2022 · 137 citations
  26. Attributed Question Answering: Evaluation and Modeling for Attributed Large Language ModelsBernd Bohnet, Vinh Q. Tran, Pat Verga, et al.2022 · 136 citations
  27. Fantastic Questions and Where to Find Them: FairytaleQA – An Authentic Dataset for Narrative ComprehensionYing Xu, Dakuo Wang, Mo Yu, et al.2022 · 136 citations
  28. Byte Pair Encoding is Suboptimal for Language Model PretrainingKaj Bostrom, Greg Durrett2020 · 136 citations
  29. SIB-200: A Simple, Inclusive, and Big Evaluation Dataset for Topic Classification in 200+ Languages and DialectsDavid Ifeoluwa Adelani, Hannah Liu, Xiaoyu Shen, et al.2023 · 135 citations
  30. Affective and Contextual Embedding for Sarcasm DetectionNastaran Babanejad, Heidar Davoudi, Aijun An, et al.2020 · 135 citations
  31. Simple and Effective Masked Diffusion Language ModelsSubham Sekhar Sahoo, Marianne Arriola, Yair Schiff, et al.2024 · 134 citations
  32. Few-Shot Self-Rationalization with Natural Language PromptsAna Marasovic, Iz Beltagy, Doug Downey, et al.2022 · 134 citations
  33. Enhancing Zero-shot and Few-shot Stance Detection with Commonsense Knowledge GraphRui Liu, Zheng Lin, Yutong Tan, et al.2021 · 134 citations
  34. Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic ReasoningPan Lu, Ran Gong, Shibiao Jiang, et al.2021 · 134 citations
  35. Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and ApproachesShane Storks, Qiaozi Gao, Joyce Y. Chai2019 · 134 citations
  36. TICO-19: the Translation Initiative for COvid-19Antonios Anastasopoulos, Alessandro Cattelan, Zi-Yi Dou, et al.2020 · 133 citations
  37. Next Sentence Prediction helps Implicit Discourse Relation Classification within and across DomainsWei Shi, Vera Demberg2019 · 133 citations
  38. Long-context LLMs Struggle with Long In-context LearningTianle Li, Ge Zhang, Quy Duc Do, et al.2024 · 132 citations
  39. Formal Mathematics Statement Curriculum LearningStanislas Polu, Jesse Michael Han, Kunhao Zheng, et al.2022 · 132 citations
  40. Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge EnhancementHui Liu, Wenya Wang, Haoliang Li2022 · 132 citations
  41. Task-aware Retrieval with InstructionsAkari Asai, Timo Schick, Patrick Lewis, et al.2023 · 131 citations
  42. Extracting Latent Steering Vectors from Pretrained Language ModelsNishant Subramani, Nivedita Suresh, Matthew Peters2022 · 131 citations
  43. Learning Compact Metrics for MTAmy Pu, Hyung Won Chung, Ankur Parikh, et al.2021 · 130 citations
  44. An Analysis of Natural Language Inference Benchmarks through the Lens of NegationMd Mosharaf Hossain, Venelin Kovatchev, Pranoy Dutta, et al.2020 · 130 citations
  45. Analyzing Transformers in Embedding SpaceGuy Dar, Mor Geva, Ankit Gupta, et al.2023 · 129 citations
  46. Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction BenchmarkJoel Niklaus, Ilias Chalkidis, Matthias Stürmer2021 · 129 citations
  47. Still a Pain in the Neck: Evaluating Text Representations on Lexical CompositionVered Shwartz, Ido Dagan2019 · 129 citations
  48. Sequence Parallelism: Long Sequence Training from System PerspectiveShenggui Li, Fuzhao Xue, Chaitanya Baranwal, et al.2023 · 128 citations
  49. Bitext Mining Using Distilled Sentence Representations for Low-Resource LanguagesKevin Heffernan, Onur Çelebi, Holger Schwenk2022 · 127 citations
  50. NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment AnalysisShamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, et al.2022 · 127 citations
  51. Arabic aspect based sentiment analysis using bidirectional GRU based modelsMohammed M.Abdelgwad, Taysir Hassan A Soliman, Ahmed I.Taloba, et al.2021 · 127 citations
  52. Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error DetectorsLiyan Tang, Tanya Goyal, Alex Fabbri, et al.2023 · 126 citations
  53. Interpretable Neural Predictions with Differentiable Binary VariablesJasmijn Bastings, Wilker Aziz, Ivan Titov2019 · 126 citations
  54. Adversarial Learning for Zero-Shot Stance Detection on Social MediaEmily Allaway, Malavika Srikanth, Kathleen McKeown2021 · 124 citations
  55. Large Language Model Alignment: A SurveyTianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 123 citations
  56. Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across LanguagesLibo Qin, Qiguang Chen, Fuxuan Wei, et al.2023 · 122 citations
  57. LEVER: Learning to Verify Language-to-Code Generation with ExecutionAnsong Ni, Srini Iyer, Dragomir Radev, et al.2023 · 122 citations
  58. LEXTREME: A Multi-Lingual and Multi-Task Benchmark for the Legal DomainJoel Niklaus, Veton Matoshi, Pooja Rani, et al.2023 · 122 citations
  59. EQUATE: A Benchmark Evaluation Framework for Quantitative Reasoning in Natural Language InferenceAbhilasha Ravichander, Aakanksha Naik, Carolyn Rose, et al.2019 · 122 citations
  60. Generative Judge for Evaluating AlignmentJunlong Li, Shichao Sun, Weizhe Yuan, et al.2023 · 121 citations
  61. Automated evaluation of written discourse coherence using GPT-4Ben Naismith, Phoebe Mulcaire, Jill Burstein2023 · 120 citations
  62. Transformer-Patcher: One Mistake worth One NeuronZeyu Huang, Yikang Shen, Xiaofeng Zhang, et al.2023 · 120 citations
  63. High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural MetricsMarkus Freitag, David Grangier, Qijun Tan, et al.2022 · 120 citations
  64. AlphaMath Almost Zero: Process Supervision without ProcessGuoxin Chen, Minpeng Liao, Chengxi Li, et al.2024 · 119 citations
  65. Knowledge Enhanced Masked Language Model for Stance DetectionKornraphop Kawintiranon, Lisa Singh2021 · 119 citations
  66. Knowledge-Augmented Language Model Prompting for Zero-Shot Knowledge Graph Question AnsweringJinheon Baek, Alham Fikri Aji, Amir Saffari2023 · 118 citations
  67. I-BERT: Integer-only BERT QuantizationSehoon Kim, Amir Gholami, Zhewei Yao, et al.2021 · 118 citations
  68. Encode, Tag, Realize: High-Precision Text EditingEric Malmi, Sebastian Krause, Sascha Rothe, et al.2019 · 118 citations
  69. Pretraining Language Models with Human PreferencesTomasz Korbak, Kejian Shi, Angelica Chen, et al.2023 · 117 citations
  70. MUSS: Multilingual Unsupervised Sentence Simplification by Mining ParaphrasesLouis Martin, Angela Fan, Éric de la Clergerie, et al.2022 · 117 citations
  71. ArabicMMLU: Assessing Massive Multitask Language Understanding in ArabicFajri Koto, Haonan Li, Sara Shatnawi, et al.2024 · 116 citations
  72. Intrinsic Bias Metrics Do Not Correlate with Application BiasSeraphina Goldfarb-Tarrant, Rebecca Marchant, Ricardo Muñoz Sánchez, et al.2021 · 116 citations
  73. Entity Linking in 100 LanguagesJan A. Botha, Zifei Shan, Daniel Gillick2020 · 114 citations
  74. MLSUM: The Multilingual Summarization CorpusThomas Scialom, Paul-Alexis Dray, Sylvain Lamprier, et al.2020 · 114 citations
  75. ALLaM: Large Language Models for Arabic and EnglishM Saiful Bari, Yazeed Alnumay, Norah A. Alzahrani, et al.2024 · 113 citations
  76. Neural Natural Language Inference Models Partially Embed Theories of Lexical Entailment and NegationAtticus Geiger, Kyle Richardson, Christopher Potts2020 · 112 citations
  77. Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text CorpusIsaac Caswell, Theresa Breiner, Daan van Esch, et al.2020 · 111 citations
  78. Certifying LLM Safety against Adversarial PromptingAounon Kumar, Chirag Agarwal, Suraj Srinivas, et al.2023 · 110 citations
  79. AMR-To-Text Generation with Graph TransformerTianming Wang, Xiaojun Wan, Hanqi Jin2020 · 108 citations
  80. Physics of Language Models: Part 3.1, Knowledge Storage and ExtractionZeyuan Allen-Zhu, Yuanzhi Li2023 · 107 citations
  81. French CrowS-Pairs: Extending a challenge dataset for measuring social bias in masked language models to a language other than EnglishAurélie Névéol, Yoann Dupont, Julien Bezançon, et al.2022 · 107 citations
  82. End-to-End Bias Mitigation by Modelling Biases in CorporaRabeeh Karimi Mahabadi, Yonatan Belinkov, James Henderson2020 · 107 citations
  83. LEDGAR: A Large-Scale Multi-label Corpus for Text Classification of Legal Provisions in ContractsDon Tuggener, Pius von Däniken, Thomas Peetz, et al.2020 · 107 citations
  84. TokenSkip: Controllable Chain-of-Thought Compression in LLMsHeming Xia, Chak Tou Leong, Wenjie Wang, et al.2025 · 105 citations
  85. Can Transformer be Too Compositional? Analysing Idiom Processing in Neural Machine TranslationVerna Dankers, Christopher Lucas, Ivan Titov2022 · 105 citations
  86. Playing with Words at the National Library of Sweden — Making a Swedish BERTMartin Malmsten, Love Borjeson, Chris Haffenden2020 · 105 citations
  87. LENS: A Learnable Evaluation Metric for Text SimplificationMounica Maddela, Yao Dou, David Heineman, et al.2023 · 103 citations
  88. An Annotated Dataset of Coreference in English LiteratureDavid Bamman, Olivia Lewke, Anya Mansoor2020 · 103 citations
  89. Uncertain Natural Language InferenceTongfei Chen, Zhengping Jiang, Adam Poliak, et al.2020 · 103 citations
  90. Tokenizer Choice For LLM Training: Negligible or Crucial?Mehdi Ali, Michael Fromm, Klaudia Thellmann, et al.2024 · 102 citations
  91. Learning to Reason Deductively: Math Word Problem Solving as Complex Relation ExtractionZhanming Jie, Jierui Li, Wei Lu2022 · 102 citations
  92. Scaling Laws for TransferDanny Hernandez, Jared Kaplan, Tom Henighan, et al.2021 · 102 citations
  93. Findings of the WMT 2019 Shared Task on Automatic Post-EditingRajen Chatterjee, Christian Federmann, Matteo Negri, et al.2019 · 102 citations
  94. Probing Natural Language Inference Models through Semantic FragmentsKyle Richardson, Hai Hu, Lawrence S. Moss, et al.2019 · 102 citations
  95. Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex WordsValentin, Hofmann2021 · 101 citations
  96. UniTE: Unified Translation EvaluationYu Wan, Dayiheng Liu, Baosong Yang, et al.2022 · 100 citations
  97. Inverse Scaling: When Bigger Isn't BetterIan R. McKenzie, Alexander Lyzhov, Michael Pieler, et al.2023 · 99 citations
  98. Emojis as Anchors to Detect Arabic Offensive Language and Hate SpeechHamdy Mubarak, Sabit Hassan, Shammur Absar Chowdhury2022 · 96 citations
  99. Cross-Domain Label-Adaptive Stance DetectionMomchil Hardalov, Arnav Arora, Preslav Nakov, et al.2021 · 96 citations
  100. LinCE: A Centralized Benchmark for Linguistic Code-switching EvaluationGustavo Aguilar, Sudipta Kar, Thamar Solorio2020 · 96 citations

1 … 8 9 10 … 15

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/cited-by/page/9/