Elamur Research⌕
☰
home / papers / ALBERT: A Lite BERT for Self-supervised Learning… / cited by / page 2

Who cites «ALBERT: A Lite BERT for Self-supervised Learning of Language Representations»

1,861 papers of our library cite it (of the 149,439 whose bibliographies we read) · 262 with a page here, the most cited first · page 2 of 3 · 101–200 · ← back to «ALBERT: A Lite BERT for Self-supervised Learning of Language Representations»

1 2 3

  1. TernaryBERT: Distillation-aware Ultra-low Bit BERTConference on Empirical Methods in Natural Language Processing (EMNLP)Wei Zhang, Lu Hou, Yichun Yin, et al.2020 · 213 citations
  2. Training Question Answering Models From Synthetic DataConference on Empirical Methods in Natural Language Processing (EMNLP)Raul Puri, Ryan Spring, Mohammad Shoeybi, et al.2020 · 208 citations
  3. CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From CharactersInternational Conference on Computational Linguistics (COLING)Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, et al.2020 · 206 citations
  4. Structured Pruning of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Ziheng Wang, Jeremy Wohlwend, Tao Lei2020 · 202 citations
  5. A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark DatasetsFindings of the Association for Computational LinguisticsMd Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.2023 · 200 citations
  6. COCO-LM: Correcting and Contrasting Text Sequences for Language Model PretrainingarXiv:2102.08473Yu Meng, Chenyan Xiong, Payal Bajaj, et al.2021 · 198 citations
  7. Q²: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Or Honovich, Leshem Choshen, Roee Aharoni, et al.2021 · 196 citations
  8. What Can We Learn from Collective Human Opinions on Natural Language Inference Data?Conference on Empirical Methods in Natural Language Processing (EMNLP)Yixin Nie, Xiang Zhou, Mohit Bansal2020 · 196 citations
  9. Auto-Debias: Debiasing Masked Language Models with Automated Biased PromptsAnnual Meeting of the Association for Computational Linguistics (ACL)Yue Guo, Yi Yang, Ahmed Abbasi2022 · 191 citations
  10. SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition (MultiCoNER)International Workshop on Semantic Evaluation (SemEval)Shervin Malmasi, Anjie Fang, Besnik Fetahu, et al.2022 · 190 citations
  11. Compressing Large-Scale Transformer-Based Models: A Case Study on BERTTransactions of the Association for Computational Linguistics (TACL)Prakhar Ganesh, Yao Chen, Xin Lou, et al.2021 · 190 citations
  12. GLiNER: Generalist Model for Named Entity Recognition using Bidirectional TransformerConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Urchade Zaratiana, Nadi Tomeh, Pierre Holat, et al.2024 · 189 citations
  13. Packed Levitated Marker for Entity and Relation ExtractionAnnual Meeting of the Association for Computational Linguistics (ACL)Deming Ye, Yankai Lin, Peng Li, et al.2022 · 189 citations
  14. Gradient-based Adversarial Attacks against Text TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Chuan Guo, Alexandre Sablayrolles, Hervé Jégou, et al.2021 · 189 citations
  15. Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style TransferConference on Empirical Methods in Natural Language Processing (EMNLP)Fanchao Qi, Yangyi Chen, Xurui Zhang, et al.2021 · 189 citations
  16. NILE : Natural Language Inference with Faithful Natural Language ExplanationsAnnual Meeting of the Association for Computational Linguistics (ACL)Sawan Kumar, Partha Talukdar2020 · 184 citations
  17. Debiasing Pre-trained Contextualised EmbeddingsConference of the European Chapter of the Association for Computational Linguistics (EACL)Masahiro Kaneko, Danushka Bollegala2021 · 175 citations
  18. Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic LanguagesAnnual Meeting of the Association for Computational Linguistics (ACL)Sumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, et al.2023 · 174 citations
  19. KGPT: Knowledge-Grounded Pre-Training for Data-to-Text GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Yu Su, Xifeng Yan, et al.2020 · 174 citations
  20. The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive RemediationsConference on Empirical Methods in Natural Language Processing (EMNLP)Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, et al.2023 · 171 citations
  21. GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via CipherarXiv:2308.06463Youliang Yuan, Wenxiang Jiao, Wenxuan Wang, et al.2023 · 168 citations
  22. Label Verbalization and Entailment for Effective Zero and Few-Shot Relation ExtractionConference on Empirical Methods in Natural Language Processing (EMNLP)Oscar Sainz, Oier Lopez de Lacalle, Gorka Labaka, et al.2021 · 167 citations
  23. BinaryBERT: Pushing the Limit of BERT QuantizationAnnual Meeting of the Association for Computational Linguistics (ACL)Haoli Bai, Wei Zhang, Lu Hou, et al.2021 · 166 citations
  24. ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language GenerationInternational Joint Conference on Artificial IntelligenceDongling Xiao, Han Zhang, Yukun Li, et al.2020 · 163 citations
  25. CLIMATE-FEVER: A Dataset for Verification of Real-World Climate ClaimsarXiv:2012.00614Thomas Diggelmann, Jordan Boyd-Graber, Jannis Bulian, et al.2020 · 158 citations
  26. SemEval-2020 Task 4: Commonsense Validation and ExplanationInternational Workshop on Semantic Evaluation (SemEval)Cunxiang Wang, Shuailong Liang, Yili Jin, et al.2020 · 158 citations
  27. Leveraging Large Language Models for Multiple Choice Question AnsweringarXiv:2210.12353Joshua Robinson, Christopher Michael Rytting, David Wingate2022 · 157 citations
  28. CPM: A Large-scale Generative Chinese Pre-trained Language ModelAI OpenZhengyan Zhang, Xu Han, Hao Zhou, et al.2020 · 150 citations
  29. Out of Order: How important is the sequential order of words in a sentence in Natural Language Understanding tasks?Findings of the Association for Computational LinguisticsThang Pham, Trung Bui, Long Mai, et al.2021 · 148 citations
  30. Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
  31. SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and OffenseInternational Workshop on Semantic Evaluation (SemEval)J. A. Meaney, Steven Wilson, Luis Chiruzzo, et al.2021 · 142 citations
  32. Rethinking embedding coupling in pre-trained language modelsarXiv:2010.12821Hyung Won Chung, Thibault Févry, Henry Tsai, et al.2020 · 142 citations
  33. IndicBART: A Pre-trained Model for Indic Natural Language GenerationFindings of the Association for Computational LinguisticsRaj Dabre, Himani Shrotriya, Anoop Kunchukuttan, et al.2022 · 141 citations
  34. ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Yujia Qin, Yankai Lin, Ryuichi Takanobu, et al.2021 · 139 citations
  35. Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and ApproachesarXiv:1904.01172Shane Storks, Qiaozi Gao, Joyce Y. Chai2019 · 135 citations
  36. Generalization in NLI: Ways (Not) To Go Beyond Simple HeuristicsWorkshop on Insights from Negative Results in NLPPrajjwal Bhargava, Aleksandr Drozd, Anna Rogers2021 · 131 citations
  37. Improving Factual Consistency of Abstractive Summarization via Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Feng Nan, Cicero Nogueira dos Santos, Henghui Zhu, et al.2021 · 129 citations
  38. Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction BenchmarkNatural Legal Language Processing WorkshopJoel Niklaus, Ilias Chalkidis, Matthias Stürmer2021 · 129 citations
  39. The Moral Integrity Corpus: A Benchmark for Ethical Dialogue SystemsAnnual Meeting of the Association for Computational Linguistics (ACL)Caleb Ziems, Jane A. Yu, Yi-Chia Wang, et al.2022 · 122 citations
  40. I-BERT: Integer-only BERT QuantizationInternational Conference on Machine Learning (ICML)Sehoon Kim, Amir Gholami, Zhewei Yao, et al.2021 · 122 citations
  41. Logical Fallacy DetectionFindings of the Association for Computational LinguisticsZhijing Jin, Abhinav Lalwani, Tejas Vaidhya, et al.2022 · 119 citations
  42. End-to-End Training of Neural Retrievers for Open-Domain Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Devendra Sachan, Mostofa Patwary, Mohammad Shoeybi, et al.2021 · 116 citations
  43. Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender BiasWorkshop on Gender Bias in Natural Language ProcessingMarion Bartl, Malvina Nissim, Albert Gatt2020 · 116 citations
  44. WiCE: Real-World Entailment for Claims in WikipediaConference on Empirical Methods in Natural Language Processing (EMNLP)Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, et al.2023 · 113 citations
  45. French CrowS-Pairs: Extending a challenge dataset for measuring social bias in masked language models to a language other than EnglishAnnual Meeting of the Association for Computational Linguistics (ACL)Aurélie Névéol, Yoann Dupont, Julien Bezançon, et al.2022 · 107 citations
  46. Transformers for Tabular Data Representation: A Survey of Models and ApplicationsTransactions of the Association for Computational Linguistics (TACL)Gilbert Badaro, Mohammed Saeed, Paolo Papotti2023 · 104 citations
  47. On the Intrinsic and Extrinsic Fairness Evaluation Metrics for Contextualized Language RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Yang Trista Cao, Yada Pruksachatkun, Kai-Wei Chang, et al.2022 · 100 citations
  48. Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Jannis Bulian, Christian Buck, Wojciech Gajewski, et al.2022 · 100 citations
  49. True Few-Shot Learning with Prompts–-A Real-World PerspectiveTransactions of the Association for Computational Linguistics (TACL)Timo Schick, Hinrich Schütze2022 · 96 citations
  50. SPARTQA: A Textual Question Answering Benchmark for Spatial ReasoningRoshanak Mirzaee, Hossein Rajaby Faghihi, Qiang Ning, et al.2021 · 95 citations
  51. A Report on the 2020 Sarcasm Detection Shared TaskWorkshop on Figurative Language ProcessingDebanjan Ghosh, Avijit Vajpayee, Smaranda Muresan2020 · 92 citations
  52. Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?Findings of the Association for Computational LinguisticsYi Tay, Mostafa Dehghani, Samira Abnar, et al.2023 · 86 citations
  53. ORCA: A Challenging Benchmark for Arabic Language UnderstandingFindings of the Association for Computational LinguisticsAbdelRahim Elmadany, ElMoatez Billah Nagoudi, Muhammad Abdul-Mageed2023 · 83 citations
  54. Survey of Vulnerabilities in Large Language Models Revealed by Adversarial AttacksarXiv:2310.10844Erfan Shayegani, Md Abdullah Al Mamun, Yu Fu, et al.2023 · 83 citations
  55. Domain Adaptation with Pre-trained Transformers for Query-Focused Abstractive Text SummarizationComputational LinguisticsMd Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang2022 · 76 citations
  56. Structural Persistence in Language Models: Priming as a Window into Abstract Language RepresentationsTransactions of the Association for Computational Linguistics (TACL)Arabella Sinclair, Jaap Jumelet, Willem Zuidema, et al.2022 · 74 citations
  57. CBLUE: A Chinese Biomedical Language Understanding Evaluation BenchmarkarXiv:2106.08087Ningyu Zhang, Mosha Chen, Zhen Bi, et al.2021 · 71 citations
  58. NormBank: A Knowledge Bank of Situational Social NormsAnnual Meeting of the Association for Computational Linguistics (ACL)Caleb Ziems, Jane Dwivedi-Yu, Yi-Chia Wang, et al.2023 · 69 citations
  59. CLUENER2020: Fine-grained Named Entity Recognition Dataset and Benchmark for ChinesearXiv:2001.04351Liang Xu, Yu tong, Qianqian Dong, et al.2020 · 69 citations
  60. Towards Faithful Neural Table-to-Text Generation with Content-Matching ConstraintsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhenyi Wang, Xiaoyang Wang, Bang An, et al.2020 · 67 citations
  61. ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2112.12731Shuohuan Wang, Yu Sun, Yang Xiang, et al.2021 · 63 citations
  62. Which Linguist Invented the Lightbulb? Presupposition Verification for Question-AnsweringNajoung Kim, Ellie Pavlick, Burcu Karagol Ayan, et al.2021 · 63 citations
  63. Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
  64. Building a Bridge: A Method for Image-Text Sarcasm Detection Without Pretraining on Image-Text DataProceedings of the First International Workshop on Natural Language Processing Beyond TextXinyu Wang, Xiaowen Sun, Tan Yang, et al.2020 · 62 citations
  65. A Family of Pretrained Transformer Language Models for RussianLanguage Resources and Evaluation Conference (LREC)Dmitry Zmitrovich, Aleksandr Abramov, Andrey Kalmykov, et al.2024 · 60 citations
  66. Puzzle Solving using Reasoning of Large Language Models: A SurveyConference on Empirical Methods in Natural Language Processing (EMNLP)Panagiotis Giadikiaroglou, Maria Lymperaiou, Giorgos Filandrianos, et al.2024 · 48 citations
  67. ANLIzing the Adversarial Natural Language Inference DatasetSociety for Computation in Linguistics (SCiL)Adina Williams, Tristan Thrush, Douwe Kiela2022 · 48 citations
  68. Metaphor Understanding Challenge Dataset for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Tong, Rochelle Choenni, Martha Lewis, et al.2024 · 47 citations
  69. Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
  70. Fact Checking with Insufficient EvidenceTransactions of the Association for Computational Linguistics (TACL)Pepa Atanasova, Jakob Grue Simonsen, Christina Lioma, et al.2022 · 46 citations
  71. Polysemy–-Evidence from Linguistics, Behavioral Science, and Contextualized Language ModelsComputational LinguisticsJanosch Haber, Massimo Poesio2024 · 44 citations
  72. Pragmatic competence of pre-trained language models through the lens of discourse connectivesConference on Computational Natural Language Learning (CoNLL)Lalchand Pandia, Yan Cong, Allyson Ettinger2021 · 42 citations
  73. DeepSeek: Paradigm Shifts and Technical Evolution in Large AI ModelsarXiv:2507.09955Luolin Xiong, Haofen Wang, Xi Chen, et al.2025 · 41 citations
  74. MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment TasksConference on Neural Information Processing Systems (NeurIPS)Allen Nie, Yuhui Zhang, Atharva Amdekar, et al.2023 · 41 citations
  75. A Few Topical Tweets are Enough for Effective User Stance DetectionConference of the European Chapter of the Association for Computational Linguistics (EACL)Younes Samih, Kareem Darwish2021 · 40 citations
  76. DziriBERT: a Pre-trained Language Model for the Algerian DialectarXiv:2109.12346Amine Abdaoui, Mohamed Berrimi, Mourad Oussalah, et al.2021 · 38 citations
  77. Transformer-based Context-aware Sarcasm Detection in Conversation Threads from Social MediaWorkshop on Figurative Language ProcessingXiangjue Dong, Changmao Li, Jinho D. Choi2020 · 35 citations
  78. Probing Contextual Language Models for Common Ground with Visual RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Gabriel Ilharco, Rowan Zellers, Ali Farhadi, et al.2021 · 33 citations
  79. The Life Cycle of Knowledge in Big Language Models: A SurveyarXiv:2303.07616 · Machine Intelligence Research. vol. 21, no. 2, pp. 217-238, 2024Boxi Cao, Hongyu Lin, Xianpei Han, et al.2023 · 31 citations
  80. Evaluating Document Coherence ModelingTransactions of the Association for Computational Linguistics (TACL)Aili Shen, Meladel Mistica, Bahar Salehi, et al.2021 · 30 citations
  81. One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial SupportarXiv:2306.09237Ronja Stern, Vishvaksenan Rasiah, Veton Matoshi, et al.2023 · 29 citations
  82. Sub-Character Tokenization for Chinese Pretrained Language ModelsTransactions of the Association for Computational Linguistics (TACL)Chenglei Si, Zhengyan Zhang, Yingfa Chen, et al.2023 · 29 citations
  83. Syntax Role for Neural Semantic Role LabelingComputational LinguisticsZuchao Li, Hai Zhao, Shexia He, et al.2021 · 29 citations
  84. A Survey on Asking Clarification Questions Datasets in Conversational SystemsAnnual Meeting of the Association for Computational Linguistics (ACL)Hossein A. Rahmani, Xi Wang, Yue Feng, et al.2023 · 28 citations
  85. Evaluating ChatGPT and Bard AI on Arabic Sentiment AnalysisArabic Natural Language Processing Conference (ArabicNLP)Abdulmohsen Al-Thubaity, Sakhar Alkhereyf, Hanan Murayshid, et al.2023 · 27 citations
  86. Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, et al.2022 · 27 citations
  87. Sentiment Analysis through LLM NegotiationsarXiv:2311.01876Xiaofei Sun, Xiaoya Li, Shengyu Zhang, et al.2023 · 25 citations
  88. Scaling Latent Reasoning via Looped Language ModelsarXiv:2510.25741Rui-Jie Zhu, Zixuan Wang, Kai Hua, et al.2025 · 22 citations
  89. ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language UnderstandingarXiv:2010.12148Dongling Xiao, Yu-Kun Li, Han Zhang, et al.2020 · 22 citations
  90. Arabizi Language Models for Sentiment AnalysisInternational Conference on Computational Linguistics (COLING)Gaétan Baert, Souhir Gahbiche, Guillaume Gadek, et al.2020 · 21 citations
  91. Semantics of Multiword Expressions in Transformer-Based Models: A SurveyTransactions of the Association for Computational Linguistics (TACL)Filip Miletić, Sabine Schulte im Walde2024 · 20 citations
  92. An Empirical Study of Metrics to Measure Representational Harms in Pre-Trained Language ModelsarXiv:2301.09211Saghar Hosseini, Hamid Palangi, Ahmed Hassan Awadallah2023 · 19 citations
  93. Topic-Guided Sampling For Data-Efficient Multi-Domain Stance DetectionAnnual Meeting of the Association for Computational Linguistics (ACL)Erik Arakelyan, Arnav Arora, Isabelle Augenstein2023 · 19 citations
  94. A Survey on Automated Sarcasm Detection on TwitterarXiv:2202.02516Bleau Moores, Vijay Mago2022 · 19 citations
  95. Improving Arabic Text Categorization Using Transformer Training DiversificationArabic Natural Language Processing Workshop (WANLP)Shammur Absar Chowdhury, Ahmed Abdelali, Kareem Darwish, et al.2020 · 17 citations
  96. Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal ThinkingAnnual Meeting of the Association for Computational Linguistics (ACL)Yilong Chen, Junyuan Shang, Zhenyu Zhang, et al.2025 · 16 citations
  97. DiPlomat: A Dialogue Dataset for Situated Pragmatic ReasoningConference on Neural Information Processing Systems (NeurIPS)Hengli Li, Song-Chun Zhu, Zilong Zheng2023 · 15 citations
  98. When Truth Matters - Addressing Pragmatic Categories in Natural Language Inference (NLI) by Large Language Models (LLMs)Joint Conference on Lexical and Computational Semantics (*SEM)Reto Gubelmann, Aikaterini-lida Kalouli, Christina Niklaus, et al.2023 · 15 citations
  99. SaudiBERT: A Large Language Model Pretrained on Saudi Dialect CorporaarXiv:2405.06239Faisal Qarah2024 · 14 citations
  100. New Arabic Medical Dataset for Diseases ClassificationLecture notes in computer scienceJaafar Hammoud, Aleksandra Vatian, Natalia Dobrenko, et al.2021 · 14 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/lan-2019-albert-lite-bert-self-supervised/cited-by/page/2/