Elamur Research⌕
☰
home / authors / Aidan N. Gomez / cited by

Who cites Aidan N. Gomez

17,908 citations of their works from 17,698 papers of our library (of the 149,439 whose bibliographies we read) · 1,916 with a page here, the most cited first · page 1 of 20 · 1–100 · ← Aidan N. Gomez

1 2 … 10 … 20

  1. BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Jacob Devlin, Ming-Wei Chang, Kenton Lee, et al.2019 · 56,209 citations
  2. An Image is Worth 16x16 Words: Transformers for Image Recognition at ScalearXiv:2010.11929Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.2020 · 23,726 citations
  3. Sentence-BERT: Sentence Embeddings using Siamese BERT-NetworksConference on Empirical Methods in Natural Language Processing (EMNLP)Nils Reimers, Iryna Gurevych2019 · 17,096 citations
  4. Transformers: State-of-the-Art Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Thomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,755 citations
  5. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
  6. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Mike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,856 citations
  7. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
  8. RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
  9. Llama 2: Open Foundation and Fine-Tuned Chat ModelsarXiv:2307.09288Hugo Touvron, Louis Martin, Kevin Stone, et al.2023 · 9,669 citations
  10. LLaMA: Open and Efficient Foundation Language ModelsarXiv:2302.13971Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 9,603 citations
  11. Graph Attention NetworksarXiv:1710.10903Petar Veličkovic, Guillem Cucurull, Arantxa Casanova, et al.2017 · 9,035 citations
  12. Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
  13. BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformaticsJinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.2019 · 8,339 citations
  14. The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
  15. ChatGPT for Good? On Opportunities and Challenges of Large Language Models for EducationEnkelejda Kasneci, Kathrin Seßler, Stefan Küchemann, et al.2023 · 7,440 citations
  16. Representation Learning with Contrastive Predictive CodingarXiv:1807.03748Aaron van den Oord, Yazhe Li, Oriol Vinyals2018 · 7,022 citations
  17. Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksarXiv:2005.11401Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.2020 · 6,256 citations
  18. Emerging Properties in Self-Supervised Vision TransformersIEEE/CVF International Conference on Computer Vision (ICCV)Mathilde Caron, Hugo Touvron, Ishan Misra, et al.2021 · 6,046 citations
  19. Survey of Hallucination in Natural Language GenerationACM Computing SurveysZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,974 citations
  20. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing SurveysPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,423 citations
  21. PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
  22. The Power of Scale for Parameter-Efficient Prompt TuningConference on Empirical Methods in Natural Language Processing (EMNLP)Brian Lester, Rami Al-Rfou, Noah Constant2021 · 4,287 citations
  23. A Call for Clarity in Reporting BLEU ScoresMatt Post2018 · 4,152 citations
  24. Energy and Policy Considerations for Deep Learning in NLPAnnual Meeting of the Association for Computational Linguistics (ACL)Emma Strubell, Ananya Ganesh, Andrew McCallum2019 · 4,075 citations
  25. fairseq: A Fast, Extensible Toolkit for Sequence ModelingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Myle Ott, Sergey Edunov, Alexei Baevski, et al.2019 · 3,984 citations
  26. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,942 citations
  27. Longformer: The Long-Document TransformerarXiv:2004.05150Iz Beltagy, Matthew E. Peters, Arman Cohan2020 · 3,880 citations
  28. XLNet: Generalized Autoregressive Pretraining for Language UnderstandingarXiv:1906.08237Zhilin Yang, Zihang Dai, Yiming Yang, et al.2019 · 3,857 citations
  29. Large language models are zero-shot reasonersConference on Neural Information Processing Systems (NeurIPS)Takeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.2022 · 3,832 citations
  30. Training Verifiers to Solve Math Word ProblemsarXiv:2110.14168Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.2021 · 3,796 citations
  31. A Survey on Evaluation of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyYupeng Chang, Xu Wang, Jindong Wang, et al.2023 · 3,648 citations
  32. SciBERT: A Pretrained Language Model for Scientific TextConference on Empirical Methods in Natural Language Processing (EMNLP)Iz Beltagy, Kyle Lo, Arman Cohan2019 · 3,582 citations
  33. Conformer: Convolution-augmented Transformer for Speech RecognitionInterspeechAnmol Gulati, James Qin, Chung-Cheng Chiu, et al.2020 · 3,475 citations
  34. Scaling Laws for Neural Language ModelsarXiv:2001.08361Jared Kaplan, Sam McCandlish, Tom Henighan, et al.2020 · 3,434 citations
  35. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Linting Xue, Noah Constant, Adam Roberts, et al.2021 · 3,226 citations
  36. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  37. Gemini: A Family of Highly Capable Multimodal ModelsarXiv:2312.11805Gemini Team, Rohan Anil, Sebastian Borgeaud, et al.2023 · 3,050 citations
  38. RoFormer: Enhanced Transformer with Rotary Position EmbeddingarXiv:2104.09864Jianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 3,028 citations
  39. Language Models as Knowledge Bases?Conference on Empirical Methods in Natural Language Processing (EMNLP)Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.2019 · 3,028 citations
  40. CodeBERT: A Pre-Trained Model for Programming and Natural LanguagesFindings of the Association for Computational LinguisticsZhangyin Feng, Daya Guo, Duyu Tang, et al.2020 · 2,967 citations
  41. A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
  42. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsarXiv:1909.11942Zhenzhong Lan, Mingda Chen, Sebastian Goodman, et al.2019 · 2,806 citations
  43. Hierarchical Text-Conditional Image Generation with CLIP LatentsarXiv:2204.06125Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, et al.2022 · 2,713 citations
  44. Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon2020 · 2,674 citations
  45. The Curious Case of Neural Text DegenerationarXiv:1904.09751Ari Holtzman, Jan Buys, Li Du, et al.2019 · 2,660 citations
  46. Evaluating Large Language Models Trained on CodearXiv:2107.03374Mark Chen, Jerry Tworek, Heewoo Jun, et al.2021 · 2,659 citations
  47. SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics (TACL)Mandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,616 citations
  48. Lost in the Middle: How Language Models Use Long ContextsTransactions of the Association for Computational Linguistics (TACL)Nelson F. Liu, Kevin Lin, John Hewitt, et al.2023 · 2,584 citations
  49. Robust Speech Recognition via Large-Scale Weak SupervisionarXiv:2212.04356Alec Radford, Jong Wook Kim, Tao Xu, et al.2022 · 2,546 citations
  50. Sparks of Artificial General Intelligence: Early experiments with GPT-4arXiv:2303.12712Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, et al.2023 · 2,439 citations
  51. UNITER: UNiversal Image-TExt Representation LearningLecture notes in computer scienceYen-Chun Chen, Linjie Li, Licheng Yu, et al.2019 · 2,418 citations
  52. Measuring Mathematical Problem Solving With the MATH DatasetarXiv:2103.03874Dan Hendrycks, Collin Burns, Saurav Kadavath, et al.2021 · 2,395 citations
  53. TinyBERT: Distilling BERT for Natural Language UnderstandingFindings of the Association for Computational LinguisticsXiaoqi Jiao, Yichun Yin, Lifeng Shang, et al.2020 · 2,378 citations
  54. Conceptual Captions: A Cleaned, Hypernymed, Image Alt-text Dataset For Automatic Image CaptioningAnnual Meeting of the Association for Computational Linguistics (ACL)Piyush Sharma, Nan Ding, Sebastian Goodman, et al.2018 · 2,348 citations
  55. Relational inductive biases, deep learning, and graph networksarXiv:1806.01261Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, et al.2018 · 2,335 citations
  56. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language TasksarXiv:1908.02265Jiasen Lu, Dhruv Batra, Devi Parikh, et al.2019 · 2,302 citations
  57. Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,246 citations
  58. Multimodal Transformer for Unaligned Multimodal Language SequencesAnnual Meeting of the Association for Computational Linguistics (ACL)Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.2019 · 2,193 citations
  59. Text Summarization with Pretrained EncodersConference on Empirical Methods in Natural Language Processing (EMNLP)Yang Liu, Mirella Lapata2019 · 2,095 citations
  60. Training Compute-Optimal Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.2022 · 2,032 citations
  61. BLEURT: Learning Robust Metrics for Text GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Thibault Sellam, Dipanjan Das, Ankur Parikh2020 · 2,032 citations
  62. BERT Rediscovers the Classical NLP PipelineAnnual Meeting of the Association for Computational Linguistics (ACL)Ian Tenney, Dipanjan Das, Ellie Pavlick2019 · 2,028 citations
  63. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
  64. On Faithfulness and Factuality in Abstractive SummarizationAnnual Meeting of the Association for Computational Linguistics (ACL)Joshua Maynez, Shashi Narayan, Bernd Bohnet, et al.2020 · 1,857 citations
  65. DeBERTa: Decoding-enhanced BERT with Disentangled AttentionarXiv:2006.03654Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,828 citations
  66. PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationarXiv:1912.08777Jingqing Zhang, Yao Zhao, Mohammad Saleh, et al.2019 · 1,828 citations
  67. AllenNLP: A Deep Semantic Natural Language Processing PlatformarXiv:1803.07640Matt Gardner, Joel Grus, Mark Neumann, et al.2018 · 1,819 citations
  68. Exploiting Cloze-Questions for Few-Shot Text Classification and Natural Language InferenceConference of the European Chapter of the Association for Computational Linguistics (EACL)Timo Schick, Hinrich Schütze2021 · 1,817 citations
  69. What Does BERT Learn about the Structure of Language?Annual Meeting of the Association for Computational Linguistics (ACL)Ganesh Jawahar, Benoît Sagot, Djamé Seddah2019 · 1,806 citations
  70. ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Omar Khattab, Matei Zaharia2020 · 1,789 citations
  71. Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
  72. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,756 citations
  73. OPT: Open Pre-trained Transformer Language ModelsarXiv:2205.01068Susan Zhang, Stephen Roller, Naman Goyal, et al.2022 · 1,755 citations
  74. Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
  75. Universal Sentence EncoderarXiv:1803.11175Daniel Cer, Yinfei Yang, Sheng-yi Kong, et al.2018 · 1,629 citations
  76. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530Gemini Team, Petko Georgiev, Ving Ian Lei, et al.2024 · 1,589 citations
  77. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword CandidatesAnnual Meeting of the Association for Computational Linguistics (ACL)Taku Kudo2018 · 1,573 citations
  78. VisualBERT: A Simple and Performant Baseline for Vision and LanguagearXiv:1908.03557Liunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,568 citations
  79. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,556 citations
  80. Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data EngineeringShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,551 citations
  81. CLIPScore: A Reference-free Evaluation Metric for Image CaptioningConference on Empirical Methods in Natural Language Processing (EMNLP)Jack Hessel, Ari Holtzman, Maxwell Forbes, et al.2021 · 1,550 citations
  82. Universal Sentence Encoder for EnglishConference on Empirical Methods in Natural Language Processing (EMNLP)Daniel Cer, Yinfei Yang, Sheng-yi Kong, et al.2018 · 1,546 citations
  83. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
  84. Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be PrunedAnnual Meeting of the Association for Computational Linguistics (ACL)Elena Voita, David Talbot, Fedor Moiseev, et al.2019 · 1,535 citations
  85. Zero-Shot Text-to-Image GenerationarXiv:2102.12092Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.2021 · 1,528 citations
  86. Multi-Task Deep Neural Networks for Natural Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaodong Liu, Pengcheng He, Weizhu Chen, et al.2019 · 1,524 citations
  87. Pre-Training with Whole Word Masking for Chinese BERTIEEE/ACM Transactions on Audio Speech and Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, et al.2019 · 1,490 citations
  88. LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,485 citations
  89. Code Llama: Open Foundation Models for CodearXiv:2308.12950Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,430 citations
  90. Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197Li Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,422 citations
  91. wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsConference on Neural Information Processing Systems (NeurIPS)Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.2020 · 1,421 citations
  92. Language-agnostic BERT Sentence EmbeddingAnnual Meeting of the Association for Computational Linguistics (ACL)Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.2020 · 1,413 citations
  93. VideoBERT: A Joint Model for Video and Language Representation LearningIEEE/CVF International Conference on Computer Vision (ICCV)Chen Sun, Austin Myers, Carl Vondrick, et al.2019 · 1,345 citations
  94. LaMDA: Language Models for Dialog ApplicationsarXiv:2201.08239Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,344 citations
  95. Parameter-efficient fine-tuning of large-scale pre-trained language modelsNature Machine IntelligenceNing Ding, Yujia Qin, Guang You Yang, et al.2023 · 1,325 citations
  96. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingarXiv:2111.09543Pengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,320 citations
  97. RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsFindings of the Association for Computational LinguisticsSamuel Gehman, Suchin Gururangan, Maarten Sap, et al.2020 · 1,306 citations
  98. AraBERT: Transformer-based Model for Arabic Language UnderstandingarXiv:2003.00104Wissam Antoun, Fady Baly, Hazem Hajj2020 · 1,304 citations
  99. COMET: Commonsense Transformers for Automatic Knowledge Graph ConstructionAnnual Meeting of the Association for Computational Linguistics (ACL)Antoine Bosselut, Hannah Rashkin, Maarten Sap, et al.2019 · 1,294 citations
  100. CTRL: A Conditional Transformer Language Model for Controllable GenerationarXiv:1909.05858Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.2019 · 1,291 citations

1 2 … 10 … 20

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/aidan-n-gomez/cited-by/