Elamur Research⌕
☰
home / authors / Piyush Sharma / cited by

Who cites Piyush Sharma

2,405 citations of their works from 2,380 papers of our library (of the 149,439 whose bibliographies we read) · 347 with a page here, the most cited first · page 1 of 4 · 1–100 · ← Piyush Sharma

1 2 3 4

  1. Transformers: State-of-the-Art Natural Language ProcessingConference on Empirical Methods in Natural Language Processing (EMNLP)Thomas Wolf, Lysandre Debut, Victor Sanh, et al.2020 · 15,755 citations
  2. Language Models are Few-Shot LearnersarXiv:2005.14165Tom B. Brown, Benjamin Mann, Nick Ryder, et al.2020 · 14,178 citations
  3. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Mike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,856 citations
  4. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
  5. Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
  6. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language ProcessingACM Computing SurveysPengfei Liu, Weizhe Yuan, Jinlan Fu, et al.2021 · 5,423 citations
  7. XLNet: Generalized Autoregressive Pretraining for Language UnderstandingarXiv:1906.08237Zhilin Yang, Zihang Dai, Yiming Yang, et al.2019 · 3,857 citations
  8. Measuring Massive Multitask Language UnderstandingarXiv:2009.03300Dan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 3,620 citations
  9. Scaling Laws for Neural Language ModelsarXiv:2001.08361Jared Kaplan, Sam McCandlish, Tom Henighan, et al.2020 · 3,434 citations
  10. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  11. RoFormer: Enhanced Transformer with Rotary Position EmbeddingarXiv:2104.09864Jianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 3,028 citations
  12. UNITER: UNiversal Image-TExt Representation LearningLecture notes in computer scienceYen-Chun Chen, Linjie Li, Licheng Yu, et al.2019 · 2,418 citations
  13. TinyBERT: Distilling BERT for Natural Language UnderstandingFindings of the Association for Computational LinguisticsXiaoqi Jiao, Yichun Yin, Lifeng Shang, et al.2020 · 2,378 citations
  14. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language TasksarXiv:1908.02265Jiasen Lu, Dhruv Batra, Devi Parikh, et al.2019 · 2,302 citations
  15. Flamingo: a Visual Language Model for Few-Shot LearningarXiv:2204.14198Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.2022 · 2,246 citations
  16. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsarXiv:2301.12597Junnan Li, Dongxu Li, Silvio Savarese, et al.2023 · 2,219 citations
  17. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
  18. DeBERTa: Decoding-enhanced BERT with Disentangled AttentionarXiv:2006.03654Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,828 citations
  19. Pre-trained Models for Natural Language Processing: A SurveyarXiv:2003.08271 · SCIENCE CHINA Technological Sciences,2020, 63, 1872-1897Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.2020 · 1,759 citations
  20. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,756 citations
  21. BERTopic: Neural topic modeling with a class-based TF-IDF procedurearXiv:2203.05794Maarten Grootendorst2022 · 1,737 citations
  22. Scaling Up Visual and Vision-Language Representation Learning With Noisy Text SupervisionInternational Conference on Machine Learning (ICML)Chao Jia, Yinfei Yang, Ye Xia, et al.2021 · 1,615 citations
  23. VisualBERT: A Simple and Performant Baseline for Vision and LanguagearXiv:1908.03557Liunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,568 citations
  24. Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A SurveyACM Computing SurveysBonan Min, Hayley Ross, Elior Sulem, et al.2021 · 1,556 citations
  25. Unifying Large Language Models and Knowledge Graphs: A RoadmapIEEE Transactions on Knowledge and Data EngineeringShirui Pan, Linhao Luo, Yufei Wang, et al.2023 · 1,551 citations
  26. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
  27. Zero-Shot Text-to-Image GenerationarXiv:2102.12092Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.2021 · 1,528 citations
  28. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationarXiv:2201.12086Junnan Li, Dongxu Li, Caiming Xiong, et al.2022 · 1,523 citations
  29. LEGAL-BERT: The Muppets straight out of Law SchoolFindings of the Association for Computational LinguisticsIlias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, et al.2020 · 1,493 citations
  30. Pre-Training with Whole Word Masking for Chinese BERTIEEE/ACM Transactions on Audio Speech and Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, et al.2019 · 1,490 citations
  31. LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,485 citations
  32. GLM: General Language Model Pretraining with Autoregressive Blank InfillingAnnual Meeting of the Association for Computational Linguistics (ACL)Zhengxiao Du, Yujie Qian, Xiao Liu, et al.2022 · 1,455 citations
  33. LaMDA: Language Models for Dialog ApplicationsarXiv:2201.08239Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.2022 · 1,344 citations
  34. DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingarXiv:2111.09543Pengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,320 citations
  35. AraBERT: Transformer-based Model for Arabic Language UnderstandingarXiv:2003.00104Wissam Antoun, Fady Baly, Hazem Hajj2020 · 1,304 citations
  36. CamemBERT: a Tasty French Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,269 citations
  37. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsarXiv:2304.10592Deyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,141 citations
  38. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Timo Schick, Hinrich Schütze2021 · 1,132 citations
  39. VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsarXiv:1908.08530Weijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,066 citations
  40. Evaluating Object Hallucination in Large Vision-Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Yifan Li, Yifan Du, Kun Zhou, et al.2023 · 1,004 citations
  41. Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language ModelsComputational LinguisticsYue Zhang, Yafu Li, Leyang Cui, et al.2023 · 977 citations
  42. Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and BeyondarXiv:2308.12966Jinze Bai, Shuai Bai, Shusheng Yang, et al.2023 · 970 citations
  43. CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Nikita Nangia, Clara Vania, Rasika Bhalerao, et al.2020 · 897 citations
  44. UNIFIEDQA: Crossing Format Boundaries with a Single QA SystemFindings of the Association for Computational LinguisticsDaniel Khashabi, Sewon Min, Tushar Khot, et al.2020 · 857 citations
  45. Unsupervised Dense Information Retrieval with Contrastive LearningarXiv:2112.09118Gautier Izacard, Mathilde Caron, Lucas Hosseini, et al.2021 · 836 citations
  46. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondACM Transactions on Knowledge Discovery from DataJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 814 citations
  47. ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionarXiv:2102.03334Wonjae Kim, Bokyung Son, Ildoo Kim2021 · 804 citations
  48. Revisiting Pre-Trained Models for Chinese Natural Language ProcessingarXiv:2004.13922Yiming Cui, Wanxiang Che, Ting Liu, et al.2020 · 790 citations
  49. Reproducible scaling laws for contrastive language-image learningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 769 citations
  50. IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian LanguagesFindings of the Association for Computational LinguisticsDivyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.2020 · 732 citations
  51. CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataLanguage Resources and Evaluation Conference (LREC)Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.2020 · 666 citations
  52. A Frustratingly Easy Approach for Entity and Relation ExtractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Danqi Chen2020 · 631 citations
  53. Video-LLaVA: Learning United Visual Representation by Alignment Before ProjectionConference on Empirical Methods in Natural Language Processing (EMNLP)Bin Lin, Yang Ye, Bin Zhu, et al.2023 · 628 citations
  54. A Robustly Optimized BERT Pre-training Approach with Post-trainingChinese National Conference on Computational LinguisticsLiu Zhuang, Lin Wayne, Shi Ya, et al.2021 · 587 citations
  55. What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical ExamsarXiv:2009.13081Di Jin, Eileen Pan, Nassim Oufattole, et al.2020 · 567 citations
  56. Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Armen Aghajanyan, Sonal Gupta, Luke Zettlemoyer2021 · 542 citations
  57. DeCLUTR: Deep Contrastive Learning for Unsupervised Textual RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)John Giorgi, Osvald Nitski, Bo Wang, et al.2021 · 516 citations
  58. A-OKVQA: A Benchmark for Visual Question Answering using World KnowledgeLecture notes in computer scienceDustin Schwenk, Apoorv Khandelwal, Christopher Clark, et al.2022 · 509 citations
  59. SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionarXiv:2108.10904Zirui Wang, Jiahui Yu, Adams Wei Yu, et al.2021 · 481 citations
  60. HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingConference on Empirical Methods in Natural Language Processing (EMNLP)Linjie Li, Yen-Chun Chen, Yu Cheng, et al.2020 · 481 citations
  61. ARBERT & MARBERT: Deep Bidirectional Transformers for ArabicarXiv:2101.01785 · ACL-2021 camera ready versionMuhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi2021 · 478 citations
  62. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object DetectionarXiv:2303.05499Shilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.2023 · 472 citations
  63. Large Language Models: A SurveyarXiv:2402.06196Shervin Minaee, Tomas Mikolov, Narjes Nikzad, et al.2024 · 471 citations
  64. CogView: Mastering Text-to-Image Generation via TransformersarXiv:2105.13290Ming Ding, Zhuoyi Yang, Wenyi Hong, et al.2021 · 469 citations
  65. MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual ContextsarXiv:2310.02255Pan Lu, Hritik Bansal, Tony Xia, et al.2023 · 468 citations
  66. OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkarXiv:2202.03052Peng Wang, An Yang, Rui Men, et al.2022 · 467 citations
  67. MVBench: A Comprehensive Multi-modal Video Understanding BenchmarkIEEE Computer Society Conference on Computer Vision and Pattern RecognitionKunchang Li, Yali Wang, Yinan He, et al.2023 · 463 citations
  68. ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLecture notes in computer scienceLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 454 citations
  69. LLM-Pruner: On the Structural Pruning of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Xinyin Ma, Gongfan Fang, Xinchao Wang2023 · 452 citations
  70. Pretrained Transformers Improve Out-of-Distribution RobustnessAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Hendrycks, Xiaoyuan Liu, Eric Wallace, et al.2020 · 452 citations
  71. FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingarXiv:1909.11764Chen Zhu, Yu Cheng, Zhe Gan, et al.2019 · 452 citations
  72. Experience Grounds LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Yonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 439 citations
  73. GPT-NER: Named Entity Recognition via Large Language ModelsFindings of the Association for Computational LinguisticsShuhe Wang, Xiaofei Sun, Xiaoya Li, et al.2025 · 436 citations
  74. InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksarXiv:2312.14238Zhe Chen, Jiannan Wu, Wenhai Wang, et al.2023 · 435 citations
  75. mPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityarXiv:2304.14178Qinghao Ye, Haiyang Xu, Guohai Xu, et al.2023 · 427 citations
  76. The Hateful Memes Challenge: Detecting Hate Speech in Multimodal MemesarXiv:2005.04790Douwe Kiela, Hamed Firooz, Aravind Mohan, et al.2020 · 420 citations
  77. Factual Probing Is [MASK]: Learning vs. Learning to RecallConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zexuan Zhong, Dan Friedman, Danqi Chen2021 · 415 citations
  78. True Few-Shot Learning with Language ModelsarXiv:2105.11447Ethan Perez, Douwe Kiela, Kyunghyun Cho2021 · 412 citations
  79. Do Prompt-Based Models Really Understand the Meaning of Their Prompts?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Albert Webson, Ellie Pavlick2022 · 407 citations
  80. Aligning AI With Shared Human ValuesarXiv:2008.02275Dan Hendrycks, Collin Burns, Steven Basart, et al.2020 · 395 citations
  81. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-TrainingarXiv:2002.12804Hangbo Bao, Li Dong, Furu Wei, et al.2020 · 395 citations
  82. ETC: Encoding Long and Structured Inputs in TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Joshua Ainslie, Santiago Ontañón, Chris Alberti, et al.2020 · 386 citations
  83. German's Next Language ModelInternational Conference on Computational Linguistics (COLING)Branden Chan, Stefan Schweter, Timo Möller2020 · 385 citations
  84. FastBERT: a Self-distilling BERT with Adaptive Inference TimeAnnual Meeting of the Association for Computational Linguistics (ACL)Weijie Liu, Peng Zhou, Zhiruo Wang, et al.2020 · 383 citations
  85. PaLI: A Jointly-Scaled Multilingual Language-Image ModelarXiv:2209.06794Xi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 371 citations
  86. Revisiting Few-sample BERT Fine-tuningarXiv:2006.05987Tianyi Zhang, Felix Wu, Arzoo Katiyar, et al.2020 · 368 citations
  87. Parameter-Efficient Transfer Learning with Diff PruningAnnual Meeting of the Association for Computational Linguistics (ACL)Demi Guo, Alexander Rush, Yoon Kim2021 · 367 citations
  88. VideoChat: Chat-Centric Video UnderstandingScience China Information SciencesKunChang Li, Yinan He, Yi Wang, et al.2023 · 365 citations
  89. Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Shengding Hu, Ning Ding, Huadong Wang, et al.2022 · 362 citations
  90. BERTje: A Dutch BERT ModelarXiv:1912.09582Wietse de Vries, Andreas van Cranenburgh, Arianna Bisazza, et al.2019 · 361 citations
  91. RobBERT: a Dutch RoBERTa-based Language ModelarXiv:2001.06286Pieter Delobelle, Thomas Winters, Bettina Berendt2020 · 349 citations
  92. MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesarXiv:2308.02490Weihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 344 citations
  93. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2107.02137Yu Sun, Shuohuan Wang, Shikun Feng, et al.2021 · 332 citations
  94. Language Is Not All You Need: Aligning Perception with Language ModelsConference on Neural Information Processing Systems (NeurIPS)Shaohan Huang, Li Dong, Wenhui Wang, et al.2023 · 330 citations
  95. Unsupervised Corpus Aware Language Model Pre-training for Dense Passage RetrievalAnnual Meeting of the Association for Computational Linguistics (ACL)Luyu Gao, Jamie Callan2022 · 328 citations
  96. MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
  97. How many data points is a prompt worth?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Teven Le Scao, Alexander Rush2021 · 320 citations
  98. From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Shangbin Feng, Chan Young Park, Yuhan Liu, et al.2023 · 311 citations
  99. Byte Pair Encoding is Suboptimal for Language Model PretrainingFindings of the Association for Computational LinguisticsKaj Bostrom, Greg Durrett2020 · 310 citations
  100. UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Wei Li, Can Gao, Guocheng Niu, et al.2021 · 308 citations

1 2 3 4

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/piyush-sharma/cited-by/