Who cites «Adam: A Method for Stochastic Optimization»
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsIEEE/CVF International Conference on Computer Vision (ICCV)Ze Liu, Yutong Lin, Yue Cao, et al.2021 · 33,968 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScalearXiv:2010.11929Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.2020 · 23,726 citations
- Attention Is All You NeedarXiv:1706.03762Ashish Vaswani, Noam Shazeer, Niki Parmar, et al.2017 · 17,458 citations
- Deep Contextualized Word RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Matthew E. Peters, Mark Neumann, Mohit Iyyer, et al.2018 · 14,944 citations
- RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
- Graph Attention NetworksarXiv:1710.10903Petar Veličkovic, Guillem Cucurull, Arantxa Casanova, et al.2017 · 9,035 citations
- Semi-Supervised Classification with Graph Convolutional NetworksarXiv:1609.02907Thomas N. Kipf, Max Welling2016 · 9,023 citations
- Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
- Show, Attend and Tell: Neural Image Caption Generation with Visual AttentionarXiv:1502.03044Kelvin Xu, Jimmy Ba, Ryan Kiros, et al.2015 · 7,670 citations
- Representation Learning with Contrastive Predictive CodingarXiv:1807.03748Aaron van den Oord, Yazhe Li, Oriol Vinyals2018 · 7,022 citations
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial NetworksarXiv:1511.06434Alec Radford, Luke Metz, Soumith Chintala2015 · 6,654 citations
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep NetworksarXiv:1703.03400Chelsea Finn, Pieter Abbeel, Sergey Levine2017 · 6,549 citations
- Retrieval-Augmented Generation for Knowledge-Intensive NLP TasksarXiv:2005.11401Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.2020 · 6,256 citations
- A Broad-Coverage Challenge Corpus for Sentence Understanding through InferenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Adina Williams, Nikita Nangia, Samuel R. Bowman2018 · 5,551 citations
- Neural Architectures for Named Entity RecognitionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, et al.2016 · 5,319 citations
- mixup: Beyond Empirical Risk MinimizationarXiv:1710.09412Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, et al.2017 · 4,928 citations
- Inductive Representation Learning on Large GraphsarXiv:1706.02216William L. Hamilton, Rex Ying, Jure Leskovec2017 · 4,795 citations
- PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
- Neural Architecture Search with Reinforcement LearningarXiv:1611.01578Barret Zoph, Quoc V. Le2016 · 4,413 citations
- Neural Message Passing for Quantum ChemistryarXiv:1704.01212Justin Gilmer, Samuel S. Schoenholz, Patrick F. Riley, et al.2017 · 3,793 citations
- SciBERT: A Pretrained Language Model for Scientific TextConference on Empirical Methods in Natural Language Processing (EMNLP)Iz Beltagy, Kyle Lo, Arman Cohan2019 · 3,582 citations
- Conformer: Convolution-augmented Transformer for Speech RecognitionInterspeechAnmol Gulati, James Qin, Chung-Cheng Chiu, et al.2020 · 3,475 citations
- HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden UnitsIEEE/ACM Transactions on Audio Speech and Language ProcessingWei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, et al.2021 · 3,458 citations
- Scaling Laws for Neural Language ModelsarXiv:2001.08361Jared Kaplan, Sam McCandlish, Tom Henighan, et al.2020 · 3,434 citations
- Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading BooksarXiv:1506.06724Yukun Zhu, Ryan Kiros, Richard Zemel, et al.2015 · 3,083 citations
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- Self-Attention with Relative Position RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Peter Shaw, Jakob Uszkoreit, Ashish Vaswani2018 · 2,848 citations
- LXMERT: Learning Cross-Modality Encoder Representations from TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Hao Tan, Mohit Bansal2019 · 2,789 citations
- Hierarchical Text-Conditional Image Generation with CLIP LatentsarXiv:2204.06125Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, et al.2022 · 2,713 citations
- Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingarXiv:2007.15779Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon2020 · 2,674 citations
- SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics (TACL)Mandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,616 citations
- Self-critical Sequence Training for Image CaptioningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionSteven J. Rennie, Etienne Marcheret, Youssef Mroueh, et al.2016 · 2,404 citations
- Reading Wikipedia to Answer Open-Domain QuestionsAnnual Meeting of the Association for Computational Linguistics (ACL)Danqi Chen, Adam Fisch, Jason Weston, et al.2017 · 2,283 citations
- SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsarXiv:1905.00537Alex Wang, Yada Pruksachatkun, Nikita Nangia, et al.2019 · 2,227 citations
- Tensor Fusion Network for Multimodal Sentiment AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP)Amir Zadeh, Minghai Chen, Soujanya Poria, et al.2017 · 2,125 citations
- GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question AnsweringIEEE Computer Society Conference on Computer Vision and Pattern RecognitionDrew A. Hudson, Christopher D. Manning2019 · 2,078 citations
- Training Compute-Optimal Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.2022 · 2,032 citations
- Convolutional Neural Networks on Graphs with Fast Localized Spectral FilteringConference on Neural Information Processing Systems (NeurIPS)Michael Defferrard, Xavier Bresson, Pierre Vandergheynst2016 · 1,861 citations
- DeBERTa: Decoding-enhanced BERT with Disentangled AttentionarXiv:2006.03654Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al.2020 · 1,828 citations
- Layer NormalizationarXiv:1607.06450Jimmy Lei Ba, Jamie Ryan Kiros, Geoffrey E. Hinton2016 · 1,819 citations
- ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Omar Khattab, Matei Zaharia2020 · 1,789 citations
- Leveraging Passage Retrieval with Generative Models for Open Domain Question AnsweringConference of the European Chapter of the Association for Computational Linguistics (EACL)Gautier Izacard, Edouard Grave2021 · 1,692 citations
- Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
- A Deep Reinforced Model for Abstractive SummarizationarXiv:1705.04304Romain Paulus, Caiming Xiong, Richard Socher2017 · 1,657 citations
- The Concrete Distribution: A Continuous Relaxation of Discrete Random VariablesarXiv:1611.00712Chris J. Maddison, Andriy Mnih, Yee Whye Teh2016 · 1,629 citations
- End-to-End Relation Extraction using LSTMs on Sequences and Tree StructuresAnnual Meeting of the Association for Computational Linguistics (ACL)Makoto Miwa, Mohit Bansal2016 · 1,606 citations
- VisualBERT: A Simple and Performant Baseline for Vision and LanguagearXiv:1908.03557Liunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,568 citations
- Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be PrunedAnnual Meeting of the Association for Computational Linguistics (ACL)Elena Voita, David Talbot, Fedor Moiseev, et al.2019 · 1,535 citations
- Zero-Shot Text-to-Image GenerationarXiv:2102.12092Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.2021 · 1,528 citations
- Multi-Task Deep Neural Networks for Natural Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaodong Liu, Pengcheng He, Weizhu Chen, et al.2019 · 1,524 citations
- How Can We Know What Language Models Know?Transactions of the Association for Computational Linguistics (TACL)Zhengbao Jiang, Frank F. Xu, Jun Araki, et al.2020 · 1,521 citations
- Understanding Black-box Predictions via Influence FunctionsarXiv:1703.04730Pang Wei Koh, Percy Liang2017 · 1,514 citations
- Pre-Training with Whole Word Masking for Chinese BERTIEEE/ACM Transactions on Audio Speech and Language ProcessingYiming Cui, Wanxiang Che, Ting Liu, et al.2019 · 1,490 citations
- Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197Li Dong, Nan Yang, Wenhui Wang, et al.2019 · 1,422 citations
- wav2vec 2.0: A Framework for Self-Supervised Learning of Speech RepresentationsConference on Neural Information Processing Systems (NeurIPS)Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.2020 · 1,421 citations
- Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionPeter Anderson, Qi Wu, Damien Teney, et al.2017 · 1,414 citations
- BoolQ: Exploring the Surprising Difficulty of Natural Yes/No QuestionsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Christopher Clark, Kenton Lee, Ming-Wei Chang, et al.2019 · 1,330 citations
- Deep Biaffine Attention for Neural Dependency ParsingTimothy Dozat, Christopher D. Manning2016 · 1,326 citations
- DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding SharingarXiv:2111.09543Pengcheng He, Jianfeng Gao, Weizhu Chen2021 · 1,320 citations
- Long Short-Term Memory-Networks for Machine ReadingConference on Empirical Methods in Natural Language Processing (EMNLP)Jianpeng Cheng, Li Dong, Mirella Lapata2016 · 1,313 citations
- CTRL: A Conditional Transformer Language Model for Controllable GenerationarXiv:1909.05858Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.2019 · 1,291 citations
- CamemBERT: a Tasty French Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL)Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.2019 · 1,269 citations
- Assessing the Ability of LSTMs to Learn Syntax-Sensitive DependenciesTransactions of the Association for Computational Linguistics (TACL)Tal Linzen, Emmanuel Dupoux, Yoav Goldberg2016 · 1,256 citations
- A Structural Probe for Finding Syntax in Word RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)John Hewitt, Christopher D. Manning2019 · 1,254 citations
- Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement LearningarXiv:1709.00103Victor Zhong, Caiming Xiong, Richard Socher2017 · 1,226 citations
- Recipes for Building an Open-Domain ChatbotConference of the European Chapter of the Association for Computational Linguistics (EACL)Stephen Roller, Emily Dinan, Naman Goyal, et al.2021 · 1,214 citations
- DailyDialog: A Manually Labelled Multi-turn Dialogue DatasetarXiv:1710.03957Yanran Li, Hui Su, Xiaoyu Shen, et al.2017 · 1,206 citations
- BERTweet: A pre-trained language model for English TweetsConference on Empirical Methods in Natural Language Processing (EMNLP)Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen2020 · 1,144 citations
- MASS: Masked Sequence to Sequence Pre-training for Language GenerationarXiv:1905.02450Kaitao Song, Xu Tan, Tao Qin, et al.2019 · 1,143 citations
- Encoding Sentences with Graph Convolutional Networks for Semantic Role LabelingConference on Empirical Methods in Natural Language Processing (EMNLP)Diego Marcheggiani, Ivan Titov2017 · 1,106 citations
- RotatE: Knowledge Graph Embedding by Relational Rotation in Complex SpacearXiv:1902.10197Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, et al.2019 · 1,073 citations
- VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsarXiv:1908.08530Weijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,066 citations
- Privacy Risk in Machine Learning: Analyzing the Connection to OverfittingarXiv:1709.01604Samuel Yeom, Irene Giacomelli, Matt Fredrikson, et al.2017 · 1,036 citations
- A Theoretically Grounded Application of Dropout in Recurrent Neural NetworksarXiv:1512.05287Yarin Gal, Zoubin Ghahramani2015 · 1,032 citations
- Attention is not ExplanationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sarthak Jain, Byron C. Wallace2019 · 1,021 citations
- Linguistic Knowledge and Transferability of Contextual RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Nelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,021 citations
- Neural Summarization by Extracting Sentences and WordsAnnual Meeting of the Association for Computational Linguistics (ACL)Jianpeng Cheng, Mirella Lapata2016 · 1,011 citations
- Learning Discourse-level Diversity for Neural Dialog Models using Conditional Variational AutoencodersAnnual Meeting of the Association for Computational Linguistics (ACL)Tiancheng Zhao, Ran Zhao, Maxine Eskenazi2017 · 993 citations
- MPNet: Masked and Permuted Pre-training for Language UnderstandingarXiv:2004.09297Kaitao Song, Xu Tan, Tao Qin, et al.2020 · 957 citations
- Visual7W: Grounded Question Answering in ImagesIEEE Computer Society Conference on Computer Vision and Pattern RecognitionYuke Zhu, Oliver Groth, Michael Bernstein, et al.2015 · 952 citations
- Bilateral Multi-Perspective Matching for Natural Language SentencesInternational Joint Conference on Artificial IntelligenceZhiguo Wang, Wael Hamza, Radu Florian2017 · 933 citations
- Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature RepresentationsEliyahu Kiperwasser, Yoav Goldberg2016 · 909 citations
- Is Attention Interpretable?Annual Meeting of the Association for Computational Linguistics (ACL)Sofia Serrano, Noah A. Smith2019 · 899 citations
- End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFarXiv:1603.01354Xuezhe Ma, Eduard Hovy2016 · 868 citations
- DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language UnderstandingProceedings of the AAAI Conference on Artificial IntelligenceTao Shen, Tianyi Zhou, Guodong Long, et al.2017 · 854 citations
- DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in ConversationConference on Empirical Methods in Natural Language Processing (EMNLP)Deepanway Ghosal, Navonil Majumder, Soujanya Poria, et al.2019 · 853 citations
- DocVQA: A Dataset for VQA on Document ImagesarXiv:2007.00398Minesh Mathew, Dimosthenis Karatzas, C.V. Jawahar2020 · 844 citations
- Multi-Way, Multilingual Neural Machine Translation with a Shared Attention MechanismConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Orhan Firat, Kyunghyun Cho, Yoshua Bengio2016 · 833 citations
- ERASER: A Benchmark to Evaluate Rationalized NLP ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, et al.2020 · 832 citations
- Fast Abstractive Summarization with Reinforce-Selected Sentence RewritingAnnual Meeting of the Association for Computational Linguistics (ACL)Yen-Chun Chen, Mohit Bansal2018 · 826 citations
- Scaling Neural Machine TranslationConference on Machine Translation: Research PapersMyle Ott, Sergey Edunov, David Grangier, et al.2018 · 826 citations
- Learning Deep Transformer Models for Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Qiang Wang, Bei Li, Tong Xiao, et al.2019 · 810 citations
- XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleInterspeechArun Babu, Changhan Wang, Andros Tjandra, et al.2021 · 807 citations
- Reasoning about Entailment with Neural AttentionarXiv:1509.06664Tim Rocktaschel, Edward Grefenstette, Karl Moritz Hermann, et al.2015 · 802 citations
- Ask Me Anything: Dynamic Memory Networks for Natural Language ProcessingarXiv:1506.07285Ankit Kumar, Ozan Irsoy, Peter Ondruska, et al.2015 · 801 citations
- TuckER: Tensor Factorization for Knowledge Graph CompletionarXiv:1901.09590Ivana Balažević, Carl Allen, Timothy M. Hospedales2019 · 799 citations
- Achieving Human Parity on Automatic Chinese to English News TranslationarXiv:1803.05567Hany Hassan, Anthony Aue, Chang Chen, et al.2018 · 799 citations
- Semi-supervised sequence tagging with bidirectional language modelsAnnual Meeting of the Association for Computational Linguistics (ACL)Matthew E. Peters, Waleed Ammar, Chandra Bhagavatula, et al.2017 · 795 citations
- Revisiting Pre-Trained Models for Chinese Natural Language ProcessingarXiv:2004.13922Yiming Cui, Wanxiang Che, Ting Liu, et al.2020 · 790 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/kingma-2014-adam-method-stochastic-optimization/cited-by/