Elamur Research⌕
☰
home / papers / Dropout: A Simple Way to Prevent Neural Networks… / cited by

Who cites «Dropout: A Simple Way to Prevent Neural Networks from Overfitting»

2,041 papers of our library cite it (of the 149,439 whose bibliographies we read) · 242 with a page here, the most cited first · page 1 of 3 · 1–100 · ← back to «Dropout: A Simple Way to Prevent Neural Networks from Overfitting»

1 2 3

  1. Attention Is All You NeedarXiv:1706.03762Ashish Vaswani, Noam Shazeer, Niki Parmar, et al.2017 · 17,458 citations
  2. Distilling the Knowledge in a Neural NetworkarXiv:1503.02531Geoffrey Hinton, Oriol Vinyals, Jeff Dean2015 · 15,229 citations
  3. Deep Contextualized Word RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Matthew E. Peters, Mark Neumann, Mohit Iyyer, et al.2018 · 14,944 citations
  4. Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerarXiv:1910.10683Colin Raffel, Noam Shazeer, Adam Roberts, et al.2019 · 11,325 citations
  5. YOLOv4: Optimal Speed and Accuracy of Object DetectionarXiv:2004.10934Alexey Bochkovskiy, Chien-Yao Wang, Hong-Yuan Mark Liao2020 · 10,403 citations
  6. Graph Attention NetworksarXiv:1710.10903Petar Veličkovic, Guillem Cucurull, Arantxa Casanova, et al.2017 · 9,035 citations
  7. Semi-Supervised Classification with Graph Convolutional NetworksarXiv:1609.02907Thomas N. Kipf, Max Welling2016 · 9,023 citations
  8. Explaining and Harnessing Adversarial ExamplesarXiv:1412.6572Ian J. Goodfellow, Jonathon Shlens, Christian Szegedy2014 · 8,577 citations
  9. Show, Attend and Tell: Neural Image Caption Generation with Visual AttentionarXiv:1502.03044Kelvin Xu, Jimmy Ba, Ryan Kiros, et al.2015 · 7,670 citations
  10. Learning Transferable Architectures for Scalable Image RecognitionIEEE Computer Society Conference on Computer Vision and Pattern RecognitionBarret Zoph, Vijay Vasudevan, Jonathon Shlens, et al.2017 · 6,583 citations
  11. A Broad-Coverage Challenge Corpus for Sentence Understanding through InferenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Adina Williams, Nikita Nangia, Samuel R. Bowman2018 · 5,551 citations
  12. EfficientNet: Rethinking Model Scaling for Convolutional Neural NetworksInternational Conference on Machine Learning (ICML)Mingxing Tan, Quoc V. Le2019 · 5,416 citations
  13. A large annotated corpus for learning natural language inferenceConference on Empirical Methods in Natural Language Processing (EMNLP)Samuel R. Bowman, Gabor Angeli, Christopher Potts, et al.2015 · 5,299 citations
  14. mixup: Beyond Empirical Risk MinimizationarXiv:1710.09412Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, et al.2017 · 4,928 citations
  15. SimCSE: Simple Contrastive Learning of Sentence EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP)Tianyu Gao, Xingcheng Yao, Danqi Chen2021 · 3,942 citations
  16. Conformer: Convolution-augmented Transformer for Speech RecognitionInterspeechAnmol Gulati, James Qin, Chung-Cheng Chiu, et al.2020 · 3,475 citations
  17. Convolutional Sequence to Sequence LearningarXiv:1705.03122Jonas Gehring, Michael Auli, David Grangier, et al.2017 · 3,042 citations
  18. Generating Sentences from a Continuous SpaceConference on Computational Natural Language Learning (CoNLL)Samuel R. Bowman, Luke Vilnis, Oriol Vinyals, et al.2016 · 2,435 citations
  19. Relational inductive biases, deep learning, and graph networksarXiv:1806.01261Peter W. Battaglia, Jessica B. Hamrick, Victor Bapst, et al.2018 · 2,335 citations
  20. Stacked Attention Networks for Image Question AnsweringIEEE Computer Society Conference on Computer Vision and Pattern RecognitionZichao Yang, Xiaodong He, Jianfeng Gao, et al.2015 · 2,157 citations
  21. Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1arXiv:1602.02830Matthieu Courbariaux, Itay Hubara, Daniel Soudry, et al.2016 · 2,143 citations
  22. Bidirectional Attention Flow for Machine ComprehensionarXiv:1611.01603Minjoon Seo, Aniruddha Kembhavi, Ali Farhadi, et al.2016 · 1,988 citations
  23. BinaryConnect: Training Deep Neural Networks with binary weights during propagationsarXiv:1511.00363Matthieu Courbariaux, Yoshua Bengio, Jean-Pierre David2015 · 1,885 citations
  24. Quantized Neural Networks: Training Neural Networks with Low Precision Weights and ActivationsarXiv:1609.07061Itay Hubara, Matthieu Courbariaux, Daniel Soudry, et al.2016 · 1,610 citations
  25. End-to-End Relation Extraction using LSTMs on Sequences and Tree StructuresAnnual Meeting of the Association for Computational Linguistics (ACL)Makoto Miwa, Mohit Bansal2016 · 1,606 citations
  26. On the Convergence of Adam and BeyondarXiv:1904.09237Sashank J. Reddi, Satyen Kale, Sanjiv Kumar2019 · 1,598 citations
  27. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword CandidatesAnnual Meeting of the Association for Computational Linguistics (ACL)Taku Kudo2018 · 1,573 citations
  28. Unifying Visual-Semantic Embeddings with Multimodal Neural Language ModelsarXiv:1411.2539Ryan Kiros, Ruslan Salakhutdinov, Richard S. Zemel2014 · 1,371 citations
  29. Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement LearningarXiv:1709.00103Victor Zhong, Caiming Xiong, Richard Socher2017 · 1,226 citations
  30. Semantically Conditioned LSTM-based Natural Language Generation for Spoken Dialogue SystemsConference on Empirical Methods in Natural Language Processing (EMNLP)Tsung-Hsien Wen, Milica Gašić, Nikola Mrkšić, et al.2015 · 1,202 citations
  31. Bias and Fairness in Large Language Models: A SurveyComputational LinguisticsIsabel O. Gallegos, Ryan A. Rossi, Joe Barrow, et al.2023 · 1,082 citations
  32. A Theoretically Grounded Application of Dropout in Recurrent Neural NetworksarXiv:1512.05287Yarin Gal, Zoubin Ghahramani2015 · 1,032 citations
  33. Chinese NER Using Lattice LSTMAnnual Meeting of the Association for Computational Linguistics (ACL)Yue Zhang, Jie Yang2018 · 998 citations
  34. Segment AnythingarXiv:2304.02643Alexander Kirillov, Eric Mintun, Nikhila Ravi, et al.2023 · 960 citations
  35. Deep Unordered Composition Rivals Syntactic Methods for Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Mohit Iyyer, Varun Manjunatha, Jordan Boyd-Graber, et al.2015 · 926 citations
  36. End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFarXiv:1603.01354Xuezhe Ma, Eduard Hovy2016 · 868 citations
  37. DiSAN: Directional Self-Attention Network for RNN/CNN-Free Language UnderstandingProceedings of the AAAI Conference on Artificial IntelligenceTao Shen, Tianyi Zhou, Guodong Long, et al.2017 · 854 citations
  38. Gated Self-Matching Networks for Reading Comprehension and Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhui Wang, Nan Yang, Furu Wei, et al.2017 · 833 citations
  39. ERASER: A Benchmark to Evaluate Rationalized NLP ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, et al.2020 · 832 citations
  40. Scaling Neural Machine TranslationConference on Machine Translation: Research PapersMyle Ott, Sergey Edunov, David Grangier, et al.2018 · 826 citations
  41. TuckER: Tensor Factorization for Knowledge Graph CompletionarXiv:1901.09590Ivana Balažević, Carl Allen, Timothy M. Hospedales2019 · 799 citations
  42. SoundStream: An End-to-End Neural Audio CodecIEEE/ACM Transactions on Audio Speech and Language ProcessingNeil Zeghidour, Alejandro Luebs, Ahmed Omran, et al.2021 · 733 citations
  43. Progressive Differentiable Architecture Search: Bridging the Depth Gap between Search and EvaluationIEEE/CVF International Conference on Computer Vision (ICCV)Xin Chen, Lingxi Xie, Jun Wu, et al.2019 · 732 citations
  44. The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural NetworksarXiv:1802.08232Nicholas Carlini, Chang Liu, Ulfar Erlingsson, et al.2018 · 692 citations
  45. A Joint Many-Task Model: Growing a Neural Network for Multiple NLP TasksConference on Empirical Methods in Natural Language Processing (EMNLP)Kazuma Hashimoto, Caiming Xiong, Yoshimasa Tsuruoka, et al.2016 · 674 citations
  46. PathNet: Evolution Channels Gradient Descent in Super Neural NetworksarXiv:1701.08734Chrisantha Fernando, Dylan Banarse, Charles Blundell, et al.2017 · 667 citations
  47. How Powerful are Graph Neural Networks?arXiv:1810.00826Keyulu Xu, Weihua Hu, Jure Leskovec, et al.2018 · 655 citations
  48. A Neural Approach to Automated Essay ScoringConference on Empirical Methods in Natural Language Processing (EMNLP)Kaveh Taghipour, Hwee Tou Ng2016 · 654 citations
  49. Reporting Score Distributions Makes a Difference: Performance Study of LSTM-networks for Sequence TaggingConference on Empirical Methods in Natural Language Processing (EMNLP)Nils Reimers, Iryna Gurevych2017 · 652 citations
  50. Regularizing and Optimizing LSTM Language ModelsarXiv:1708.02182Stephen Merity, Nitish Shirish Keskar, Richard Socher2017 · 633 citations
  51. Efficient Intent Detection with Dual Sentence EncodersWorkshop on Natural Language Processing for Conversational AIIñigo Casanueva, Tadas Temčinas, Daniela Gerz, et al.2020 · 628 citations
  52. Linguistically-Informed Self-Attention for Semantic Role LabelingConference on Empirical Methods in Natural Language Processing (EMNLP)Emma Strubell, Patrick Verga, Daniel Andor, et al.2018 · 604 citations
  53. Dynamic Coattention Networks For Question AnsweringarXiv:1611.01604Caiming Xiong, Victor Zhong, Richard Socher2016 · 596 citations
  54. DataStories at SemEval-2017 Task 4: Deep LSTM with Attention for Message-level and Topic-based Sentiment AnalysisInternational Workshop on Semantic Evaluation (SemEval)Christos Baziotis, Nikos Pelekis, Christos Doulkeridis2017 · 588 citations
  55. Massively Multilingual Neural Machine Translation in the Wild: Findings and ChallengesarXiv:1907.05019Naveen Arivazhagan, Ankur Bapna, Orhan Firat, et al.2019 · 564 citations
  56. Reducing Transformer Depth on Demand with Structured DropoutarXiv:1909.11556Angela Fan, Edouard Grave, Armand Joulin2019 · 560 citations
  57. SearchQA: A New Q&A Dataset Augmented with Context from a Search EnginearXiv:1704.05179Matthew Dunn, Levent Sagun, Mike Higgins, et al.2017 · 555 citations
  58. Fast and Accurate Entity Recognition with Iterated Dilated ConvolutionsConference on Empirical Methods in Natural Language Processing (EMNLP)Emma Strubell, Patrick Verga, David Belanger, et al.2017 · 548 citations
  59. Simple, Scalable Adaptation for Neural Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP)Ankur Bapna, Orhan Firat2019 · 530 citations
  60. ICON: Interactive Conversational Memory Network for Multimodal Emotion DetectionConference on Empirical Methods in Natural Language Processing (EMNLP)Devamanyu Hazarika, Soujanya Poria, Rada Mihalcea, et al.2018 · 526 citations
  61. Regularizing Neural Networks by Penalizing Confident Output DistributionsarXiv:1701.06548Gabriel Pereyra, George Tucker, Jan Chorowski, et al.2017 · 496 citations
  62. A Convolutional Encoder Model for Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Jonas Gehring, Michael Auli, David Grangier, et al.2017 · 492 citations
  63. Deep Exploration via Bootstrapped DQNarXiv:1602.04621Ian Osband, Charles Blundell, Alexander Pritzel, et al.2016 · 490 citations
  64. Legal Judgment Prediction via Topological LearningConference on Empirical Methods in Natural Language Processing (EMNLP)Haoxi Zhong, Zhipeng Guo, Cunchao Tu, et al.2018 · 480 citations
  65. Joint Embedding of Words and Labels for Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Guoyin Wang, Chunyuan Li, Wenlin Wang, et al.2018 · 465 citations
  66. CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual ReasoningarXiv:1612.06890Justin Johnson, Bharath Hariharan, Laurens van der Maaten, et al.2016 · 464 citations
  67. Graph-to-Sequence Learning using Gated Graph Neural NetworksAnnual Meeting of the Association for Computational Linguistics (ACL)Daniel Beck, Gholamreza Haffari, Trevor Cohn2018 · 459 citations
  68. FreeLB: Enhanced Adversarial Training for Natural Language UnderstandingarXiv:1909.11764Chen Zhu, Yu Cheng, Zhe Gan, et al.2019 · 452 citations
  69. Neural Document Summarization by Jointly Learning to Score and Select SentencesAnnual Meeting of the Association for Computational Linguistics (ACL)Qingyu Zhou, Nan Yang, Furu Wei, et al.2018 · 450 citations
  70. The Falcon Series of Open Language ModelsarXiv:2311.16867Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 443 citations
  71. Adversarial Training Methods for Semi-Supervised Text ClassificationarXiv:1605.07725Takeru Miyato, Andrew M. Dai, Ian Goodfellow2016 · 433 citations
  72. Depression and Self-Harm Risk Assessment in Online ForumsConference on Empirical Methods in Natural Language Processing (EMNLP)Andrew Yates, Arman Cohan, Nazli Goharian2017 · 404 citations
  73. BPE-Dropout: Simple and Effective Subword RegularizationAnnual Meeting of the Association for Computational Linguistics (ACL)Ivan Provilkov, Dmitrii Emelianenko, Elena Voita2020 · 391 citations
  74. Deep Semantic Role Labeling with Self-AttentionProceedings of the AAAI Conference on Artificial IntelligenceZhixing Tan, Mingxuan Wang, Jun Xie, et al.2017 · 387 citations
  75. Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling MechanismsAnnual Meeting of the Association for Computational Linguistics (ACL)Dinghan Shen, Guoyin Wang, Wenlin Wang, et al.2018 · 386 citations
  76. Many Languages, One ParserTransactions of the Association for Computational Linguistics (TACL)Waleed Ammar, George Mulcaire, Miguel Ballesteros, et al.2016 · 382 citations
  77. Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social GoodAnnual Meeting of the Association for Computational Linguistics (ACL)Xuewei Wang, Weiyan Shi, Richard Kim, et al.2019 · 373 citations
  78. Revisiting Few-sample BERT Fine-tuningarXiv:2006.05987Tianyi Zhang, Felix Wu, Arzoo Katiyar, et al.2020 · 368 citations
  79. Averaging Weights Leads to Wider Optima and Better GeneralizationarXiv:1803.05407Pavel Izmailov, Dmitrii Podoprikhin, Timur Garipov, et al.2018 · 366 citations
  80. Adversarial Training for Unsupervised Bilingual Lexicon InductionAnnual Meeting of the Association for Computational Linguistics (ACL)Meng Zhang, Yang Liu, Huanbo Luan, et al.2017 · 362 citations
  81. Simultaneously Self-Attending to All Mentions for Full-Abstract Biological Relation ExtractionConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Patrick Verga, Emma Strubell, Andrew McCallum2018 · 353 citations
  82. Exploring Neural Text Simplification ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Sergiu Nisioi, Sanja Štajner, Simone Paolo Ponzetto, et al.2017 · 353 citations
  83. Syntax-Aware Aspect Level Sentiment Classification with Graph Attention NetworksConference on Empirical Methods in Natural Language Processing (EMNLP)Binxuan Huang, Kathleen Carley2019 · 351 citations
  84. RobBERT: a Dutch RoBERTa-based Language ModelarXiv:2001.06286Pieter Delobelle, Thomas Winters, Bettina Berendt2020 · 349 citations
  85. Semi-supervised Multitask Learning for Sequence LabelingAnnual Meeting of the Association for Computational Linguistics (ACL)Marek Rei2017 · 347 citations
  86. Sentence Compression by Deletion with LSTMsConference on Empirical Methods in Natural Language Processing (EMNLP)Katja Filippova, Enrique Alfonseca, Carlos A. Colmenares, et al.2015 · 338 citations
  87. Neural Paraphrase Generation with Stacked Residual LSTM NetworksInternational Conference on Computational Linguistics (COLING)Aaditya Prakash, Sadid A. Hasan, Kathy Lee, et al.2016 · 337 citations
  88. Long Short-Term Memory Neural Networks for Chinese Word SegmentationConference on Empirical Methods in Natural Language Processing (EMNLP)Xinchi Chen, Xipeng Qiu, Chenxi Zhu, et al.2015 · 336 citations
  89. ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and GenerationarXiv:2107.02137Yu Sun, Shuohuan Wang, Shikun Feng, et al.2021 · 332 citations
  90. Learning to Mine Aligned Code and Natural Language Pairs from Stack OverflowarXiv:1805.08949Pengcheng Yin, Bowen Deng, Edgar Chen, et al.2018 · 308 citations
  91. Muppet: Massive Multi-task Representations with Pre-FinetuningConference on Empirical Methods in Natural Language Processing (EMNLP)Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, et al.2021 · 307 citations
  92. Nested Named Entity Recognition RevisitedConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Arzoo Katiyar, Claire Cardie2018 · 306 citations
  93. A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error CorrectionProceedings of the AAAI Conference on Artificial IntelligenceShamil Chollampatt, Hwee Tou Ng2018 · 302 citations
  94. Incorporating Discrete Translation Lexicons into Neural Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP)Philip Arthur, Graham Neubig, Satoshi Nakamura2016 · 302 citations
  95. Entity Linking via Joint Encoding of Types, Descriptions, and ContextConference on Empirical Methods in Natural Language Processing (EMNLP)Nitish Gupta, Sameer Singh, Dan Roth2017 · 299 citations
  96. Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency ParsingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Tal Schuster, Ori Ram, Regina Barzilay, et al.2019 · 298 citations
  97. Overcoming Catastrophic Forgetting by Incremental Moment MatchingarXiv:1703.08475Sang-Woo Lee, Jin-Hwa Kim, Jaehyun Jun, et al.2017 · 298 citations
  98. Structural Scaffolds for Citation Intent Classification in Scientific PublicationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Arman Cohan, Waleed Ammar, Madeleine van Zuylen, et al.2019 · 289 citations
  99. Text Generation from Knowledge Graphs with Graph TransformersConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Rik Koncel-Kedziorski, Dhanush Bekal, Yi Luan, et al.2019 · 288 citations
  100. Hierarchical Multiscale Recurrent Neural NetworksarXiv:1609.01704Junyoung Chung, Sungjin Ahn, Yoshua Bengio2016 · 288 citations

1 2 3

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/srivastava-2014-dropout-simple-way-prevent/cited-by/