Rupesh Kumar Srivastava
Rupesh Kumar Srivastava has 3 papers in our library, in 2015–2016; often with Jurgen Schmidhuber, Jan Koutnik, Klaus Greff.
No OpenAlex profile matched yet.
📄 3 works in our library · 🔗 Cited 356 times in our library · ⭐ Paper Stars ranking: #443
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksArtificial Intelligence · 3 worksArts and Humanities · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
Works by year
2010s
Papers
- LSTM: A Search Space Odyssey (2015 · 7,008 citations)
Since its introduction in the mid-1990s, LSTM has accumulated many architectural modifications, but no one had systematically tested which of its parts actually matter. - Highway Networks (2015 · 680 citations)
Deeper neural networks tend to perform better, but plain feedforward stacks get much harder to train with gradient descent as layers are added, even with careful variance-preserving initialization. - Recurrent Highway Networks (2016 · 147 citations)
Recurrent networks usually update their hidden state with a single nonlinear step per time step. Making this step-to-step transition deeper should add modeling power, but such models have very long gradient paths and are hard to train, even when built from LSTM cells. Zilly et al. study this problem using Geršgorin's…
Co-authors here
Venues
- IEEE Transactions on Neural Networks and Learning Systems: IEEE Transactions on Neural Networks and Learning Systems 2015
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/rupesh-kumar-srivastava/