Andriy Mnih
Andriy Mnih has 2 papers in our library, in 2012–2016, most of them on Language models & pretraining; often with Yee Whye Teh, Chris J. Maddison.
OpenAlex · h-index 21 · 49 works · 12,925 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 590 times in our library · 8 more in our library without a page yet · ⭐ Paper Stars ranking: #1604
Affiliations
🏢Google DeepMindLondon ·
United Kingdom2013–2026 · 10 papers🏢GoogleLondon ·
United Kingdom2026 · 1 paper🏢GoogleMountain View ·
United States2015–2021 · 13 papers🎓University of TorontoToronto ·
Canada2003–2010 · 9 papers🔬Gatsby Computational Neuroscience UnitLondon ·
United Kingdom2011–2012 · 3 papers🎓University College LondonLondon ·
United Kingdom2011–2012 · 3 papers
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2010s
Papers
- The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables (2016 · 1,629 citations)
Gradient-based training of models with random choices works well when each random node can be rewritten as a differentiable function of its parameters plus fixed noise. - A Fast and Simple Algorithm for Training Neural Probabilistic Language Models (2012 · 408 citations)
Neural probabilistic language models (NPLMs) tend to beat n-gram models, but they are slow to train. The softmax normalization forces every gradient step to score the entire vocabulary. Mnih and Teh adapt noise-contrastive estimation (NCE), introduced by Gutmann and Hyvärinen for unnormalized densities, to discrete…
All works
- Probabilistic Matrix Factorization ↗neural information processing systems · no summary yetAndriy Mnih, Ruslan Salakhutdinov2007 · 3,483 citations
- Restricted Boltzmann machines for collaborative filtering ↗International Conference on Machine Learning · no summary yetRuslan Salakhutdinov, Andriy Mnih, Geoffrey E. Hinton2007 · 1,865 citations
- The Concrete Distribution: A Continuous Relaxation of Discrete Random VariablesarXiv:1611.00712Chris J. Maddison, Andriy Mnih, Yee Whye Teh2016 · 1,629 citations
- Bayesian probabilistic matrix factorization using Markov chain Monte Carlo ↗International Conference on Machine Learning · no summary yetRuslan Salakhutdinov, Andriy Mnih2008 · 1,437 citations
- Learning word embeddings efficiently with noise-contrastive estimation ↗neural information processing systems · no summary yetAndriy Mnih, Koray Kavukcuoglu2013 · 505 citations
- A Fast and Simple Algorithm for Training Neural Probabilistic Language ModelsarXiv:1206.6426 · In Proceedings of the 29th International Conference on Machine Learning, pages 1751-1758, 2012Andriy Mnih, Yee Whye Teh2012 · 408 citations
- Attentive Neural Processes ↗arXiv (Cornell University) · no summary yetHyunjik Kim et al.2019 · 33 citations
- Wormholes Improve Contrastive Divergence ↗no summary yetMax Welling, Andriy Mnih, Geoffrey E. Hinton2003 · 12 citations
- Learning word embeddings efficiently with noise-contrastive ↗no summary yetAndriy Mnih, Koray Kavukcuoglu2014
- Bayesian probabilistic matrix factorization using MCMC ↗no summary yetRuslan Salakhutdinov, Andriy Mnih2008
Co-authors here
Venues
- International Conference on Machine Learning ×2
- neural information processing systems ×2
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/andriy-mnih/