Sungjin Ahn
Sungjin Ahn has 3 papers in our library, in 2016, most of them on Language models & pretraining; often with Yoshua Bengio, Bowen Zhou, Caglar Gulcehre.
OpenAlex · ORCID · h-index 23 · 111 works · 2,435 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 397 times in our library · 8 more in our library without a page yet · ⭐ Paper Stars ranking: #2555
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksSignal Processing · 1 workComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2010s
Papers
- Pointing the Unknown Words (2016 · 651 citations)
Neural sequence models usually generate words from a fixed shortlist of frequent tokens, so rare items such as named entities are either poorly learned or collapsed into UNK. - Hierarchical Multiscale Recurrent Neural Networks (2016 · 288 citations)
Recurrent networks have long struggled to learn representations that are both temporal and hierarchical. Earlier multiscale RNNs either fixed each layer's update rate in advance or needed explicit segment boundaries, such as word tokenization. Chung, Ahn and Bengio propose the hierarchical multiscale RNN (HM-RNN)… - A Neural Knowledge Language Model (2016 · 146 citations)
Conventional neural language models are poor at conveying factual knowledge. Names of people, places, and dates occur rarely in a corpus. As a result, the model either lacks such words in its vocabulary or substitutes the <unk> token for them. The authors propose the Neural Knowledge Language Model (NKLM), an…
All works
- Pointing the Unknown WordsAnnual Meeting of the Association for Computational Linguistics (ACL)Caglar Gulcehre, Sungjin Ahn, Ramesh Nallapati, et al.2016 · 651 citations
- Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus ↗Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetIulian Vlad Serban et al.2016 · 351 citations
- Hierarchical Multiscale Recurrent Neural NetworksarXiv:1609.01704Junyoung Chung, Sungjin Ahn, Yoshua Bengio2016 · 288 citations
- A Neural Knowledge Language ModelarXiv:1608.00318Sungjin Ahn, Heeyoul Choi, Tanel Pärnamaa, et al.2016 · 146 citations
- Denoising Criterion for Variational Auto-Encoding Framework ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetDaniel Im Jiwoong Im et al.2017 · 144 citations
- Bayesian Posterior Sampling via Stochastic Gradient Fisher Scoring ↗UvA-DARE (University of Amsterdam) · no summary yetSungjin Ahn, Anoop Korattikara, Max Welling2012 · 114 citations
- Distributed Stochastic Gradient MCMC ↗UvA-DARE (University of Amsterdam) · no summary yetSungjin Ahn, Babak Shahbaba, Max Welling2014 · 80 citations
- Large-Scale Distributed Bayesian Matrix Factorization using Stochastic Gradient MCMC ↗ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · no summary yetSungjin Ahn et al.2015 · 54 citations
- Scalable MCMC for Mixed Membership Stochastic Blockmodels ↗UvA-DARE (University of Amsterdam) · no summary yetLi, Wenzhe, Sungjin Ahn, Max Welling2015 · 25 citations
- Distributed and Adaptive Darting Monte Carlo through Regenerations ↗UvA-DARE (University of Amsterdam) · no summary yetSungjin Ahn, Yutian Chen, Max Welling2013 · 23 citations
- Scalable Overlapping Community Detection ↗IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) · no summary yetIsmail El-Helw et al.2016 · 8 citations
Co-authors here
Venues
- UvA-DARE (University of Amsterdam) ×4
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2016
- ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD)
- IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)
- Proceedings of the AAAI Conference on Artificial Intelligence
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/sungjin-ahn/