Adhiguna Kuncoro
Adhiguna Kuncoro has 2 papers in our library, in 2018–2022, most of them on Language models & pretraining, Syntax & grammar formalisms; often with Chris Dyer, Phil Blunsom, Dani Yogatama.
OpenAlex · h-index 17 · 42 works · 2,046 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1,544 times in our library · 7 more in our library without a page yet · ⭐ Paper Stars ranking: #5103
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Syntax & grammar formalisms · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
2010s
Papers
- LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better (2018 · 208 citations)
Linzen et al. (2016) used subject–verb number agreement as a probe of syntactic competence. The hard cases contain intervening "attractor" nouns whose number differs from the subject. On that basis they argued that LSTM language models fail to capture long-range syntactic dependencies. Kuncoro et al. rerun this test… - Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale (2022 · 72 citations)
Large Transformer LMs perform strongly without any explicit model of hierarchical syntax. It was unclear whether recursive syntactic composition, which helped small LSTM-based RNNGs, still adds value for Transformers at larger scale. The authors introduce Transformer Grammars (TGs), built on Transformer-XL, which…
All works
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher ↗arXiv:2112.11446 · no summary yetJack W. Rae et al.2021 · 928 citations
- Recurrent Neural Network Grammars ↗Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetChris Dyer et al.2016 · 770 citations
- LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them BetterAnnual Meeting of the Association for Computational Linguistics (ACL)Adhiguna Kuncoro, Chris Dyer, John Hale, et al.2018 · 208 citations
- Finding syntax in human encephalography with beam search ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetJohn Hale et al.2018 · 182 citations
- Unsupervised Recurrent Neural Network Grammars ↗Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · no summary yetYoon Kim et al.2019 · 168 citations
- IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetSamuel Cahyawijaya et al.2021 · 150 citations
- What Do Recurrent Neural Network Grammars Learn About Syntax? ↗arXiv:1611.05774 · no summary yetAdhiguna Kuncoro et al.2016 · 83 citations
- Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at ScaleTransactions of the Association for Computational Linguistics (TACL)Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, et al.2022 · 72 citations
- Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser ↗Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · no summary yetAdhiguna Kuncoro et al.2016 · 57 citations
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2018
- Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ×2
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing ×2
- Transactions of the Association for Computational Linguistics (TACL): Transactions of the Association for Computational Linguistics (TACL) 2022
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/adhiguna-kuncoro/