Urvashi Khandelwal
Urvashi Khandelwal has 3 papers in our library, in 2018–2022, most of them on Language models & pretraining, Vision & language; often with Christopher D. Manning, Dan Jurafsky, Fangyu Liu.
OpenAlex · h-index 14 · 16 works · 4,361 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 4,013 times in our library · 6 more in our library without a page yet · ⭐ Paper Stars ranking: #3045
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 2 worksVision & language · 1 work
Works by year
2020s
2010s
Papers
- Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context (2018 · 399 citations)
Neural language models beat n-gram models, and this is often credited to their use of distant context. This paper tests that claim directly. It asks three things: how many preceding tokens an LSTM language model actually exploits, whether near and far context are represented differently, and how a copy mechanism… - BAM! Born-Again Multi-Task Networks for Natural Language Understanding (2019 · 285 citations)
Multi-task neural models in NLP often fail to match the accuracy of separately trained single-task models. - Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding (2022 · 158 citations)
Pix2Struct is a general pretrained model for images where text and visuals are mixed, such as documents, charts, diagrams, app screens, and photos containing text.
All works
- What Does BERT Look at? An Analysis of BERT's Attention ↗Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · no summary yetKevin Clark et al.2019 · 2,049 citations
- Generalization through Memorization: Nearest Neighbor Language Models ↗arXiv:1911.00172 · no summary yetUrvashi Khandelwal et al.2019 · 464 citations
- Emergent linguistic structure in artificial neural networks trained by self-supervision ↗Proceedings of the National Academy of Sciences · no summary yetChristopher D. Manning et al.2020 · 461 citations
- Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use ContextAnnual Meeting of the Association for Computational Linguistics (ACL)Urvashi Khandelwal, He He, Peng Qi, et al.2018 · 399 citations
- BAM! Born-Again Multi-Task Networks for Natural Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL)Kevin Clark, Minh-Thang Luong, Urvashi Khandelwal, et al.2019 · 285 citations
- Nearest Neighbor Machine Translation ↗arXiv (Cornell University) · no summary yetUrvashi Khandelwal et al.2020 · 193 citations
- With Little Power Comes Great Responsibility ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetDallas Card et al.2020 · 173 citations
- Pix2Struct: Screenshot Parsing as Pretraining for Visual Language UnderstandingarXiv:2210.03347Kenton Lee, Mandar Joshi, Iulia Turc, et al.2022 · 158 citations
- Sample Efficient Text Summarization Using a Single Pre-Trained Transformer ↗arXiv (Cornell University) · no summary yetUrvashi Khandelwal et al.2019 · 81 citations
Co-authors here
- Christopher D. Manning
- Dan Jurafsky
- Fangyu Liu
- He He
- Hexiang Hu
- Iulia Turc
- Julian Eisenschlos
- Kenton Lee
- Kevin Clark
- Kristina Toutanova
- Mandar Joshi
- Ming-Wei Chang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2019, ACL 2018
- Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP
- Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)
- Proceedings of the National Academy of Sciences
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/urvashi-khandelwal/