Luke Zettlemoyer — all works
- Deep Contextualized Word RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Matthew E. Peters, Mark Neumann, Mohit Iyyer, et al.2018 · 14,944 citations
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Mike Lewis, Yinhan Liu, Naman Goyal, et al.2020 · 12,856 citations
- RoBERTa: A Robustly Optimized BERT Pretraining ApproacharXiv:1907.11692Yinhan Liu, Myle Ott, Naman Goyal, et al.2019 · 9,837 citations
- Unsupervised Cross-lingual Representation Learning at ScaleAnnual Meeting of the Association for Computational Linguistics (ACL)Alexis Conneau, Kartikay Khandelwal, Naman Goyal, et al.2020 · 9,468 citations
- TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Mandar Joshi, Eunsol Choi, Daniel Weld, et al.2017 · 3,263 citations
- QLoRA: Efficient Finetuning of Quantized LLMsConference on Neural Information Processing Systems (NeurIPS)Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, et al.2023 · 2,929 citations
- Multilingual Denoising Pre-training for Neural Machine Translation ↗Transactions of the Association for Computational Linguistics · no summary yetYinhan Liu et al.2020 · 2,616 citations
- SpanBERT: Improving Pre-training by Representing and Predicting SpansTransactions of the Association for Computational Linguistics (TACL)Mandar Joshi, Danqi Chen, Yinhan Liu, et al.2019 · 2,616 citations
- Toolformer: Language Models Can Teach Themselves to Use ToolsConference on Neural Information Processing Systems (NeurIPS)Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, et al.2023 · 2,065 citations
- AllenNLP: A Deep Semantic Natural Language Processing PlatformarXiv:1803.07640Matt Gardner, Joel Grus, Mark Neumann, et al.2018 · 1,819 citations
- Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?Conference on Empirical Methods in Natural Language Processing (EMNLP)Sewon Min, Xinxi Lyu, Ari Holtzman, et al.2022 · 1,444 citations
- End-to-end Neural Coreference ResolutionKenton Lee, Luheng He, Mike Lewis, et al.English · 1,284 citations
- Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations ↗Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies · no summary yetRaphael Hoffmann et al.2011 · 1,099 citations
- Learning to Map Sentences to Logical Form: Structured Classification with Probabilistic Categorial GrammarsarXiv:1207.1420Luke S. Zettlemoyer, Michael Collins2012 · 1,085 citations
- QuAC: Question Answering in ContextConference on Empirical Methods in Natural Language Processing (EMNLP)Eunsol Choi, He He, Mohit Iyyer, et al.2018 · 1,066 citations
- LIMA: Less Is More for Alignment ↗arXiv:2305.11206 · no summary yetChunting Zhou et al.2023 · 1,022 citations
- FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Sewon Min, Kalpesh Krishna, Xinxi Lyu, et al.2023 · 987 citations
- Adversarial Example Generation with Syntactically Controlled Paraphrase NetworksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Mohit Iyyer, John Wieting, Kevin Gimpel, et al.2018 · 938 citations
- Zero-Shot Relation Extraction via Reading ComprehensionConference on Computational Natural Language Learning (CoNLL)Omer Levy, Minjoon Seo, Eunsol Choi, et al.2017 · 806 citations
- Summarizing Source Code using a Neural Attention Model ↗Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetSrinivasan Iyer et al.2016 · 800 citations
- LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale ↗arXiv:2208.07339 · no summary yetTim Dettmers et al.2022 · 712 citations
- Mask-Predict: Parallel Decoding of Conditional Masked Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Marjan Ghazvininejad, Omer Levy, Yinhan Liu, et al.2019 · 684 citations
- Scalable Zero-shot Entity Linking with Dense Entity RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Ledell Wu, Fabio Petroni, Martin Josifoski, et al.2020 · 619 citations
- Higher-Order Coreference Resolution with Coarse-to-Fine InferenceConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kenton Lee, Luheng He, Luke Zettlemoyer2018 · 614 citations
- Weakly Supervised Learning of Semantic Parsers for Mapping Instructions to ActionsTransactions of the Association for Computational Linguistics (TACL)Yoav Artzi, Luke Zettlemoyer2013 · 609 citations
- s1: Simple test-time scalingConference on Empirical Methods in Natural Language Processing (EMNLP)Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 608 citations
- Deep Semantic Role Labeling: What Works and What's NextLuheng He, Kenton Lee, Mike Lewis, et al.English · 596 citations
- Evaluating Gender Bias in Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Gabriel Stanovsky, Noah A. Smith, Luke Zettlemoyer2019 · 593 citations
- Dissecting Contextual Word Embeddings: Architecture and RepresentationConference on Empirical Methods in Natural Language Processing (EMNLP)Matthew E. Peters, Mark Neumann, Luke Zettlemoyer, et al.2018 · 592 citations
- Online Learning of Relaxed CCG Grammars for Parsing to Logical Form ↗Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL) · no summary yetLuke Zettlemoyer, Michael Collins2007 · 547 citations
- Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Armen Aghajanyan, Sonal Gupta, Luke Zettlemoyer2021 · 542 citations
- VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetHu Xu et al.2021 · 511 citations
- Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetChristopher Clark, Mark Yatskar, Luke Zettlemoyer2019 · 509 citations
- Open question answering over curated and extracted knowledge bases ↗ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · no summary yetAnthony Fader, Luke Zettlemoyer, Oren Etzioni2014 · 504 citations
- Learning to Automatically Solve Algebra Word Problems ↗Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetNate Kushman et al.2014 · 493 citations
- REPLUG: Retrieval-Augmented Black-Box Language ModelsarXiv:2301.12652Weijia Shi, Sewon Min, Michihiro Yasunaga, et al.2023 · 492 citations
- BERT for Coreference Resolution: Baselines and AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP)Mandar Joshi, Omer Levy, Luke Zettlemoyer, et al.2019 · 490 citations
- Learning a Neural Semantic Parser from User Feedback ↗Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetSrinivasan Iyer et al.2017 · 472 citations
- Generalization through Memorization: Nearest Neighbor Language Models ↗arXiv:1911.00172 · no summary yetUrvashi Khandelwal et al.2019 · 464 citations
- Paraphrase-Driven Learning for Open Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Anthony Fader, Luke Zettlemoyer, Oren Etzioni2013 · 444 citations
- AmbigQA: Answering Ambiguous Open-domain Questions ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetSewon Min et al.2020 · 437 citations
- OLMo: Accelerating the Science of Language Models ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDirk Groeneveld et al.2024 · 429 citations
- Neural AMR: Sequence-to-Sequence Models for Parsing and GenerationIoannis Konstas, Srinivasan Iyer, Mark Yatskar, et al.Machine translation · 425 citations
- Supervised Open Information Extraction ↗Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · no summary yetGabriel Stanovsky et al.2018 · 390 citations
- Emerging Cross-lingual Structure in Pretrained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Alexis Conneau, Shijie Wu, Haoran Li, et al.2020 · 382 citations
- Scaling Semantic Parsers with On-the-Fly Ontology MatchingConference on Empirical Methods in Natural Language Processing (EMNLP)Tom Kwiatkowski, Eunsol Choi, Yoav Artzi, et al.2013 · 363 citations
- Learning to Parse Natural Language Commands to a Robot Control System ↗Springer tracts in advanced robotics · no summary yetCynthia Matuszek et al.2013 · 362 citations
- Inducing Probabilistic CCG Grammars from Logical Form with Higher-Order Unification ↗Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing · no summary yetTom Kwiatkowksi et al.2010 · 360 citations
- Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ↗Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetLuca Soldaini et al.2024 · 341 citations
- Reinforcement Learning for Mapping Instructions to Actions ↗Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP · no summary yetS.R.K. Branavan et al.2009 · 340 citations
- Question-Answer Driven Semantic Role Labeling: Using Natural Language to Annotate Natural LanguageLuheng He, Mike Lewis, Luke ZettlemoyerEnglish · 327 citations
- MetaICL: Learning to Learn In Context ↗arXiv:2110.15943 · no summary yetSewon Min et al.2021 · 315 citations
- Multi-hop Reading Comprehension through Question Decomposition and RescoringAnnual Meeting of the Association for Computational Linguistics (ACL)Sewon Min, Victor Zhong, Luke Zettlemoyer, et al.2019 · 312 citations
- Ultra-Fine Entity Typing ↗Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetEunsol Choi et al.2018 · 310 citations
- Situation Recognition: Visual Semantic Role Labeling for Image Understanding ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetMark Yatskar, Luke Zettlemoyer, Ali Farhadi2016 · 310 citations
- Muppet: Massive Multi-task Representations with Pre-FinetuningConference on Empirical Methods in Natural Language Processing (EMNLP)Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, et al.2021 · 307 citations
- Globally Coherent Text Generation with Neural Checklist ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Chloé Kiddon, Luke Zettlemoyer, Yejin Choi2016 · 304 citations
- InCoder: A Generative Model for Code Infilling and Synthesis ↗arXiv:2204.05999 · no summary yetDaniel Fried et al.2023 · 300 citations
- Cloze-driven Pretraining of Self-attention NetworksarXiv:1903.07785Alexei Baevski, Sergey Edunov, Yinhan Liu, et al.2019 · 286 citations
- Jointly Predicting Predicates and Arguments in Neural Semantic Role LabelingAnnual Meeting of the Association for Computational Linguistics (ACL)Luheng He, Kenton Lee, Omer Levy, et al.2018 · 285 citations
- Lexical Generalization in CCG Grammar Induction for Semantic ParsingConference on Empirical Methods in Natural Language Processing (EMNLP)Tom Kwiatkowski, Luke Zettlemoyer, Sharon Goldwater, et al.2011 · 285 citations
- Surface Form Competition: Why the Highest Probability Answer Isn't Always RightConference on Empirical Methods in Natural Language Processing (EMNLP)Ari Holtzman, Peter West, Vered Shwartz, et al.2021 · 277 citations
- Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What MattersAnnual Meeting of the Association for Computational Linguistics (ACL)Boshi Wang, Sewon Min, Xiang Deng, et al.2023 · 272 citations
- 2 OLMo 2 Furious ↗arXiv:2501.00656 · no summary yetTeam OLMo et al.2025 · 262 citations
- The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language VariantsAnnual Meeting of the Association for Computational Linguistics (ACL)Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.2023 · 262 citations
- A Joint Model of Language and Perception for Grounded Attribute Learning ↗arXiv (Cornell University) · no summary yetCynthia Matuszek et al.2012 · 261 citations
- Mapping Language to Code in Programmatic ContextConference on Empirical Methods in Natural Language Processing (EMNLP)Srinivasan Iyer, Ioannis Konstas, Alvin Cheung, et al.2018 · 260 citations
- Contrastive Decoding: Open-ended Text Generation as OptimizationarXiv:2210.15097Xiang Lisa Li, Ari Holtzman, Daniel Fried, et al.2022 · 253 citations
- Trusting Your Evidence: Hallucinate Less with Context-aware DecodingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Weijia Shi, Xiaochuang Han, Mike Lewis, et al.2024 · 249 citations
- Learning Context-Dependent Mappings from Sentences to Logical FormAnnual Meeting of the Association for Computational Linguistics (ACL)Luke Zettlemoyer, Michael Collins2009 · 246 citations
- In-context Examples Selection for Machine TranslationFindings of the Association for Computational LinguisticsSweta Agrawal, Chunting Zhou, Mike Lewis, et al.2023 · 243 citations
- Noisy Channel Language Model Prompting for Few-Shot Text ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Sewon Min, Mike Lewis, Hannaneh Hajishirzi, et al.2021 · 243 citations
- A Discrete Hard EM Approach for Weakly Supervised Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Sewon Min, Danqi Chen, Hannaneh Hajishirzi, et al.2019 · 237 citations
- Compositional Questions Do Not Necessitate Multi-hop ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Sewon Min, Eric Wallace, Sameer Singh, et al.2019 · 235 citations
- Detecting Hallucinated Content in Conditional Neural Sequence GenerationFindings of the Association for Computational LinguisticsChunting Zhou, Graham Neubig, Jiatao Gu, et al.2021 · 232 citations
- Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encodersAnnual Meeting of the Association for Computational Linguistics (ACL)Terra Blevins, Luke Zettlemoyer2020 · 232 citations
- Broad-coverage CCG Semantic Parsing with AMRConference on Empirical Methods in Natural Language Processing (EMNLP)Yoav Artzi, Kenton Lee, Luke Zettlemoyer2015 · 229 citations
- Detecting Pretraining Data from Large Language Models ↗arXiv:2310.16789 · no summary yetWeijia Shi et al.2023 · 224 citations
- Demystifying Prompts in Language Models via Perplexity EstimationarXiv:2212.04037Hila Gonen, Srini Iyer, Terra Blevins, et al.2022 · 213 citations
- Selective Annotation Makes Language Models Better Few-Shot Learners ↗arXiv:2209.01975 · no summary yetHongjin Su et al.2022 · 211 citations
- A Generative Model for Parsing Natural Language to Meaning RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP)Wei Lu, Hwee Tou Ng, Wee Sun Lee, et al.2008 · 210 citations
- Sparse Networks from Scratch: Faster Training without Losing Performance ↗arXiv (Cornell University) · no summary yetTim Dettmers, Luke Zettlemoyer2019 · 201 citations
- Improving Passage Retrieval with Zero-Shot Question GenerationConference on Empirical Methods in Natural Language Processing (EMNLP)Devendra Sachan, Mike Lewis, Mandar Joshi, et al.2022 · 199 citations
- DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation ↗arXiv:2211.11501 · no summary yetYuhang Lai et al.2022 · 199 citations
- Neural Metaphor Detection in ContextConference on Empirical Methods in Natural Language Processing (EMNLP)Ge Gao, Eunsol Choi, Yejin Choi, et al.2018 · 198 citations
- Vision-and-Dialog Navigation ↗arXiv:1907.04957 · no summary yetJesse Thomason et al.2019 · 196 citations
- One Embedder, Any Task: Instruction-Finetuned Text EmbeddingsarXiv:2212.09741Hongjin Su, Weijia Shi, Jungo Kasai, et al.2022 · 194 citations
- Nearest Neighbor Machine Translation ↗arXiv (Cornell University) · no summary yetUrvashi Khandelwal et al.2020 · 193 citations
- Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.2022 · 190 citations
- Bootstrapping Semantic Parsers from Conversations ↗Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing · no summary yetYoav Artzi, Luke Zettlemoyer2011 · 188 citations
- Pre-training via ParaphrasingarXiv:2006.15020Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.2020 · 187 citations
- Learning Symbolic Models of Stochastic Domains ↗Journal of Artificial Intelligence Research · no summary yetHanna Pasula, Luke Zettlemoyer, Leslie Pack Kaelbling2007 · 187 citations
- 8-bit Optimizers via Block-wise QuantizationarXiv:2110.02861Tim Dettmers, Mike Lewis, Sam Shleifer, et al.2021 · 181 citations
- Deep RNNs Encode Soft Hierarchical SyntaxAnnual Meeting of the Association for Computational Linguistics (ACL)Terra Blevins, Omer Levy, Luke Zettlemoyer2018 · 179 citations
- BASE Layers: Simplifying Training of Large, Sparse ModelsarXiv:2103.16716Mike Lewis, Shruti Bhosale, Tim Dettmers, et al.2021 · 177 citations
- Binding Language Models in Symbolic LanguagesarXiv:2210.02875Zhoujun Cheng, Tianbao Xie, Peng Shi, et al.2022 · 170 citations
- Transformers with convolutional context for ASR ↗arXiv (Cornell University) · no summary yetAbdelrahman Mohamed, Dmytro Okhonko, Luke Zettlemoyer2019 · 162 citations
- ROSCOE: A Suite of Metrics for Scoring Step-by-Step ReasoningarXiv:2212.07919Olga Golovneva, Moya Chen, Spencer Poff, et al.2022 · 155 citations
- ART: Automatic multi-step reasoning and tool-use for large language modelsarXiv:2303.09014Bhargavi Paranjape, Scott Lundberg, Sameer Singh, et al.2023 · 154 citations
- Multilingual Autoregressive Entity LinkingTransactions of the Association for Computational Linguistics (TACL)Nicola De Cao, Ledell Wu, Kashyap Popat, et al.2022 · 153 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/luke-zettlemoyer/works/