Ellie Pavlick — all works
- BERT Rediscovers the Classical NLP PipelineAnnual Meeting of the Association for Computational Linguistics (ACL)Ian Tenney, Dipanjan Das, Ellie Pavlick2019 · 2,028 citations
- Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language InferenceR. Thomas McCoy, Ellie Pavlick, Tal LinzenEnglish · 1,662 citations
- Optimizing Statistical Machine Translation for Text SimplificationWei Xu, Courtney Napoles, Ellie Pavlick, et al.Machine translation · 954 citations
- What do you learn from context? Probing for sentence structure in contextualized word representationsarXiv:1905.06316Ian Tenney, Patrick Xia, Berlin Chen, et al.2019 · 602 citations
- Inherent Disagreements in Human Textual InferencesEllie Pavlick, Tom KwiatkowskiEnglish · 454 citations
- PPDB 2.0: Better paraphrase ranking, fine-grained entailment relations, word embeddings, and style classificationEllie Pavlick, Pushpendre Rastogi, Juri Ganitkevitch, et al.Machine translation · 415 citations
- Do Prompt-Based Models Really Understand the Meaning of Their Prompts?Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Albert Webson, Ellie Pavlick2022 · 407 citations
- Measuring and Reducing Gendered Correlations in Pre-trained ModelsarXiv:2010.06032Kellie Webster, Xuezhi Wang, Ian Tenney, et al.2020 · 254 citations
- What Happens To BERT Embeddings During Fine-tuning?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLPAmil Merchant, Elahe Rahimtoroghi, Ellie Pavlick, et al.2020 · 220 citations
- An Empirical Analysis of Formality in Online CommunicationEllie Pavlick, Joel TetreaultMachine translation · 215 citations
- Collecting Diverse Natural Language Inference Problems for Sentence Representation EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Adam Poliak, Aparajita Haldar, Rachel Rudinger, et al.2018 · 193 citations
- Probing What Different NLP Tasks Teach Machines about Function Word ComprehensionJoint Conference on Lexical and Computational Semantics (*SEM)Najoung Kim, Roma Patel, Adam Poliak, et al.2019 · 163 citations
- Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetAlex Wang et al.2019 · 154 citations
- Simple PPDB: A Paraphrase Database for Simplification ↗Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetEllie Pavlick, Chris Callison-Burch2016 · 129 citations
- The Language Demographics of Amazon Mechanical Turk ↗Transactions of the Association for Computational Linguistics · no summary yetEllie Pavlick et al.2014 · 128 citations
- Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in ColorConference on Computational Natural Language Learning (CoNLL)Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich, et al.2021 · 122 citations
- Symbols and grounding in large language models ↗Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · no summary yetEllie Pavlick2022 · 114 citations
- Lessons from the Trenches on Reproducible Evaluation of Language Models ↗arXiv:2405.14782 · no summary yetStella Biderman et al.2024 · 99 citations
- Frequency Effects on Syntactic Rule Learning in TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Jason Wei, Dan Garrette, Tal Linzen, et al.2021 · 92 citations
- Adding Semantics to Data-Driven Paraphrasing ↗Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetEllie Pavlick et al.2015 · 81 citations
- WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetManaal Faruqui et al.2018 · 77 citations
- FrameNet+: Fast Paraphrastic Tripling of FrameNetAnnual Meeting of the Association for Computational Linguistics (ACL)Ellie Pavlick, Travis Wolfe, Pushpendre Rastogi, et al.2015 · 75 citations
- Interpretability and Analysis in Neural NLP ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts · no summary yetYonatan Belinkov, Sebastian Gehrmann, Ellie Pavlick2020 · 73 citations
- Linearly Mapping from Image to Text Space ↗arXiv (Cornell University) · no summary yetJack Merullo et al.2022 · 65 citations
- Most “babies” are “little” and most “problems” are “huge”: Compositional Entailment in Adjective-Nouns ↗Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetEllie Pavlick, Chris Callison-Burch2016 · 64 citations
- Inducing Lexical Style Properties for Paraphrase and Genre Differentiation ↗Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetEllie Pavlick, Ani Nenkova2015 · 64 citations
- Which Linguist Invented the Lightbulb? Presupposition Verification for Question-AnsweringNajoung Kim, Ellie Pavlick, Burcu Karagol Ayan, et al.English · 63 citations
- How well do NLI models capture verb veridicality?Alexis Ross, Ellie PavlickEnglish · 61 citations
- Characterizing Mechanisms for Factual Recall in Language Models ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetQinan Yu, Jack Merullo, Ellie Pavlick2023 · 59 citations
- The MultiBERTs: BERT Reproductions for Robustness Analysis ↗arXiv:2106.16163 · no summary yetThibault Sellam et al.2021 · 57 citations
- Language Models Implement Simple Word2Vec-style Vector Arithmetic ↗Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · no summary yetJack Merullo, Carsten Eickhoff, Ellie Pavlick2024 · 53 citations
- Circuit Component Reuse Across Tasks in Transformer Language Models ↗arXiv (Cornell University) · no summary yetJack Merullo, Carsten Eickhoff, Ellie Pavlick2023 · 48 citations
- The Gun Violence Database: A new task and data set for NLP ↗Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · no summary yetEllie Pavlick et al.2016 · 47 citations
- Robot Object Retrieval with Contextual Natural Language Queries ↗no summary yetThao Ngoc Nguyen et al.2020 · 45 citations
- Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics (ACL 2015) ↗The Association for Computational Linguistics · no summary yetEllie Pavlick et al.2015 · 42 citations
- Does Vision-and-Language Pretraining Improve Lexical Grounding? ↗Findings of the Association for Computational Linguistics: EMNLP 2021 · no summary yetTian Yun, Chen Sun, Ellie Pavlick2021 · 40 citations
- Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling. ↗no summary yetSamuel R. Bowman et al.2018 · 34 citations
- Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runs ↗arXiv:2303.08114 · no summary yetKelvin Guu et al.2023 · 33 citations
- Does CLIP Bind Concepts? Probing Compositionality in Large Image Models ↗Findings of the Association for Computational Linguistics: EACL 2024 · no summary yetMartha Lewis et al.2024 · 28 citations
- Break It Down: Evidence for Structural Compositionality in Neural Networks ↗neural information processing systems · no summary yetMichael A. Lepori, Thomas Serre, Ellie Pavlick2023 · 26 citations
- AND does not mean OR: Using Formal Languages to Study Language Models' Representations ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · no summary yetAaron Traylor, Roman Feiman, Ellie Pavlick2021 · 25 citations
- Grounding Language to Non-Markovian Tasks with No Supervision of Task Specifications ↗no summary yetRoma Patel, Ellie Pavlick, Stefanie Tellex2020 · 24 citations
- Are “Undocumented Workers” the Same as “Illegal Aliens”? Disentangling Denotation and Connotation in Vector Spaces ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetAlbert Webson et al.2020 · 23 citations
- Unit Testing for Concepts in Neural Networks ↗Transactions of the Association for Computational Linguistics · no summary yetCharles Lovering, Ellie Pavlick2022 · 22 citations
- Are Language Models Worse than Humans at Following Prompts? It's Complicated ↗Findings of the Association for Computational Linguistics: EMNLP 2023 · no summary yetAlbert Webson et al.2023 · 21 citations
- Does Data Augmentation Improve Generalization in NLP? ↗arXiv (Cornell University) · no summary yetRohan Jha, Charles Lovering, Ellie Pavlick2020 · 21 citations
- Learning Scalar Adjective Intensity from ParaphrasesAnne Cocos, Skyler Wharton, Ellie Pavlick, et al.English · 21 citations
- Are Two Heads Better than One? Crowdsourced Translation via a Two-Step Collaboration of Non-Professional Translators and Editors ↗Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetRui Yan et al.2014 · 21 citations
- Parallel trade-offs in human cognition and neural networks: The dynamic interplay between in-context and in-weight learning ↗Proceedings of the National Academy of Sciences · no summary yetJacob Russin, Ellie Pavlick, Michael J. Frank2025 · 20 citations
- “Was it “stated” or was it “claimed”?: How linguistic bias affects generative language models ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetRoma Patel, Ellie Pavlick2021 · 20 citations
- Grounding Language to Landmarks in Arbitrary Outdoor Environments ↗Proceedings - IEEE International Conference on Robotics and Automation/Proceedings · no summary yetMatthew Berg et al.2020 · 20 citations
- Planning with State Abstractions for Non-Markovian Task Specifications ↗arXiv:1905.12096 · no summary yetYoonseon Oh et al.2019 · 19 citations
- So-Called Non-Subsective Adjectives ↗Proceedings of the Fifth Joint Conference on Lexical and Computational Semantics · no summary yetEllie Pavlick, Chris Callison-Burch2016 · 19 citations
- LLMs as models for analogical reasoning ↗Journal of Memory and Language · no summary yetSam Musker et al.2025 · 18 citations
- Are Rotten Apples Edible? Challenging Commonsense Inference Ability with Exceptions ↗Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yetNam Do, Ellie Pavlick2021 · 16 citations
- Tense Manages to Predict Implicative Behavior in Verbs ↗Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · no summary yetEllie Pavlick, Chris Callison-Burch2016 · 16 citations
- Domain-Specific Paraphrase Extraction ↗Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · no summary yetEllie Pavlick et al.2015 · 16 citations
- Effectively Crowdsourcing Radiology Report Annotations ↗Proceedings of the Sixth International Workshop on Health Text Mining and Information Analysis · no summary yetAnne Cocos et al.2015 · 15 citations
- The promise and pitfalls of generative AI ↗Nature Reviews Psychology · no summary yetMonojit Choudhury et al.2025 · 14 citations
- The Same But Different: Structural Similarities and Differences in Multilingual Language Modeling ↗arXiv (Cornell University) · no summary yetRuochen Zhang et al.2024 · 14 citations
- Spatial Language Understanding for Object Search in Partially Observed City-scale Environments ↗arXiv:2012.02705 · no summary yetKaiyu Zheng et al.2021 · 13 citations
- Re-Evaluating Evaluation for Multilingual Summarization ↗Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · no summary yetJessica Zosa Forde et al.2024 · 12 citations
- mOthello: When Do Cross-Lingual Representation Alignment and Cross-Lingual Transfer Emerge in Multilingual Models? ↗Findings of the Association for Computational Linguistics: NAACL 2024 · no summary yetTianze Hua, Tian Yun, Ellie Pavlick2024 · 12 citations
- Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in Hex ↗neural information processing systems · no summary yetCharles Lovering et al.2022 · 10 citations
- SNAP judgments into the digital age: Reporting on food stamps varies significantly with time, publication type, and political leaning ↗PLoS ONE · no summary yetBenjamin W. Chrisinger et al.2020 · 10 citations
- Crowdsourcing for NLP ↗Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Tutorial Abstracts · no summary yetChris Callison-Burch, Lyle Ungar, Ellie Pavlick2015 · 10 citations
- Paths Not Taken: Understanding and Mending the Multilingual Factual Recall PipelineConference on Empirical Methods in Natural Language Processing (EMNLP)Meng Lu, Ruochen Zhang, Carsten Eickhoff, et al.2025 · 9 citations
- Talking Heads: Understanding Inter-Layer Communication in Transformer Language Models ↗neural information processing systems · no summary yetJack Merullo, Carsten Eickhoff, Ellie Pavlick2024 · 9 citations
- Bayesian Preference Elicitation with Language Models ↗arXiv:2403.05534 · no summary yetKunal Handa et al.2024 · 8 citations
- Affordance-based robot object retrieval ↗Autonomous Robots · no summary yetThao Ngoc Nguyen et al.2021 · 8 citations
- Crowdsourcing for grammatical error correction ↗no summary yetEllie Pavlick, Rui Yan, Chris Callison-Burch2014 · 8 citations
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources ↗arXiv:2410.23261 · no summary yetApoorv Khandelwal et al.2024 · 7 citations
- Do Vision-Language Pretrained Models Learn Composable Primitive Concepts? ↗arXiv (Cornell University) · no summary yetTian Yun et al.2022 · 7 citations
- When does data augmentation help generalization in NLP ↗no summary yetRohan Jha, Charles Lovering, Ellie Pavlick2020 · 7 citations
- How Do Vision-Language Models Process Conflicting Information Across Modalities? ↗arXiv (Cornell University) · no summary yetTianze Hua, Yun, Tian, Ellie Pavlick2025 · 6 citations
- From prediction to understanding: Will AI foundation models transform brain science? ↗Neuron · no summary yetThomas Serre, Ellie Pavlick2025 · 6 citations
- NeuroSurgeon: A Toolkit for Subnetwork Analysis ↗arXiv (Cornell University) · no summary yetMichael A. Lepori, Ellie Pavlick, Serre, Thomas2023 · 6 citations
- Identifying 1950s American Jazz Musicians: Fine-Grained IsA Extraction via Modifier Composition ↗Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetEllie Pavlick, Marius Paşca2017 · 6 citations
- Evaluation of an Artificial Intelligence Conversational Chatbot to Enhance HIV Preexposure Prophylaxis Uptake: Development and Usability Internal Testing ↗Journal of Medical Internet Research · no summary yetJun Tao et al.2025 · 5 citations
- Uncovering Intermediate Variables in Transformers using Circuit Probing ↗arXiv (Cornell University) · no summary yetMichael A. Lepori, Serre, Thomas, Ellie Pavlick2023 · 5 citations
- Emergence of Abstract State Representations in Embodied Sequence Modeling ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetTian Yun et al.2023 · 5 citations
- Do Trajectories Encode Verb Meaning? ↗Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetDylan Ebert, Chen Sun, Ellie Pavlick2022 · 5 citations
- Pretraining on Interactions for Learning Grounded Affordance Representations ↗Proceedings of the 11th Joint Conference on Lexical and Computational Semantics · no summary yetJack Merullo et al.2022 · 5 citations
- A Knapsack by Any Other Name: Presentation impacts LLM performance on NP-hard problems ↗Findings of the Association for Computational Linguistics: EMNLP 2025 · no summary yetAlex Duchnowski, Ellie Pavlick, Alexander Koller2025 · 4 citations
- How Do Language Models Compose Functions? ↗arXiv (Cornell University) · no summary yetApoorv Khandelwal, Ellie Pavlick2025 · 4 citations
- Does Training on Synthetic Data Make Models Less Robust? ↗The Sixth Workshop on Insights from Negative Results in NLP · no summary yetLingze Zhang, Ellie Pavlick2025 · 4 citations
- Is human compositionality meta-learned? ↗Behavioral and Brain Sciences · no summary yetJacob Russin et al.2024 · 4 citations
- Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting ↗arXiv (Cornell University) · no summary yetAnand, Suraj et al.2024 · 4 citations
- Analyzing Modular Approaches for Visual Question Decomposition ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetApoorv Khandelwal, Ellie Pavlick, Chen Sun2023 · 4 citations
- Training Priors Predict Text-To-Image Model Performance ↗arXiv (Cornell University) · no summary yetCharles Lovering, Ellie Pavlick2023 · 4 citations
- A Visuospatial Dataset for Naturalistic Verb Learning ↗Proceedings of the Ninth Joint Conference on Lexical and Computational Semantics · no summary yetDylan Ebert, Ellie Pavlick2020 · 4 citations
- Transferring Linear Features Across Language Models With Model Stitching ↗neural information processing systems · no summary yetAlan Chen et al.2025 · 3 citations
- LLMs model how humans induce logically structured rules ↗Journal of Memory and Language · no summary yetAlyssa Marie Loo, Ellie Pavlick, Roman Feiman2025 · 3 citations
- Are LLMs Models of Distributional Semantics? A Case Study on Quantifiers ↗arXiv (Cornell University) · no summary yetZhang Enyan et al.2024 · 3 citations
- Testing Causal Models of Word Meaning in GPT-3 and -4 ↗arXiv (Cornell University) · no summary yetSam Musker, Ellie Pavlick2023 · 3 citations
- Instilling Inductive Biases with Subnetworks ↗arXiv (Cornell University) · no summary yetEnyan Zhang, Michael A. Lepori, Ellie Pavlick2023 · 3 citations
- Whither symbols in the era of advanced neural networks? ↗Trends in Cognitive Sciences · no summary yetThomas L. Griffiths et al.2026 · 2 citations
- Comparing Trajectory and Vision Modalities for Verb Representation ↗arXiv (Cornell University) · no summary yetDylan Ebert, Chen Sun, Ellie Pavlick2023 · 2 citations
- Deep neural networks can learn generalizable same-different visual relations ↗arXiv:2310.09612 · no summary yetAlexa R. Tartaglini et al.2023 · 2 citations
- Using Grounded Word Representations to Study Theories of Lexical Concepts ↗Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics · no summary yetDylan Ebert, Ellie Pavlick2019 · 2 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/ellie-pavlick/works/