Noah A. Smith · page 3
Papers
- Is GPT-3 Text Indistinguishable from Human Text? Scarecrow: A Framework for Scrutinizing Machine Text (2022 · 152 citations)
Recent work suggested that ordinary crowd workers can no longer reliably tell GPT-3 output from human writing. - Generation from Abstract Meaning Representation using Tree Transducers (2016 · 152 citations)
The paper generates English from AMR graphs in two steps. A breadth-first spanning tree is taken from the graph, and a weighted tree-to-string transducer turns that tree into a sentence. The transducer rules are extracted from AMR-aligned sentences: each aligned subgraph becomes a rule with argument slots for its… - In-Context Learning for Few-Shot Dialogue State Tracking (2022 · 144 citations)
Annotating task-oriented dialogues at the turn level is slow and expensive, and fine-tuned dialogue state tracking (DST) models must be retrained whenever a schema gains new slots or domains. - Dynamic Entity Representations in Neural Language Models (2017 · 144 citations)
Most neural language models do not represent entities beyond the words used to mention them, so they cannot follow who or what a long text is about. - NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics (2022 · 140 citations)
Left-to-right decoders such as beam search and top-k sampling pick each token based only on the prefix generated so far. - Inoculation by Fine-Tuning: A Method for Analyzing Challenge Datasets (2019 · 138 citations)
Challenge (adversarial) datasets often cause sharp drops in model accuracy. A drop alone does not show whether the model architecture is limited or whether the original training data simply lacked certain patterns. Liu, Schwartz and Smith address this with "inoculation by fine-tuning." A model trained on the standard… - Deep Encoder, Shallow Decoder: Reevaluating Non-autoregressive Machine Translation (2020 · 134 citations)
Non-autoregressive translation (NAR) is often presented as a faster alternative to standard autoregressive (AR) Transformers, with only a small loss in quality. - Parsing Tweets into Universal Dependencies (2018 · 121 citations)
The authors extend the UD guidelines to tweets: emoticons and retweet markers become non-syntactic or discourse tokens, abbreviations such as "idc" stay unnormalized as single words, multiword expressions can be merged, and tweets can have several roots. - Comprehensive Annotation of Multiword Expressions in a Social Web Corpus (2014 · 120 citations)
The authors annotate every multiword expression (MWE) in a web corpus of about 55,000 words, sentence by sentence, without limiting the kinds of MWE. - A Corpus and Model Integrating Multiword Expressions and Supersenses (2015 · 111 citations)
The paper defines one task: find lexical expressions in running text, single- or multi-word, and label the noun and verb ones with a supersense (41 coarse classes). - We're Afraid Language Models Aren't Modeling Ambiguity (2023 · 110 citations)
The paper asks whether pretrained language models can notice when a sentence has more than one plausible meaning and separate those meanings. - A Latent Variable Model for Geographic Lexical Variation (2010 · 110 citations)
Studies of dialect and sociolinguistic variation usually start from a small set of variables that researchers choose by hand. - Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank (2020 · 104 citations)
Multilingual models such as mBERT serve low-resource language varieties unevenly. Varieties that are barely present in, or absent from, the pretraining data have too little labeled and unlabeled text to train a strong monolingual model. Chau, Lin, and Smith test whether mBERT can be adapted cheaply using only a small… - Time Waits for No One! Analysis and Challenges of Temporal Misalignment (2022 · 102 citations)
The paper examines temporal misalignment, the situation in which the text used to train an NLP model and the text it is evaluated or deployed on come from different periods. - Learning Latent Personas of Film Characters (2013 · 101 citations)
The authors propose viewing narrative through its characters rather than only as a sequence of events. Their goal is to automatically discover the typical roles (personas) of film characters, that is, archetypes and stereotypes such as the villain or the protagonist's love interest. To this end, they assembled a new… - Turning on the Turbo: Fast Third-Order Non-Projective Turbo Parsers (2013 · 97 citations)
Non-projective graph parsing with third-order features (grand- and tri-siblings, head bigrams) is NP-hard, so the paper uses AD3, an accelerated dual decomposition algorithm, and extends it with specialised head automata that solve the large subproblems exactly. - Probing Across Time: What Does RoBERTa Know and When? (2021 · 96 citations)
The paper asks when, during pretraining, a masked language model acquires different kinds of knowledge, rather than only what a finished model knows. - Provable Limitations of Acquiring Meaning from Ungrounded Form: What Will Future Language Models Understand? (2021 · 89 citations)
Can a system trained only on raw text, with no grounding, ever acquire meaning? Merrill, Goldberg, Schwartz and Smith turn the informal debate started by Bender and Koller (2020) into a precise mathematical question. - Frame-Semantic Role Labeling with Heterogeneous Annotations (2015 · 88 citations)
The paper addresses argument identification in frame-semantic parsing: given a predicate and the FrameNet frame it evokes, the system must find the phrases that fill the frame's roles and label them. - Probabilistic Frame-Semantic Parsing (2010 · 87 citations)
The paper treats frame-semantic parsing as a structured prediction task. Given an English sentence, the system must find the words that evoke FrameNet frames, choose the correct frame for each, and mark the text spans that fill that frame's roles. The authors replace the many-classifier SVM pipeline of the strongest… - Tree Edit Models for Recognizing Textual Entailments, Paraphrases, and Answers to Questions (2010 · 87 citations)
The paper models a pair of sentences as a sequence of tree edits between their dependency trees. Edits are insert, delete and relabel operations plus three that handle reordering: move a subtree, make a new root, and move a sibling. The sequence is found by greedy best-first search, using a normalised partial tree… - Turbo Parsers: Dependency Parsing by Approximate Variational Inference (2010 · 69 citations)
Rich non-projective dependency parsers that score sibling and grandparent arcs make exact inference intractable, so they need approximate decoding. - Unsupervised Structure Prediction with Non-Parallel Multilingual Guidance (2011 · 62 citations)
The paper tackles building a part-of-speech tagger and a dependency parser for a language that has only raw, unannotated text. - In-context Pretraining: Language Modeling Beyond Document Boundaries (2023 · 61 citations)
Standard LM pretraining packs randomly chosen documents into each context window. Earlier documents therefore tell the model nothing about later ones, so the model gets no practice using information across document boundaries. The authors (Meta AI, University of Washington, AI2) propose In-Context Pretraining. It… - The Art of Saying No: Contextual Noncompliance in Language Models (2024 · 56 citations)
Most research on language model refusal treats it as a safety issue. This paper argues that chat models should also decline or qualify many requests that are not harmful. The authors propose a taxonomy of contextual noncompliance with five broad categories: incomplete, indeterminate, unsupported, humanizing and…
This page in Markdown → https://md.research.elamur.ai/free/en/authors/noah-a-smith/page/3/