Papers of 2021 — page 3263 papers · all years1 2 3Show your work: Scratchpads for intermediate computation with language modelsResearch librarySimCLS: A Simple Framework for Contrastive Learning of Abstractive SummarizationYixin Liu, Pengfei LiuProceedings of the 59th Annual Meeting of the…SimCSE: Simple Contrastive Learning of Sentence EmbeddingsTianyu Gao, Xingcheng Yao, Danqi ChenarXiv:2104.08821SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionZirui Wang, Jiahui Yu, Adams Wei Yu, et al.arXiv:2108.10904Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced LanguagesKelechi Ogueji, Yuxin Zhu, Jimmy LinProceedings of the 1st Workshop on Multilingual…Societal Biases in Language Generation: Progress and ChallengesEmily Sheng, Kai-Wei Chang, Prem Natarajan, et al.Proceedings of the 59th Annual Meeting of the…SoundStream: An End-to-End Neural Audio CodecNeil Zeghidour, Alejandro Luebs, Ahmed Omran, et al.arXiv:2107.03312Sparse, Dense, and Attentional Representations for Text RetrievalYi Luan, Jacob Eisenstein, Kristina Toutanova, et al.Transactions of the Association for…SPARTQA: A Textual Question Answering Benchmark for Spatial ReasoningRoshanak Mirzaee, Hossein Rajaby Faghihi, Qiang Ning, et al.Mova's core listSpeaker Turn Modeling for Dialogue Act ClassificationZihao He, Leili Tavabi, Kristina Lerman, et al.EnglishSPLADE: Sparse Lexical and Expansion Model for First Stage RankingThibault Formal, Benjamin Piwowarski, Stéphane ClinchantSIGIR 2021Stages rather than ages in the acquisition of movement structures: Data from sentence repetition and 27696 spontaneous clausesNaama Friedmann, Julia ReznickModern HebrewStereoSet: Measuring stereotypical bias in pretrained language modelsMoin Nadeem, Anna Bethke, Siva ReddyProceedings of the 59th Annual Meeting of the…Structured Denoising Diffusion Models in Discrete State-SpacesJacob Austin, Daniel D. Johnson, Jonathan Ho, et al.arXiv:2107.03006Studies in the Grammar and Lexicon of Neo-AramaicGeoffrey Khan, Paul M. NoorlanderAramaicSuperbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex WordsValentin, HofmannEnglishSurface Form Competition: Why the Highest Probability Answer Isn't Always RightAri Holtzman, Peter West, Vered Shwartz, et al.Proceedings of the 2021 Conference on Empirical…Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, et al.arXiv:2103.14030Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction BenchmarkJoel Niklaus, Ilias Chalkidis, Matthias StürmerProceedings of the Natural Legal Language…TAPEX: Table Pre-training via Learning a Neural SQL ExecutorQian Liu, Bei Chen, Jiaqi Guo, et al.arXiv:2107.07653TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in FinanceFengbin Zhu, Wenqiang Lei, Youcheng Huang, et al.Proceedings of the 59th Annual Meeting of the…Tell Me Everything You Know: A Conversation Update System for the Rational Speech Acts FrameworkCarolyn Jane AndersonEnglishTellMeWhy: A Dataset for Answering Why-Questions in NarrativesYash Kumar Lal, Nathanael Chambers, Raymond Mooney, et al.EnglishText Generation from Discourse Representation StructuresJiangming Liu, Shay B. Cohen, Mirella LapataMachine translationText2Event: Controllable Sequence-to-Structure Generation for End-to-end Event ExtractionYaojie Lu, Hongyu Lin, Jin Xu, et al.Proceedings of the 59th Annual Meeting of the…The (Un)Suitability of Automatic Evaluation Metrics for Text SimplificationFernando Alva-Manchego, Carolina Scarton, Lucia SpeciaComputational LinguisticsThe CODI-CRAC 2021 Shared Task on Anaphora, Bridging, and Discourse Deixis in DialogueSopan Khosla, Juntao Yu, Ramesh Manuvinakurike, et al.EnglishThe Curious Case of Hallucinations in Neural Machine TranslationVikas Raunak, Arul Menezes, Marcin Junczys-DowmuntProceedings of the 2021 Conference of the North…The Importance of Modeling Social Factors of Language: Theory and PracticeDirk Hovy, Diyi YangProceedings of the 2021 Conference of the North…The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language ModelsGo Inoue, Bashar Alhafni, Nurpeiis Baimukan, et al.arXiv:2103.06678The Lean 4 Theorem Prover and Programming Language (System Description)Leonardo de Moura, Sebastian UllrichCADE-28 (LNCS 12699), SpringerThe Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language ProcessingValentina Pyatkin, Shoval Sadde, Aynat Rubinstein, et al.EnglishThematic role assignment in non-default verb classes: A cross-linguistic comparison of English and GermanLouise Kyriaki, Matthias Schlesewsky, Ina Bornkessel-SchlesewskyEnglishToward a Perspectivist Turn in Ground Truthing for Predictive ComputingValerio Basile, Federico Cabitza, Andrea Campagner, et al.arXiv:2109.04270 · Proceedings of the AAAI…Towards a Decomposable Metric for Explainable Evaluation of Text Generation from AMRJuri Opitz, Anette FrankMachine translationTowards a prosodic model for Tiberian Hebrew: An intonation-based analysisSophia L. PitcherAncient HebrewTowards a Unified View of Parameter-Efficient Transfer LearningJunxian He, Chunting Zhou, Xuezhe Ma, et al.arXiv:2110.04366Towards Emotional Support Dialog SystemsSiyang Liu, Chujie Zheng, Orianna Demasi, et al.Proceedings of the 59th Annual Meeting of the…Towards Understanding and Mitigating Social Biases in Language ModelsPaul Pu Liang, Chiyu Wu, Louis-Philippe Morency, et al.arXiv:2106.13219Training Verifiers to Solve Math Word ProblemsKarl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.arXiv:2110.14168Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language ProcessingMinh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, et al.EnglishTransition-based Bubble Parsing: Improvements on Coordination Structure PredictionTianze Shi, Lillian LeeEnglishTrue Few-Shot Learning with Language ModelsEthan Perez, Douwe Kiela, Kyunghyun ChoarXiv:2105.11447Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsArtidoro Pagnoni, Vidhisha Balachandran, Yulia TsvetkovProceedings of the 2021 Conference of the North…Unified Pre-training for Program Understanding and GenerationWasi Ahmad, Saikat Chakraborty, Baishakhi Ray, et al.Proceedings of the 2021 Conference of the North…Universal DependenciesMarie-Catherine de Marneffe, Christopher D. Manning, Joakim Nivre, et al.Mova's core listUnsupervised Dense Information Retrieval with Contrastive LearningGautier Izacard, Mathilde Caron, Lucas Hosseini, et al.arXiv:2112.09118Validation of Universal Dependencies by regenerationGuy LapalmeEnglishViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionWonjae Kim, Bokyung Son, Ildoo KimarXiv:2102.03334VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and InterpretationChanghan Wang, Morgane Riviere, Ann Lee, et al.Proceedings of the 59th Annual Meeting of the…Want To Reduce Labeling Cost? GPT-3 Can HelpShuohang Wang, Yang Liu, Yichong Xu, et al.Findings of the Association for Computational…We Need to Consider Disagreement in EvaluationValerio Basile, Michael Fell, Tommaso Fornaciari, et al.Proceedings of the 1st Workshop on…WebGPT: Browser-assisted question-answering with human feedbackReiichiro Nakano, Jacob Hilton, Suchir Balaji, et al.arXiv:2112.09332Weisfeiler-Leman in the Bamboo: Novel AMR Graph Metrics and a Benchmark for AMR Graph SimilarityJuri Opitz, Angel Daza, Anette FrankMachine translationWhen Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language ModelsBenjamin Muller, Antonios Anastasopoulos, Benoît Sagot, et al.Proceedings of the 2021 Conference of the North…Which Linguist Invented the Lightbulb? Presupposition Verification for Question-AnsweringNajoung Kim, Ellie Pavlick, Burcu Karagol Ayan, et al.EnglishWhit's the Richt Pairt o Speech: PoS tagging for ScotsHarm Lameris, Sara StymneEnglishWord Sense Induction with Attentive Context ClusteringMoshe Stekel, Amos Azaria, Shai GordinAncient HebrewWord-Level Coreference ResolutionVladimir DobrovolskiiProceedings of the 2021 Conference on Empirical…XLS-R: Self-supervised Cross-lingual Speech Representation Learning at ScaleArun Babu, Changhan Wang, Andros Tjandra, et al.arXiv:2111.09296XTREME-R: Towards More Challenging and Nuanced Multilingual EvaluationSebastian Ruder, Noah Constant, Jan Botha, et al.Proceedings of the 2021 Conference on Empirical…ZeRO-Offload: Democratizing Billion-Scale Model TrainingJie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.arXiv:2101.06840Zero-Shot Text-to-Image GenerationAditya Ramesh, Mikhail Pavlov, Gabriel Goh, et al.arXiv:2102.120921 2 3