📰 NAACL 2021 — accepted papers

NAACL 2021 is the 2021 edition of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL), held in Online, June 2021 (publisher: Association for Computational Linguistics). The ACL Anthology lists 560 papers of it in 5 tracks; our library holds 74 with our summaries. Below: its awards, the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

Tracks

Main477Industry Papers39Student Research Workshop21Demonstrations17Tutorials6

Awards

As the ACL Anthology records them.

1. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze · 🏆 Outstanding Long Paper685 citations · our summary
2. Learning How to Ask: Querying LMs with Mixtures of Soft PromptsGuanghui Qin, Jason Eisner · 🏆 Best Short Paper328 citations · our summary
3. How many data points is a prompt worth?Teven Le Scao, Alexander Rush · 🏆 Outstanding Short Paper179 citations · our summary
4. COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report GenerationQingyun Wang, Manling Li, Xuan Wang et al. · Demonstrations · 🏆 Best Demo Paper121 citations
5. Unifying Cross-Lingual Semantic Role Labeling with Heterogeneous Linguistic ResourcesSimone Conia, Andrea Bacciu, Roberto Navigli · 🏆 Outstanding Long Paper25 citations
6. Video-aided Unsupervised Grammar InductionSongyang Zhang, Linfeng Song, Lifeng Jin et al. · 🏆 Best Long Paper21 citations
7. Preregistering NLP researchEmiel van Miltenburg, Chris van der Lee, Emiel Krahmer · 🏆 Best Thematic Paper20 citations
8. Query2Prod2Vec: Grounded Word Embeddings for eCommerceFederico Bianchi, Jacopo Tagliabue, Bingqing Yu · Industry Papers · 🏆 Best Industry Paper10 citations

Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLinting Xue, Noah Constant, Adam Roberts et al.1,621 citations · our summary
2. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze · 🏆 Outstanding Long Paper685 citations · our summary
3. Unified Pre-training for Program Understanding and GenerationWasi Ahmad, Saikat Chakraborty, Baishakhi Ray et al.608 citations · our summary
4. QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question AnsweringMichihiro Yasunaga, Hongyu Ren, Antoine Bosselut et al.522 citations
5. A Frustratingly Easy Approach for Entity and Relation ExtractionZexuan Zhong, Danqi Chen477 citations · our summary
6. RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question AnsweringYingqi Qu, Yuchen Ding, Jing Liu et al.356 citations · our summary
7. KILT: a Benchmark for Knowledge Intensive Language TasksFabio Petroni, Aleksandra Piktus, Angela Fan et al.339 citations · our summary
8. Self-Alignment Pretraining for Biomedical Entity RepresentationsFangyu Liu, Ehsan Shareghi, Zaiqiao Meng et al.335 citations · our summary
9. Learning How to Ask: Querying LMs with Mixtures of Soft PromptsGuanghui Qin, Jason Eisner · 🏆 Best Short Paper328 citations · our summary
10. Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal290 citations · our summary

All accepted papers (560)

The most cited first; 74 with our summary link to their page here, the others to the original.

1. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLinting Xue, Noah Constant, Adam Roberts et al.1,621 citations · our summary
2. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze · 🏆 Outstanding Long Paper685 citations · our summary
3. Unified Pre-training for Program Understanding and GenerationWasi Ahmad, Saikat Chakraborty, Baishakhi Ray et al.608 citations · our summary
4. QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question AnsweringMichihiro Yasunaga, Hongyu Ren, Antoine Bosselut et al.522 citations
5. A Frustratingly Easy Approach for Entity and Relation ExtractionZexuan Zhong, Danqi Chen477 citations · our summary
6. RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question AnsweringYingqi Qu, Yuchen Ding, Jing Liu et al.356 citations · our summary
7. KILT: a Benchmark for Knowledge Intensive Language TasksFabio Petroni, Aleksandra Piktus, Angela Fan et al.339 citations · our summary
8. Self-Alignment Pretraining for Biomedical Entity RepresentationsFangyu Liu, Ehsan Shareghi, Zaiqiao Meng et al.335 citations · our summary
9. Learning How to Ask: Querying LMs with Mixtures of Soft PromptsGuanghui Qin, Jason Eisner · 🏆 Best Short Paper328 citations · our summary
10. Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal290 citations · our summary
11. A Survey on Recent Approaches for Natural Language Processing in Low-Resource ScenariosMichael A. Hedderich, Lukas Lange, Heike Adel et al.260 citations · our summary
12. Factual Probing Is [MASK]: Learning vs. Learning to RecallZexuan Zhong, Dan Friedman, Danqi Chen260 citations · our summary
13. Document-Level Event Argument Extraction by Conditional GenerationSha Li, Heng Ji, Jiawei Han254 citations · our summary
14. InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-TrainingZewen Chi, Li Dong, Furu Wei et al.249 citations
15. Dynabench: Rethinking Benchmarking in NLPDouwe Kiela, Max Bartolo, Yixin Nie et al.229 citations
16. GSum: A General Framework for Guided Neural Abstractive SummarizationZi-Yi Dou, Pengfei Liu, Hiroaki Hayashi et al.200 citations · our summary
17. Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsArtidoro Pagnoni, Vidhisha Balachandran, Yulia Tsvetkov190 citations · our summary
18. Aspect-based Sentiment Analysis with Type-aware Graph Convolutional Networks and Layer EnsembleYuanhe Tian, Guimin Chen, Yan Song187 citations
19. COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted ListLuyu Gao, Zhuyun Dai, Jamie Callan186 citations · our summary
20. Supporting Clustering with Contrastive LearningDejiao Zhang, Feng Nan, Xiaokai Wei et al.185 citations · our summary
21. How many data points is a prompt worth?Teven Le Scao, Alexander Rush · 🏆 Outstanding Short Paper179 citations · our summary
22. Contextualized Perturbation for Textual Adversarial AttackDianqi Li, Yizhe Zhang, Hao Peng et al.178 citations · our summary
23. Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring TasksNandan Thakur, Nils Reimers, Johannes Daxenberger et al.176 citations · our summary
24. QMSum: A New Benchmark for Query-based Multi-domain Meeting SummarizationMing Zhong, Da Yin, Tao Yu et al.174 citations · our summary
25. Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTaJunqi Dai, Hang Yan, Tianxiang Sun et al.163 citations

See all 560 papers in NAACL 2021 — accepted papers →

📄 Papers with our summary in our library (74)

The most cited first (OpenAlex citations plus our library's).

1. mT5: A Massively Multilingual Pre-trained Text-to-Text TransformerLinting Xue, Noah Constant, Adam Roberts, et al.2021 · 3,197 citations
2. It's Not Just Size That Matters: Small Language Models Are Also Few-Shot LearnersTimo Schick, Hinrich Schütze2021 · 1,122 citations
3. Are NLP Models really able to Solve Simple Math Word Problems?Arkil Patel, Satwik Bhattamishra, Navin Goyal2021 · 883 citations
4. Unified Pre-training for Program Understanding and GenerationWasi Ahmad, Saikat Chakraborty, Baishakhi Ray, et al.2021 · 748 citations
5. Learning To Retrieve Prompts for In-Context LearningOhad Rubin, Jonathan Herzig, Jonathan Berant2021 · 717 citations
6. RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question AnsweringYingqi Qu, Yuchen Ding, Jing Liu, et al.2021 · 602 citations
7. Learning How to Ask: Querying LMs with Mixtures of Soft PromptsGuanghui Qin, Jason Eisner2021 · 568 citations
8. Self-Alignment Pretraining for Biomedical Entity RepresentationsFangyu Liu, Ehsan Shareghi, Zaiqiao Meng, et al.2021 · 434 citations
9. Document-Level Event Argument Extraction by Conditional GenerationSha Li, Heng Ji, Jiawei Han2021 · 432 citations
10. Understanding Factuality in Abstractive Summarization with FRANK: A Benchmark for Factuality MetricsArtidoro Pagnoni, Vidhisha Balachandran, Yulia Tsvetkov2021 · 418 citations
11. Factual Probing Is [MASK]: Learning vs. Learning to RecallZexuan Zhong, Dan Friedman, Danqi Chen2021 · 411 citations
12. A Survey on Recent Approaches for Natural Language Processing in Low-Resource ScenariosMichael A. Hedderich, Lukas Lange, Heike Adel, et al.2021 · 400 citations
13. QMSum: A New Benchmark for Query-based Multi-domain Meeting SummarizationMing Zhong, Da Yin, Tao Yu, et al.2021 · 400 citations
14. A Dataset of Information-Seeking Questions and Answers Anchored in Research PapersPradeep Dasigi, Kyle Lo, Iz Beltagy, et al.2021 · 374 citations
15. Efficient Attentions for Long Document SummarizationLuyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 335 citations
16. GSum: A General Framework for Guided Neural Abstractive SummarizationZi-Yi Dou, Pengfei Liu, Hiroaki Hayashi, et al.2021 · 319 citations
17. How many data points is a prompt worth?Teven Le Scao, Alexander Rush2021 · 316 citations
18. Get Your Vitamin C! Robust Fact Verification with Contrastive EvidenceTal Schuster, Adam Fisch, Regina Barzilay2021 · 289 citations
19. Contextualized Perturbation for Textual Adversarial AttackDianqi Li, Yizhe Zhang, Hao Peng, et al.2021 · 282 citations
20. Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring TasksNandan Thakur, Nils Reimers, Johannes Daxenberger, et al.2021 · 276 citations
21. COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted ListLuyu Gao, Zhuyun Dai, Jamie Callan2021 · 250 citations
22. The Curious Case of Hallucinations in Neural Machine TranslationVikas Raunak, Arul Menezes, Marcin Junczys-Dowmunt2021 · 241 citations
23. Supporting Clustering with Contrastive LearningDejiao Zhang, Feng Nan, Xiaokai Wei, et al.2021 · 239 citations
24. Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-trainingOshin Agarwal, Heming Ge, Siamak Shakeri, et al.2021 · 238 citations
25. FUDGE: Controlled Text Generation With Future DiscriminatorsKevin Yang, Dan Klein2021 · 235 citations

See all 74 works in NAACL 2021 — accepted papers →

🧭 Top topics

Topics of its works in our library, with the number of works on each.

🧠Language models & pretraining (12)📝Summarization (9)🔗Coreference resolution (7)❓Question answering (6)😊Sentiment & emotion (5)🔍Information retrieval & search (5)🧵Discourse analysis (4)🗨️Dialogue systems (4)🌍Multilingual & cross-lingual NLP (4)✍️Text generation (3)📏Evaluation & benchmarks (3)🧮Reasoning (3)🔁Machine translation (2)💻Code & programming languages (2)🔬Interpretability (2)

📚 Fields

🖥️Computer Science (74)🎭Arts and Humanities (73)🤝Social Sciences (5)🧬Biochemistry, Genetics and Molecular Biology (1)💭Psychology (1)

🧑‍🔬 Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

🏛️ Top institutions

Institutions on the bylines of its works here, by the number of works.

🏢MicrosoftRedmond · United States6 works here🏢GoogleMountain View · United States6 works here🎓University of WashingtonSeattle · United States6 works here🎓Georgia Institute of TechnologyAtlanta · United States3 works here🎓University of Illinois Urbana-ChampaignUrbana · United States3 works here🎓Technische Universität DarmstadtDarmstadt · Germany3 works here🔬Allen Institute for Artificial IntelligenceSeattle · United States3 works here🎓Bocconi UniversityMilan · Italy3 works here🎓Carnegie Mellon UniversityPittsburgh · United States3 works here🎓Columbia UniversityNew York · United States3 works here🎓The University of Texas at AustinAustin · United States3 works here🏢Adobe SystemsSan Jose · United States2 works here

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/venues/naacl/2021/