Treebanks
What it is
A treebank is a collection of sentences where each one comes with its grammatical tree, drawn or checked by people. The Penn Treebank of English newspaper text made statistical parsing possible; today the Universal Dependencies treebanks cover more than a hundred languages.
Treebanks are how parsers learn and how they are measured. Building one is slow, careful work: guidelines, trained annotators, agreement checks. Every treebank also has its own habits, and knowing them matters as much as the trees themselves.
How Mova does it
Mova keeps a folder for every UD treebank it uses, with its annotation habits and converters, and builds its own silver corpus of English trees. On this site every sentence of its corpora — the Tanakh, the school lessons and the fairy tales — has its own page with its tree drawn word by word.
- Treebanks: seeds, papers and converters
- Mova's own corpus: silver UD for English
- The corpora, sentence by sentence
The papers (139)
Pages: 1 · 2
- How Bad is the Problem of PP-Attachment? A Comparison of English, German and Swedish
2 ideas kept— Martin Volk, 2006 · 1 citations - The Proposition Bank: An Annotated Corpus of Semantic Roles — Martha Palmer, Daniel Gildea, Paul Kingsbury, 2005 · 2273 citations
- The Penn Discourse TreeBank 2.0. — Rashmi Prasad, Nikhil Dinesh, Alan Lee, Eleni Miltsakaki et al., 2008 · 1106 citations
- Universal Dependencies v1: A Multilingual Treebank Collection — Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Yoav Goldberg et al., 2016 · 1028 citations
- CoNLL-X Shared Task on Multilingual Dependency Parsing — Sabine Buchholz, Erwin Marsi, 2006 · 963 citations
- The Penn Treebank: Annotating Predicate Argument Structure — Mitchell Marcus, Grace Kim, Mary Ann Marcinkiewicz, Robert MacIntyre et al., 1994 · 742 citations
- Tokenizing, POS Tagging, Lemmatizing and Parsing UD 2.0 with UDPipe — Milan Straka, Jana Straková, 2017 · 567 citations
- From TreeBank to PropBank — Paul Kingsbury, Martha Palmer, 2002 · 533 citations
- Building a Large Annotated Corpus of English: The Penn Treebank — Mitchell P. Marcus, Beatrice Santorini, Mary Ann Marcinkiewicz, 1993 · 489 citations
- Part-of-Speech Tagging Guidelines for the Penn Treebank Project (3rd Revision) — Beatrice Santorini, 1990 · 434 citations
- CCGbank: A Corpus of CCG Derivations and Dependency Structures Extracted from the Penn Treebank — Julia Hockenmaier, Mark Steedman, 2007 · 383 citations
- CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies — Daniel Zeman, Martin Popel, Milan Straka, Jan Hajič et al., 2017 · 367 citations
- UDPipe: Trainable Pipeline for Processing CoNLL-U Files Performing Tokenization, Morphological Analysis, POS Tagging and Parsing — Milan Straka, Jan Hajič, Jana Straková, 2016 · 350 citations
- Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection — Joakim Nivre, Marie-Catherine de Marneffe, Filip Ginter, Jan Hajič et al., 2020 · 325 citations
- The Penn Discourse Treebank — Eleni Miltsakaki, Rashmi Prasad, Aravind Joshi, Bonnie Webber, 2004 · 307 citations
- Extended Constituent-to-Dependency Conversion for English — Richard Johansson, Pierre Nugues, 2007 · 275 citations
- 75 Languages, 1 Model: Parsing Universal Dependencies Universally — Dan Kondratyuk, Milan Straka, 2019 · 225 citations
- LinGO Redwoods: A Rich and Dynamic Treebank for HPSG — Stephan Oepen, Dan Flickinger, Kristina Toutanova, Christopher D. Manning, 2004 · 139 citations
- The LinGO Redwoods Treebank: Motivation and Preliminary Applications — Stephan Oepen, Kristina Toutanova, Stuart Shieber, Christopher Manning et al., 2002 · 135 citations
- CATiB: The Columbia Arabic Treebank — Nizar Habash, Ryan Roth, 2009 · 131 citations
- UDPipe 2.0 Prototype at CoNLL 2018 UD Shared Task — Milan Straka, 2018 · 115 citations
- Parsing Arabic Dialects — David Chiang, Mona Diab, Nizar Habash, Owen Rambow et al., 2006 · 108 citations
- Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing — Minh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, Thien Huu Nguyen, 2021 · 107 citations
- Developing an Arabic Treebank: Methods, Guidelines, Procedures, and Tools — Mohamed Maamouri, Ann Bies, 2004 · 99 citations
- Adding Noun Phrase Structure to the Penn Treebank — David Vadas, James Curran, 2007 · 94 citations
- Reflections on the Penn Discourse TreeBank, Comparable Corpora, and Complementary Annotation — Rashmi Prasad, Bonnie Webber, Aravind Joshi, 2014 · 91 citations
- Fully Parsing the Penn Treebank — Ryan Gabbard, Seth Kulick, Mitchell Marcus, 2006 · 76 citations
- Frustratingly Hard Domain Adaptation for Dependency Parsing — Mark Dredze, John Blitzer, Partha Pratim Talukdar, Kuzman Ganchev et al., 2007 · 72 citations
- WikiCoref: An English Coreference-annotated Corpus of Wikipedia Articles — Abbas Ghaddar, Phillippe Langlais, 2016 · 67 citations
- Extracting and evaluating general world knowledge from the Brown Corpus — Lenhart Schubert, Matthew Tong, 2003 · 66 citations
- CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies — Daniel Zeman, Jan Hajič, Martin Popel, Martin Potthast et al., 2018 · 61 citations
- The Galactic Dependencies Treebanks: Getting More Data by Synthesizing New Languages — Dingquan Wang, Jason Eisner, 2016 · 58 citations
- LinES: An English-Swedish Parallel Treebank — Lars Ahrenberg, 2007 · 47 citations
- SciDTB: Discourse Dependency TreeBank for Scientific Abstracts — An Yang, Sujian Li, 2018 · 42 citations
- Joint Syntacto-Discourse Parsing and the Syntacto-Discourse Treebank — Kai Zhao, Liang Huang, 2017 · 39 citations
- Translation Divergences in Chinese–English Machine Translation: An Empirical Investigation — Dun Deng, Nianwen Xue, 2017 · 39 citations
- Coordination Structures in Dependency Treebanks — Martin Popel, David Mareček, Jan Štěpánek, Daniel Zeman et al., 2013 · 39 citations
- Syntactic Annotation Guidelines for the Quranic Arabic Dependency Treebank — Kais Dukes, Eric Atwell, Abdul-Baquee M. Sharaf, 2010 · 39 citations
- UniMorph 4.0: Universal Morphology — Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, 2022 · 37 citations
- Enhancing Universal Dependency Treebanks: A Case Study — Joakim Nivre, Paola Marongiu, Filip Ginter, Jenna Kanerva et al., 2018 · 34 citations
- Overview of the IWPT 2020 Shared Task on Parsing into Enhanced Universal Dependencies — Gosse Bouma, Djamé Seddah, Daniel Zeman, 2020 · 31 citations
- A Dependency Treebank for English — Owen Rambow, Cassandre Creswell, Rachel Szekely, Harriet Taber et al., 2002 · 31 citations
- Evaluating Dependency Parsing: Robust and Heuristics-Free Cross-Annotation Evaluation — Reut Tsarfaty, Joakim Nivre, Evelina Andersson, 2011 · 27 citations
- Merging PropBank, NomBank, TimeBank, Penn Discourse Treebank and Coreference — James Pustejovsky, Adam Meyers, Martha Palmer, Massimo Poesio, 2005 · 26 citations
- Udapi: Universal API for Universal Dependencies — Martin Popel, Zdeněk Žabokrtský, Martin Vojtek, 2017 · 25 citations
- Statistical Parsing by Machine Learning from a Classical Arabic Treebank — Kais Dukes, 2015 · 25 citations
- Easy-First Dependency Parsing of Modern Hebrew — Yoav Goldberg, Michael Elhadad, 2010 · 23 citations
- Morphologically Annotated Corpora for Seven Arabic Dialects: Taizi, Sanaani, Najdi, Jordanian, Syrian, Iraqi and Moroccan — Faisal Alshargi, Shahd Dibas, Sakhar Alkhereyf, Reem Faraj et al., 2019 · 22 citations
- Joint Prediction of Morphosyntactic Categories for Fine-Grained Arabic Part-of-Speech Tagging Exploiting Tag Dictionary Information — Go Inoue, Hiroyuki Shindo, Yuji Matsumoto, 2017 · 21 citations
- Automatic Detection and Correction of Errors in Dependency Treebanks — Alexander Volokh, Günter Neumann, 2011 · 20 citations
- Assessing the Annotation Consistency of the Universal Dependencies Corpora — Marie-Catherine de Marneffe, Matias Grioni, Jenna Kanerva, Filip Ginter, 2017 · 19 citations
- Unsupervised Morphology Rivals Supervised Morphology for Arabic MT — David Stallard, Jacob Devlin, Michael Kayser, Yoong Keok Lee et al., 2012 · 19 citations
- Converting an English-Swedish Parallel Treebank to Universal Dependencies — Lars Ahrenberg, 2015 · 17 citations
- Parsing Noun Phrases in the Penn Treebank — David Vadas, James R. Curran, 2011 · 15 citations
- The Denoised Web Treebank: Evaluating Dependency Parsing under Noisy Input Conditions — Joachim Daiber, Rob van der Goot, 2016 · 14 citations
- Improving Arabic Dependency Parsing with Form-based and Functional Morphological Features — Yuval Marton, Nizar Habash, Owen Rambow, 2011 · 13 citations
- Using the Penn Treebank to Evaluate Non-Treebank Parsers — Eric K. Ringger, Robert C. Moore, Eugene Charniak, Lucy Vanderwende et al., 2004 · 13 citations
- What determines the order of adjectives in English? Comparing efficiency-based theories using dependency treebanks — Richard Futrell, William Dyer, Greg Scontras, 2020 · 12 citations
- Towards the Annotation of Penn TreeBank with Information Structure — Bernd Bohnet, Alicia Burga, Leo Wanner, 2013 · 12 citations
- The Hebrew Universal Dependency Treebank: Past, Present and Future — Shoval Sade, Amit Seker, Reut Tsarfaty, 2018 · 11 citations
- MWEs in Treebanks: From Survey to Guidelines — Victoria Rosén, Koenraad De Smedt, Gyri Smørdal Losnegaard, Eduard Bejček et al., 2016 · 11 citations
- A Dependency Treebank of Spoken Second Language English — Kristopher Kyle, Masaki Eguchi, Aaron Miller, Theodore Sither, 2022 · 10 citations
- Arabic Multi-Dialect Segmentation: bi-LSTM-CRF vs. SVM — Mohamed Eldesouki, Younes Samih, Ahmed Abdelali, Mohammed Attia et al., 2017 · 10 citations
- Annotating Coordination in the Penn Treebank — Wolfgang Maier, Sandra Kübler, Erhard Hinrichs, Julia Krivanek, 2012 · 10 citations
- I3rab: A New Arabic Dependency Treebank Based on Arabic Grammatical Theory — Dana Halabi, Ebaa Fayyoumi, Arafat Awajan, 2020 · 9 citations
- An Arabic Dependency Treebank in the Travel Domain — Dima Taji, Jamila El Gizuli, Nizar Habash, 2019 · 9 citations
- All Roads Lead to UD: Converting Stanford and Penn Parses to English Universal Dependencies with Multilayer Annotations — Siyao Peng, Amir Zeldes, 2018 · 9 citations
- Graph-to-Graph Transformer for Transition-based Dependency Parsing — Alireza Mohammadshahi, James Henderson, 2020 · 8 citations
- A non-projective greedy dependency parser with bidirectional LSTMs — David Vilares, Carlos Gómez-Rodríguez, 2017 · 8 citations
- Diacritic Annotation in the Arabic Treebank and its Impact on Parser Evaluation — Mohamed Maamouri, Seth Kulick, Ann Bies, 2008 · 8 citations
- Dependency Tree Transformation with Tree Transducers — Felix Hennig, Arne Köhn, 2017 · 7 citations
- Correcting Dependency Annotation Errors — Markus Dickinson, 2009 · 7 citations
- Using Modern Languages to Parse Ancient Ones: a Test on Old English — Luca Brigada Villa, Martina Giarda, 2023 · 6 citations
- Akkadian Treebank for early Neo-Assyrian Royal Inscriptions — Mikko Luukko, Aleksi Sahala, Sam Hardwick, Krister Lindén, 2020 · 6 citations
- Errator: a Tool to Help Detect Annotation Errors in the Universal Dependencies Project — Guillaume Wisniewski, 2018 · 6 citations
- Mind the Gap: Data Enrichment in Dependency Parsing of Elliptical Constructions — Kira Droganova, Filip Ginter, Jenna Kanerva, Daniel Zeman, 2018 · 6 citations
- Semantic Tagging for the Penn Treebank — Martha Palmer, Hoa Trang Dang, Joseph Rosenzweig, 2000 · 6 citations
- Universal Morpho-Syntactic Parsing and the Contribution of Lexica: Analyzing the ONLP Lab Submission to the CoNLL 2018 Shared Task — Amit Seker, Amir More, Reut Tsarfaty, 2018 · 5 citations
- Further Developments in Treebank Error Detection Using Derivation Trees — Seth Kulick, Ann Bies, Justin Mott, 2012 · 5 citations
- The Types and Distributions of Errors in a Wide Coverage Surface Realizer Evaluation — Charles Callaway, 2005 · 5 citations
- The Aligned Multimodal Movie Treebank: An audio, video, dependency-parse treebank — Adam Yaari, Jan DeWitt, Henry Hu, Bennett Stankovits et al., 2022 · 4 citations
- Nested Coordination in Universal Dependencies — Adam Przepiórkowski, Agnieszka Patejuk, 2019 · 4 citations
- A Cross-Task Flexible Transition Model for Arabic Tokenization, Affix Detection, Affix Labeling, POS Tagging, and Dependency Parsing — Stephen Tratz, 2013 · 4 citations
- German and English Treebanks and Lexica for Tree-Adjoining Grammars — Miriam Kaeshammer, Vera Demberg, 2012 · 4 citations
- Construct State Modification in the Arabic Treebank — Ryan Gabbard, Seth Kulick, 2008 · 4 citations
- Integrating Graph-Based and Transition-Based Dependency Parsers in the Deep Contextualized Era — Agnieszka Falenska, Anders Björkelund, Jonas Kuhn, 2020 · 3 citations
- NoEl: An Annotated Corpus for Noun Ellipsis in English — Payal Khullar, Kushal Majmundar, Manish Shrivastava, 2020 · 3 citations
- Approximate Dynamic Oracle for Dependency Parsing with Reinforcement Learning — Xiang Yu, Ngoc Thang Vu, Jonas Kuhn, 2018 · 3 citations
- A Factored Functional Dependency Transformation of the English Penn Treebank for Probabilistic Surface Generation — Irene Langkilde-Geary, Justin Betteridge, 2006 · 3 citations
- Data-driven Parsing Evaluation for Child-Parent Interactions — Zoey Liu, Emily Prud'hommeaux, 2023 · 2 citations
- Comparing Neural Network Parsers for a Less-resourced and Morphologically-rich Language: Amharic Dependency Parser — Binyam Ephrem Seyoum, Yusuke Miyao, Baye Yimam Mekonnen, 2020 · 2 citations
- Estimating POS Annotation Consistency of Different Treebanks in a Language — Akshay Aggarwal, Daniel Zeman, 2020 · 2 citations
- Sentence Boundary Detection on Line Breaks in Japanese — Yuta Hayashibe, Kensuke Mitsuzawa, 2020 · 2 citations
- Annotation Scheme for English Argument Structure Constructions Treebank — Hakyung Sung, Kristopher Kyle, 2024 · 1 citations
- Out-of-Domain Dependency Parsing for Dialects of Arabic: A Case Study — Noor Abo Mokh, Daniel Dakota, Sandra Kübler, 2024 · 1 citations
- Are UD Treebanks Getting More Consistent? A Report Card for English UD — Amir Zeldes, Nathan Schneider, 2023 · 1 citations
- Camel Treebank: An Open Multi-genre Arabic Dependency Treebank — Nizar Habash, Muhammed AbuOdeh, Dima Taji, Reem Faraj et al., 2022 · 1 citations
- Annotation guidelines of UD and SUD treebanks for spoken corpora: A proposal — Sylvain Kahane, Bernard Caron, Emmett Strickland, Kim Gerdes, 2021 · 1 citations
- Mischievous nominal constructions in Universal Dependencies — Nathan Schneider, Amir Zeldes, 2021 · 1 citations
- Towards an adequate account of parataxis in Universal Dependencies — Lars Ahrenberg, 2019 · 1 citations
Pages: 1 · 2