Identification and Resolution of Chinese Zero Pronouns: A Machine Learning Approach
Summary
Chinese often leaves subjects and other arguments unexpressed. These gaps are zero pronouns, and many refer back to an overt noun phrase earlier in the text. This anaphoric type (AZP) is hard to find and resolve because, unlike overt pronouns, it carries no gender or number cues. Earlier Chinese systems relied on hand-crafted rules or assumed the gaps were already given. Zhao and Ng propose the first fully learned pipeline that both detects and resolves AZPs.
The work uses Converse's (2006) coreference annotation of 205 Penn Chinese TreeBank (CTB 3.0) texts, with gold segmentation, POS tags and parse trees (null categories removed). Candidate gaps are taken from positions before VP-initial words. A first classifier decides which gaps are anaphoric. A second classifier pairs each detected AZP with preceding NP candidates. Both rely on simple syntactic, parse-tree-based features, and the anaphoricity threshold is tuned.
The full system reaches an F-measure of 25.9% on blind test data. Given gold AZPs, resolution performs about as well as Converse's rule-based Hobbs-algorithm system, which shows that learning can replace hand-built heuristics for this task.
Key points
- Data: 205 CTB texts. Texts 1–155 are used for training (343 AZPs) and 156–205 for testing (40 AZPs). Chains with split antecedents were dropped, leaving 383 AZPs in total.
- Candidate extraction finds 100% of zero pronouns and 98.6% of NPs.
- After tuning (r = 11 training-sample window, threshold t = 0.6) with 5-fold cross validation, blind test results are 27.5% recall, 24.4% precision and 25.9% F. The tuning gain was modest but statistically significant.
- With gold AZPs, resolution scores 42.5% F, compared with 43.0% accuracy for Converse's (2006) rule-based approach.
- Motivation: overt subjects appear in only about 64% of Chinese clauses, versus over 96% in English (Kim, 2000).
Cited by
- Anaphoric Zero Pronoun Identification: A Multilingual Approach
- Cross-lingual Zero Pronoun Resolution
- Chinese Zero Pronoun Resolution: Some Recent Advances
- Chinese Zero Pronoun Resolution: An Unsupervised Probabilistic Model Rivaling Supervised Resolvers
- Chinese Zero Pronoun Resolution: A Joint Unsupervised Discourse-Aware Model Rivaling State-of-the-Art Resolvers
- Chinese Zero Pronoun Resolution with Deep Neural Networks
- Tackling Zero Pronoun Resolution and Non-Zero Coreference Resolution Jointly
- Intra-sentential Zero Anaphora Resolution using Subject Sharing Recognition
- A Tree Kernel-Based Unified Framework for Chinese Zero Anaphora Resolution
- Exploiting Zero Pronouns to Improve Chinese Coreference Resolution
- An Empirical Study of Contextual Data Augmentation for Japanese Zero Anaphora Resolution
- Generating and Exploiting Large-scale Pseudo Training Data for Zero Pronoun Resolution
- Supervised Noun Phrase Coreference Research: The First Fifteen Years
- A Discriminative Approach to Japanese Zero Anaphora Resolution with Large-scale Lexicalized Case Frames
- Entity-Centric Joint Modeling of Japanese Coreference Resolution and Predicate Argument Structure Analysis
- One Model to Learn Both: Zero Pronoun Prediction and Translation
- Chinese Zero Pronoun Resolution with Deep Memory Network
- Zero Pronoun Resolution with Attention-based Neural Network
Cite
@inproceedings{zhao2007identification,
title = {{Identification and Resolution of Chinese Zero Pronouns: A Machine Learning Approach}},
author = {Zhao, Shanheng and Ng, Hwee Tou},
booktitle = {Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL)},
year = {2007},
url = {https://aclanthology.org/D07-1057/}
}References
- Susan Converse. 2006. Pronominal Anaphora Resolution in Chinese. Ph.D. thesis, Department of Computer and Information Science, University of Pennsylvania. find
- Antonio Ferrández and Jesús Peral. 2000. A computational approach to zero-pronouns in Spanish. In Proceedings of the 38th Annual Meeting of the Association for Computational Linguistics (ACL2000), pages 166–172. find
- Radu Florian, Hany Hassan, Abraham Ittycheriah, Hongyan Jing, Nanda Kambhatla, Xiaoqiang Luo, Nicolas Nicolov, and Salim Roukos. 2004. A statistical model for multilingual entity detection and tracking. In Proceedings of the Human Language Technology Conference and North American Chapter of the Asso… find
- Barbara J. Grosz, Aravind K. Joshi, and Scott Weinstein. 1995. Centering: A framework for modeling the local coherence of discourse. Computational Linguistics, 21(2):203–225. find our card
- Jerry R. Hobbs. 1978. Resolving pronoun references. Lingua, 44:311–338. find our card
- Ryu Iida, Kentaro Inui, and Yuji Matsumoto. 2006. Exploiting syntactic patterns as clues in zero-anaphora resolution. In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics (COLING-ACL2006), pages 625–… find our card
- Young-Joo Kim. 2000. Subject/object drop in the acquisition of Korean: A cross-linguistic comparison. Journal of East Asian Linguistics, 9(4):325–351. find
- Charles N. Li and Sandra A. Thompson. 1979. Third-person pronouns and zero-anaphora in Chinese discourse. Syntax and Semantics, 12:311–335. find
- Wendan Li. 2004. Topic chains in Chinese discourse. Discourse Processes, 37(1):25–45. find
- Andrew McCallum and Ben Wellner. 2005. Conditional models of identity uncertainty with application to noun coreference. In Advances in Neural Information Processing Systems 17 (NIPS), pages 905–912. find
- Vincent Ng and Claire Cardie. 2002a. Identifying anaphoric and non-anaphoric noun phrases to improve coreference resolution. In Proceedings of the 19th International Conference on Computational Linguistics (COLING2002), pages 1–7. find
- Vincent Ng and Claire Cardie. 2002b. Improving machine learning approaches to coreference resolution. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL2002), pages 104–111. find our card
- Vincent Ng. 2004. Learning noun phrase anaphoricity to improve coreference resolution: Issues in representation and optimization. In Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL2004), pages 152–159. find
- Kazuhiro Seki, Atsushi Fujii, and Tetsuya Ishikawa. 2002. A probabilistic method for analyzing Japanese anaphora integrating zero pronoun detection and resolution. In Proceedings of the 19th International Conference on Computational Linguistics (COLING2002), pages 911–917. find our card
- Wee Meng Soon, Hwee Tou Ng, and Daniel Chung Yong Lim. 2001. A machine learning approach to coreference resolution of noun phrases. Computational Linguistics, 27(4):521–544. find our card
- Nianwen Xue, Fei Xia, Fu-Dong Chiou, and Martha Palmer. 2005. The Penn Chinese TreeBank: Phrase structure annotation of a large corpus. Natural Language Engineering, 11(2):207–238. find
- Xiaofeng Yang, Guodong Zhou, Jian Su, and Chew Lim Tan. 2003. Coreference resolution using competition learning approach. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics (ACL2003), pages 176–183. find our card
- Ching-Long Yeh and Yi-Chun Chen. 2004. Zero anaphora resolution in Chinese with shallow parsing. Journal of Chinese Language and Computing. find
- Yaqian Zhou, Changning Huang, Jianfeng Gao, and Lide Wu. 2005. Transformation based Chinese entity detection and tracking. In Proceedings of the Second International Joint Conference on Natural Language Processing (IJCNLP 2005), pages 232–237. find