针对中国学生英文文章的词性标注方法

doi:10.13190/j.jbupt.2017.02.003

北京邮电大学学报 ›› 2017, Vol. 40 ›› Issue (2): 16-20.doi: 10.13190/j.jbupt.2017.02.003

针对中国学生英文文章的词性标注方法

谭咏梅, 杨林, 胡单

北京邮电大学智能科学与技术中心, 北京 100876

收稿日期:2016-03-29 出版日期:2017-04-28 发布日期:2017-04-26
作者简介:谭咏梅(1975-),女,副教授,E-mail:ymtan@bupt.edu.cn.

A Part-of-Speech Tagging Algorithm for Essay Written by Chinese English Learner

TAN Yong-mei, YANG Lin, HU Dan

Intelligence Science and Technology Center, Beijing University of Posts and Telecommunications, Beijing 100876, China

Received:2016-03-29 Online:2017-04-28 Published:2017-04-26

摘要/Abstract

摘要： 提出了一种基于词向量的两层词性标注方法，使用少量人工提取的特征，大部分特征可使用词向量和第1层标注向量自动训练得到.该方法将标注集分成两类，分别作为不同层的标注集.首先，对容易标注的类别进行标注；然后，对难以标注的动词或者名词进行第2层标注，将其标注为具体的某类动词或名词.利用该方法对中国学生写的英语文章进行词性标注的准确率可从95.23%提高到95.63%，超过了现有基于词向量词性标注器对相同语料词性标注的准确率.

关键词: 词性标注, 中国学生, 文章, 词向量

Abstract: A tagging algorithm about two layers part-of-speech base on word embedding was proposed. Only a few artificial features are needed in this algorithm, most features are replaced by word embedding and tagging vector that is got in the first layer. In addition, the tag set is divided into two categories, which are the tag sets of different layers. The ones which are easily to be tagged are tagged firstly in the first layer.Those tags which are hardly to be tagged as noun and verb are tagged in the second layer. Using this algorithm, the accuracy of part-of-speech tagging of essays written by Chinese English learner is improved from 95.23% to 95.63%, which outperforms the state-of-art word results of part-of-speech tagging of essays written by Chinese English learner based on vector based on word embedding.

Key words: part-of-speech tagging, Chinese English learner, essays, word vector

中图分类号:

TN911.22

谭咏梅, 杨林, 胡单. 针对中国学生英文文章的词性标注方法[J]. 北京邮电大学学报, 2017, 40(2): 16-20.

TAN Yong-mei, YANG Lin, HU Dan. A Part-of-Speech Tagging Algorithm for Essay Written by Chinese English Learner[J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2017, 40(2): 16-20.

参考文献

[1] Toutanova K, Manning C D. Enriching the knowledge sources used in a maximum entropy part-of-speech tagger[C]//Joint Sigdat Conference on Empirical Methods in Natural Language Processing and Very Large Corpora:Held in Conjunction with the, Meeting of the Association for Computational Linguistics. Hong Kong:Association for Computational Linguistics, 2000:63-70.
[2] Màrquez L, Giménez J. A general pos tagger generator based on support vector machines[J]. JMLR, 2004(5):1253-1286.
[3] Shen L, Satta G, Joshi A. Guided learning for bidirectional sequence classification[C]//Meeting of the Association for Computational Linguistics, Prague, Czech Republic:Association for Computational Linguistics. 2007:760-767.
[4] Olutobi Owoputi, Brendan O'Connor, Chris Dyer, et al. Improved part-of-speech tagging for online conversational text with word clusters[C]//Proceedings of NAACLHLT 2013. Los Angeles, California:Association for Computational Linguistics, 2013:380-390.
[5] 李红, 大学生英语写作常见错误归类分析[J]. 当代教育论坛:学科教育研究, 2006(8):120-121. Li Hong. The common errors analysis of college englishwriting[J]. Forum on Contemporary Education, 2006(8):120-121.
[6] Bengio Y, Ducharme R, Vincent P, et al. A neural probabilistic language model[J]. Journal of Machine Learning Research, 2003, 3(6):1137-1155.
[7] Alexandrescu Andrei, Kirchhoff Katrin. Factored neural language models[C]//Proceedings of the Human Language Technology Conference of the NAACL. New York City, USA:[s. n.], 2006:1-4.
[8] Collobert R, Weston J, Bottou L, et al. Natural language processing (almost) from scratch[J]. Journal of Machine Learning Research, 2011, 12(1):2493-2537.
[9] Mikolov T, Chen K, Corrado G, et al. Efficient estimation of word representations in vector space[EB/OL]. 2013-09-05. https://arxiv.org/abs/1301.3781.
[10] Santos C N D, Zadrozny B. Learning character-level representations for part-of-speech tagging[C]//International Conference on Machine Learning. Beijing:ICML, 2014:1818-1826.
[11] Collobert R. Deep learning for efficient discriminative parsing[C]//The 14^th International Conference on Artificial Intelligence and Statistics. Fort Lauderdale, Florida:AISTATS, 2011:224-232.
[12] 谭咏梅, 吴坤. 面向英语文章的词性标注算法[J]. 北京邮电大学学报, 2014, 37(6):120-124. Tan Yongmei, Wu Kun. A part-of-speech tagging method for English essay[J]. Journal of Beijing University of Posts and Telecommunications, 2014, 37(6):120-124.

针对中国学生英文文章的词性标注方法

A Part-of-Speech Tagging Algorithm for Essay Written by Chinese English Learner

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 1

编辑推荐

Metrics

本文评价