北京邮电大学学报

  • EI核心期刊

北京邮电大学学报 ›› 2008, Vol. 31 ›› Issue (1): 14-17.doi: 10.13190/jbupt.200801.14.qiny

• 论文 • 上一篇    下一篇

级联中文组块识别

秦 颖, 王小捷, 钟义信   

  1. 北京邮电大学 信息工程学院, 北京 100876
  • 收稿日期:2007-03-31 修回日期:1900-01-01 出版日期:2008-02-28 发布日期:2008-02-28
  • 通讯作者: 秦 颖

Cascade Identification of Chinese Chunks

QIN Ying, WANG Xiao-jie, ZHONG Yi-xin   

  1. Information Engineering School, Beijing University of Posts and Telecommunications, Beijing 100876,China
  • Received:2007-03-31 Revised:1900-01-01 Online:2008-02-28 Published:2008-02-28
  • Contact: QIN Ying

摘要:

基于统计方法的中文组块研究大多借鉴CoNLL2000英文组块的思想,建立了组块表示的BIO模型,并将组块识别任务作为一种为词序列标注的多分类问题.为降低分类复杂度,采取了一种分解识别法,即先识别组块的边界,再进行组块类别判定.基于条件随机场(CRF)构建了级联组块识别器,实验数据集采用宾州大学中文树库(CTB5.1).在特征选择上,借鉴了中文分词特征选择的方法.5倍交叉验证的实验结果为:组块边界识别的F1值为95.05%;类型识别的准确率为99.43%;整体F1值为93.58%.该方法提高了系统性能,缩短了学习器的训练时间.

关键词: 中文组块, 边界识别, 类别识别, 条件随机场

Abstract:

Most statistical-based Chinese chunking researches was inspired by English chunking of CoNLL2000. After representing chunks within the scheme of tags for words in a chunk (BIO), chunk identification task was cast as word sequence tagging and tackled as multi-classification problems. For sake of decreasing classification complexity, a decomposed chunking approach was proposed: first, chunk boundary identification, and then chunk type identification. The vital problem of Chinese chunking is actually boundary identification. Cascade chunk identifiers were built based on conditional random fields (CRF). The experimental dataset was extracted from Chinese tree bank 5.1 (CTB5.1). As to the features selection, some methods often used in Chinese word segmentation were borrowed to chunking task. On 5 cross validation of dataset, F1-measure of chunk boundary identification is 95.05%, and the precision of chunk type recognition is 99.43% as well. And the total chunking F1-meausre reaches 93.58%. Comparing with other relative researches, the performance is improved and the training time of learners is sharply shortened.

Key words: Chinese chunking, boundary identification, type identification, conditional random fields

中图分类号: