Distant Supervision Relation Extraction Method Based on Highway Multi-Kernel Network

doi:10.13190/j.jbupt.2020-071

Journal of Beijing University of Posts and Telecommunications ›› 2020, Vol. 43 ›› Issue (5): 71-76.doi: 10.13190/j.jbupt.2020-071

• PAPERS • Previous Articles Next Articles

Distant Supervision Relation Extraction Method Based on Highway Multi-Kernel Network

LI Wei¹, CHEN Shu-dong^1,2, OUYANG Xiao-ye², DU Rong², WANG Rong³

1. School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China;
2. Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China;
3. Key Laboratory of Space Object Measurement, Department, Beijing Institute of Tracking and Telecommunications Technology, Beijing 100094, China

Received:2020-06-20 Published:2021-03-11

Abstract

Abstract: As a technology that can quickly generate large amounts of labeled data, the distant supervision is increasingly used in relation extraction. However, there are still problems such as insufficient text feature extraction and noise in the bag. A distant supervision relation extraction method based on highway multi-kernel network is proposed to solve these questions. Firstly, the feature of sentences are deeply extracted by highway network and multi-kernel convolution; and then the intra-bag attention mechanism is used to improve the sentence weight of the correct annotation in bag and reduce the intra-bag noise to obtain the bag‘s embedding. Subsequently, the inter-bag attention mechanism is used to reduce the inter-bag noise for each group of bags with the same relation to obtain the group‘s embedding. Finally, groups are used as training samples to train the classifier to achieve relation extraction. Experiment shows that this method has better relation extraction performance than existing methods.

Key words: relation extraction, distant supervision, attention mechanism, neural network, highway multi-kernel network

CLC Number:

TP391

LI Wei, CHEN Shu-dong, OUYANG Xiao-ye, DU Rong, WANG Rong. Distant Supervision Relation Extraction Method Based on Highway Multi-Kernel Network[J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 71-76.

References

[1] Riedel S, Yao Limin, McCallum A. Modeling relations and their mentions without labeled text[J]. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases, 2010(part 1):148-163.
[2] Mintz M, Bills S, Snow R, et al. Distant supervision for relation extraction without labeled data[C]//International Joint Conference on Association for Computational Linguistics. Singapore:ACL and AFNLP, 2009:1003-1011.
[3] Ding Xiaohan, Guo Yuchen, Ding Guiguang, et al. ACNet:strengthening the kernel skeletons for powerful CNN via asymmetric convolution blocks[J]. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019(3):1911-1920.
[4] 冀振燕, 宋晓军, 皮怀雨, 等. 基于深度学习的融合多源异构数据的推荐模型[J]. 北京邮电大学学报, 2019, 42(6):35-42. Ji Zhenyan, Song Xiaojun, Pi Huaiyu, et al. Recommended model for fusing multi-source heterogeneous data based on deep learning[J]. Journal of Beijing University of Posts and Telecommunications, 2019, 42(6):35-42.
[5] Zeng Daojian, Liu Kang, Chen Yubo, et al. Distant supervision for relation extraction via piecewise convolutional neural networks[C]//Proceedings of the 2015 Conference in Empirical Methods in Natural Language Processing. Lisbon:ACL, 2015:1753-1762.
[6] Lin Yankai, Shen Shiqi, Liu Zhiyuan, et al. Neural relation extraction with selective attention over instances[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Berlin:ACL, 2016:2124-2133.
[7] Ye Zhixiu, Ling Zhenhua. Distant supervision relation extraction with intra-bag and inter-bag attentions[J]. Proceedings of NAACL-HLT, 2019(6):2810-2819.
[8] Liu Tianyu, Wang Kexiang, Chang Baobao, et al. A soft-label method for noise-tolerant distantly supervised relation extraction[C]//Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. Copenhagen:ACL, 2017:1790-1795.
[9] 李浩, 刘永坚, 解庆, 等. 基于多层次注意力机制的远程监督关系抽取模型[J]. 计算机科学, 2019, 46(10):252-257. Li Hao, Liu Yongjian, Xie Qing, et al. Distant supervision relation extraction model based on multi-level attention mechanism[J]. Computer Science, 2019, 46(10):252-257.
[10] Raphael Hoffmann, Zhang Congle, Ling Xiao, et al. Knowledge-based weak supervision for information extraction of overlapping relations[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics. Portland:ACL, 2011:541-550.
[11] Surdeanu M, Tibshirani J, Nallapati R, et al. Multi-instance multi-label learning for relation extraction[C]//Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Jeju Island:ACL, 2012:455-465.

[1]	BAO Qianhui, WEN Juan, SHI Shuzhen, DONG Mengping, LIU Xue. Aspect Category Classification Integrated in Syntactic Dependency and BERT-Att-BiLSTM [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 123-128.
[2]	YANG Lihua, NIE Qian, HU Bo, JIANG Ting. Channel Prediction Method Joint BP Neural Network with Basis Expansion Model [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 13-18.
[3]	WU Jin, ZHAO Bo, WEN Heng, WANG Yu. A Graph Neural Network Accelerator Optimization Research on Heterogeneous Architecture [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 19-24.
[4]	. 3D Segmentation of Brain Tumor MRI Image based on RAPNet [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 91-97.
[5]	yubin yubinshao Da-Chun ZHOU. Language Identification Based on Gammatone-Scale Power-Normalized Coefficients Spectrograms [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 122-128.
[6]	ZHANG Haoge, SHAO Yubin, LONG Hua, PENG Yi, ZHOU Dachun. Language Recognition Based on Log Gammatone-Scale Filter Bank Energies Spectrograms [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(1): 38-43.
[7]	. Joint SNR estimation and modulation recognition of MIMO-OFDM signals based on multitask learning [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 98-104.
[8]	run jiayu. A Deep Learning-Based DoA Estimation Method in Low SNR [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 119-125.
[9]	YE Kang, ZHANG Shujun, GUO Qi, LI Hui, CUI Xuehong. Continuous Sign Language Recognition Based on CM-Transformer [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(5): 49-53,78.
[10]	WU Xingkun, LUO Tao, LIU Aijun, YANG Ming, ZHANG Wenjing. Design of Neural Network Model for Auxiliary Diagnosis of Coarctation of Aorta [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 1-6.
[11]	LI Xingyuan, WANG Peng, SHEN Mu, LI Lei, ZHANG Lin. Construction of Multi-Modal Knowledge Graph for Epilepsy Related Papers [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 19-24.
[12]	LIU Linlan, SONG Xiuyang, CHEN Yubin. Link Prediction in Opportunistic Networks Based on Network Representation Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 64-69,103.
[13]	. Design of Three-dimensional Convolution Neural Network Model for Intelligent Aided Diagnosis of Coarctation of Aorta [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 1-6.
[14]	. Construction of multi-modal knowledge graph in epilepsy [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 21-27.
[15]	HUO Yuanlian, GONG Qi, QI Yongfeng, AN Yaqi. Adaptive Kernel RBFNN Based on Normalized Least Mean Square Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 29-35.

Distant Supervision Relation Extraction Method Based on Highway Multi-Kernel Network

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments