Least Squares Large Margin Twin Support Vector Machine

doi:10.13190/j.jbupt.2017-180

JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM ›› 2018, Vol. 41 ›› Issue (6): 34-38.doi: 10.13190/j.jbupt.2017-180

• Papers • Previous Articles Next Articles

Least Squares Large Margin Twin Support Vector Machine

WU Qing, QI Shao-wei, SUN Kai-yue, ZANG Bo-yan, ZHAO Xiang

School of Automation, Xi'an University of Posts and Telecommunications, Xi'an 710121, China

Received:2017-10-08 Online:2018-12-28 Published:2018-12-24

Abstract

Abstract: In order to overcome low accuracy and possible singularity of least squares twin support vector machine (LSTWSVM), a least squares large margin twin support vector machine (LSLMTSVM) is presented. The proposed algorithm improves generalization performance by introducing margin distribution to the optimization objective function of the LSTWSVM. Additionally, the structural risk minimization principle is implemented by adding the regularization term to the objective function which improves classification ability. Experimental results show that LSLMTSVM has better classification performance than the existing algorithm.

Key words: least squares, twin support vector machine, margin distribution, classification

CLC Number:

TN181

WU Qing, QI Shao-wei, SUN Kai-yue, ZANG Bo-yan, ZHAO Xiang. Least Squares Large Margin Twin Support Vector Machine[J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2018, 41(6): 34-38.

References

[1] Cortes C, Vapnik V N. Support-vector networks[J]. Machine Learning, 1995, 20(3):273-297.
[2] Vapnik V N. The nature of statistical learning theory[J]. Technometrics, 1997, 38(4):409.
[3] 丁晓剑, 赵银亮. 双边界支持向量机的理论研究与分析[J]. 北京邮电大学学报, 2010, 33(2):20-23. Ding Xiaojian, Zhao Yinliang. Theory and analysis of double margin SVM[J]. Journal of Beijing University of Posts and Telecommunications, 2010, 33(2):20-23.
[4] 马跃峰, 梁循, 周小平. 一种基于全局代表点的快速最小二乘支持向量机稀疏化算法[J]. 自动化学报, 2017, 43(1):132-141. Ma Yuefeng, Liang Xun, Zhou Xiaoping. A fast sparse algorithm for least squares support vector machine based on global representative points[J]. Acta Automatica Sinica, 2017, 43(1):132-141.
[5] 陈素根, 吴小俊. 改进的投影孪生支持向量机[J]. 电子学报, 2017, 45(2):408-416. Chen Sugen, Wu Xiaojun. Improved projection twin support vector machine[J]. Acta Electronica Sinica, 2017, 45(2):408-416.
[6] 刘春红, 韩晶晶, 商彦磊, 等. 基于SVM分类的云集群失败作业主动预测方法[J]. 北京邮电大学学报, 2016, 39(5):104-109. Liu Chunhong, Han Jingjing, Shang Yanlei, et al. Predicting job failure in cloud cluster:based on SVM classification[J]. Journal of Beijing University of Posts and Telecommunications, 2016, 39(5):104-109.
[7] Qi Zhiquan, Tian Yingjie, Shi Yong. Robust twin support vector machine for pattern classification[J]. Pattern Recognition, 2013, 46(1):305-316.
[8] Shao Yuanhai, Deng Naiyang, Yang Zhimin. Least squares recursive projection twin support vector machine for classification[J]. Pattern Recognition, 2012, 45(6):2299-2307.
[9] Chen Sugen, Wu Xiaojun. A new fuzzy twin support vector machine for pattern classification[J]. International Journal of Machine Learning and Cybernetics, 2018, 9(9):1553-1564.
[10] Tanveer M, Khan M A, Ho S S. Robust energy-based least squares twin support vector machines[J]. Applied Intelligence, 2016, 45(1):174-186.
[11] Mangasarian O L, Wild E W. Multisurface proximal support vector machine classification via generalized eigenvalues[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2006, 28(1):69-74.
[12] Jayadeva, Khemchandani R, Chandra S. Twin support vector machines for pattern classification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(5):905-910.
[13] Kumar M A, Gopal M. Least squares twin support vector machines for pattern classification[J]. Expert Systems with Applications, 2009, 36(4):7535-7543.
[14] Shao Yuanhai, Zhang Chunhua, Wang Xiaobo, et al. Improvements on twin support vector machines[J]. IEEE Transactions on Neural Networks, 2011, 22(6):962-968.
[15] 程昊翔, 王坚. 一种新的孪生大间隔分布机算法[J]. 控制与决策, 2016, 31(5):949-952. Cheng Haoxiang, Wang Jian. A novel twin large margin distribution machine[J]. Control and Decision, 2016, 31(5):949-952.
[16] Vapnik V N. Statistical learning theory[J]. Encyclopedia of the sciences of learning, 1998, 41(4):3185.
[17] Blake C. UCI repository of machine learning databases[EB/OL].[2017-06-25]. http://www.ics.uci.edu/~mlearn/MLRepository.html.

Least Squares Large Margin Twin Support Vector Machine

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	ZHANG Tiankui, CAI Changli, LUO Xiaoliang, ZHU Yutao. Multi-Scale Feature Transformer Based Fine-Grained Image Classification Method [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 70-75.
[2]	BAO Qianhui, WEN Juan, SHI Shuzhen, DONG Mengping, LIU Xue. Aspect Category Classification Integrated in Syntactic Dependency and BERT-Att-BiLSTM [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 123-128.
[3]	XIE Lixia, LIU Siyu, YANG Hongyu, ZHANG Liang. A Software Defect Assessment Method with Classification Cost [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 116-122.
[4]	XU Tongle, SU Yuanhao, MENG Liang, LAN Xiaosheng, LI Yunfeng. Fault Diagnosis Method of Wind Turbine Gearbox by Optimized GAN [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 62-66.
[5]	. Traditional clothing image classification algorithm based on multi-layer discriminant dictionary learning [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 104-108.
[6]	XIE Yonghong, TAO Hu, JIA Qi, YANG Shibing, HAN Xinliang. Traditional Chinese Medicine Symptom Normalization Approach Based on Pre-Trained Language Models [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 13-18,57.
[7]	. Traditional Chinese Medicine Symptom Normalization Approach Based on Pre-trained Language Models [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 14-20.
[8]	CHAO Hao, MA Qingmin, LIU Yongli. EEG-Based Emotion Recognition by Using Convolutional Echo-State Network [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 36-43.
[9]	LI Jian-gui, LIANG Yue, GAO Peng-fei, LIU Shao-hua, MA Ying-long. A Hierarchical Category Embedding Based Approach for Fault Classification of Power ICT System [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(4): 34-40.
[10]	CAO Yi, HUANG Zi-long, SHENG Yong-jian, LIU Chen, FEI Hong-bo. Noise Robust Urban Audio Classification Based on 2-Order Dense Convolutional Network Using Dual Features [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 86-91.
[11]	LIU Yi-chen, SUN Hua-zhi, MA Chun-mei, JIANG Li-fen, ZHONG Chang-hong. Commodity Classification of Online Based on High-Level Feature Fusion [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 98-104,117.
[12]	CHANG Zi-ying, WANG Wen-han, LI Tao, LIU Fen, CHEN Peng-peng. A Fingerprint Localization Method Based on Shapelet Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(4): 95-100.
[13]	JIANG Fang, ZHANG Nan-fei, HU Yan-jun, WANG Yi. BP Neural Network Based CSI Device-Free Target Classification Method [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(1): 40-45.
[14]	FU Qun-chao, WANG Cong. Based on Multiple Probing Tasks Fine-Tuning of Language Models for Text Classification [J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 76-83.
[15]	LIU Han. Spam Web Detection Based on Hybrid-Sampling and Genetic Algorithm [J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 111-117.