A Prototype-Based Adaptive Concept Drift Classification Method

doi:10.13190/j.jbupt.2017.03.005

JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM ›› 2017, Vol. 40 ›› Issue (3): 43-50.doi: 10.13190/j.jbupt.2017.03.005

Previous Articles Next Articles

A Prototype-Based Adaptive Concept Drift Classification Method

SU Jing¹, QIU Xiao-feng¹, LI Shu-fang¹, LIU Dao-wei², ZHANG Chun-hong¹

1. Beijing Key Laboratory of Network System Architecture and Convergence, Beijing University of Posts and Telecommunications, Beijing 100876, China;
2. China Electric Power Research Institute, Zhengzhou 450052, China

Received:2016-07-23 Online:2017-06-28 Published:2017-05-25

Abstract

Abstract: As a frequent problem that needs to be mainly dealt with in supervised learning scenario of streaming data, the concept drift, primarily, occurs when the data distribution or the target variable changes over time. As typical data streams, the research method which real-time solves or adapts to the concept drift of data streams can provide strong support for grid security dispatch and stable control of real-time decision-making. For accurate and quick dealing with or adapting to concept drift, a prototype-based learning algorithm of data streams classification is discussed. Based on improving the problems which have been explored in existing algorithm, a new algorithm SyncPrototype was proposed,which makes new optimization in terms of methods of classification method, prototype construction and updating. Experiment shows that SyncPrototype can outperforms the existing algorithm in terms of classification performance,time performance and response rate.

Key words: data streams, concept drift, classification

CLC Number:

TN992.53

SU Jing, QIU Xiao-feng, LI Shu-fang, LIU Dao-wei, ZHANG Chun-hong. A Prototype-Based Adaptive Concept Drift Classification Method[J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2017, 40(3): 43-50.

References

[1] Garofalakis M, Gehrke J, Rastogi R. Querying and mining data streams:you only get one look a tutorial[C]//Proceedings of the 2002 ACM SIGMOD International Conference on Management of Data. ACM, 2002:635-635.
[2] Rosch E H. Natural categories[J]. Cognitive Psychology, 1973, 4(3):328-350.
[3] Hoens T R, Polikar R, Chawla N V. Learning from streaming data with concept drift and imbalance:an overview[J]. Progress in Artificial Intelligence, 2012, 1(1):89-101.
[4] Shao J, Ahmadi Z, Kramer S. Prototype-based learning on concept-drifting data streams[C]//Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2014:412-421.
[5] Domingos P, Hulten G. Mining high-speed data streams[C]//Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data mining. ACM, 2000:71-80.
[6] Hulten G, Spencer L, Domingos P. Mining time-changing data streams[C]//Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 2001:97-106.
[7] Bifet A, Gavaldà R. Adaptive learning from evolving data streams[C]//International Symposium on Intelligent Data Analysis. Berlin Heidelberg:Springer, 2009:249-260.
[8] Liu G, Cheng H, Qin Z, et al. E-CVFDT:An improving CVFDT method for concept drift data stream[C]//Communications, Circuits and Systems (ICCCAS), 2013 International Conference on. IEEE, 2013, 1:315-318.
[9] Buntine W. Learning classification trees[J]. Statistics and Computing, 1992, 2(2):63-73.
[10] Pfahringer B, Holmes G, Kirkby R. New options for hoeffding trees[C]//Australasian Joint Conference on Artificial Intelligence. Berlin Heidelberg:Springer, 2007:90-99.
[11] Bifet A, Holmes G, Pfahringer B, et al. New ensemble methods for evolving data streams[C]//Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. Paris:ACM, 2009:139-148.
[12] Kubát M. Floating approximation in time-varying knowledge bases[J]. Pattern Recognition Letters, 1989, 10(4):223-227.
[13] Bifet A, Gavalda R. Learning from Time-Changing Data with Adaptive Windowing[C]//SDM. 2007, 7:2007.
[14] Widmer G, Kubat M. Effective learning in dynamic environments by explicit context tracking[C]//European Conference on Machine Learning. Berlin Heidelberg:Springer, 1993:227-243.
[15] Alippi C, Boracchi G, Roveri M. Just in time classifiers:managing the slow drift case[C]//2009 International Joint Conference on Neural Networks. Atlanta:IEEE, 2009:114-120.
[16] Street W N, Kim Y S. A streaming ensemble algorithm (SEA) for large-scale classification[C]//Proceedings of the seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco:ACM, 2001:377-382.
[17] Kolter J Z, Maloof M A. Dynamic weighted majority:A new ensemble method for tracking concept drift[C]//Proceedings of the Third IEEE International Conference on Data Mining. Washington DC:IEEE, 2003:123-130.
[18] Chu F, Zaniolo C. Fast and light boosting for adaptive mining of data streams[C]//Pacific-Asia Conference on Knowledge Discovery and Data Mining. Berlin Heidelberg:Springer, 2004:282-292.
[19] Brzezinski D, Stefanowski J. Reacting to different types of concept drift:The accuracy updated ensemble algorithm[J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 25(1):81-94.
[20] Brzezinski D, Stefanowski J. Combining block-based and online methods in learning ensembles from concept drifting data streams[J]. Information Sciences, 2014, 265(5):50-67.

A Prototype-Based Adaptive Concept Drift Classification Method

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	ZHANG Tiankui, CAI Changli, LUO Xiaoliang, ZHU Yutao. Multi-Scale Feature Transformer Based Fine-Grained Image Classification Method [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 70-75.
[2]	BAO Qianhui, WEN Juan, SHI Shuzhen, DONG Mengping, LIU Xue. Aspect Category Classification Integrated in Syntactic Dependency and BERT-Att-BiLSTM [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 123-128.
[3]	XIE Lixia, LIU Siyu, YANG Hongyu, ZHANG Liang. A Software Defect Assessment Method with Classification Cost [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 116-122.
[4]	. Traditional clothing image classification algorithm based on multi-layer discriminant dictionary learning [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(2): 104-108.
[5]	. Traditional Chinese Medicine Symptom Normalization Approach Based on Pre-trained Language Models [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 14-20.
[6]	XIE Yonghong, TAO Hu, JIA Qi, YANG Shibing, HAN Xinliang. Traditional Chinese Medicine Symptom Normalization Approach Based on Pre-Trained Language Models [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 13-18,57.
[7]	CHAO Hao, MA Qingmin, LIU Yongli. EEG-Based Emotion Recognition by Using Convolutional Echo-State Network [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 36-43.
[8]	LI Jian-gui, LIANG Yue, GAO Peng-fei, LIU Shao-hua, MA Ying-long. A Hierarchical Category Embedding Based Approach for Fault Classification of Power ICT System [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(4): 34-40.
[9]	CAO Yi, HUANG Zi-long, SHENG Yong-jian, LIU Chen, FEI Hong-bo. Noise Robust Urban Audio Classification Based on 2-Order Dense Convolutional Network Using Dual Features [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 86-91.
[10]	LIU Yi-chen, SUN Hua-zhi, MA Chun-mei, JIANG Li-fen, ZHONG Chang-hong. Commodity Classification of Online Based on High-Level Feature Fusion [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 98-104,117.
[11]	CHANG Zi-ying, WANG Wen-han, LI Tao, LIU Fen, CHEN Peng-peng. A Fingerprint Localization Method Based on Shapelet Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(4): 95-100.
[12]	JIANG Fang, ZHANG Nan-fei, HU Yan-jun, WANG Yi. BP Neural Network Based CSI Device-Free Target Classification Method [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(1): 40-45.
[13]	FU Qun-chao, WANG Cong. Based on Multiple Probing Tasks Fine-Tuning of Language Models for Text Classification [J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 76-83.
[14]	LIU Han. Spam Web Detection Based on Hybrid-Sampling and Genetic Algorithm [J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 111-117.
[15]	PENG Cong, SUN Yan, QI Peng. Label Relevance Based Multi-Label Scratch Classification Algorithm [J]. JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM, 2019, 42(6): 134-141.