EEG-Based Emotion Recognition by Using Convolutional Echo-State Network

doi:10.13190/j.jbupt.2021-078

Journal of Beijing University of Posts and Telecommunications ›› 2022, Vol. 45 ›› Issue (2): 36-43.doi: 10.13190/j.jbupt.2021-078

• PAPERS • Previous Articles Next Articles

EEG-Based Emotion Recognition by Using Convolutional Echo-State Network

CHAO Hao, MA Qingmin, LIU Yongli

College of Computer Science and Technology, Henan Polytechnic University, Jiaozuo 454003, China

Received:2021-04-28 Published:2021-12-16

Abstract

Abstract: A convolutional echo-state network (CESN) model is proposed for the emotion recognition task based on electroencephalogram (EEG) signals. First, a feature matrix sequence of EEG signal is constructed. Then, high-level abstract features are extracted from the feature matrices via convolution, and one dimension feature vectors are formed. After that, a reservoir with self-feedback function is employed to extract the dynamic temporal information from the feature vector sequence. Finally, the emotion recognition task is realized by ridge regression. The experiment is carried out on the database for emotion analysis using physiological signals datasets. The experiment result shows that the EEG signal segments contain temporal information related to emotion, and the CESN model can mine and utilize the information effectively. In addition, the proposed CESN model can circumvent the problems of the local optimization and long training time, which are caused by back propagation algorithm in convolutional neural network.

Key words: multi-channel electroencephalogram signal, emotion classification, convolutional echo-state network, feature confusion

CLC Number:

TP18

CHAO Hao, MA Qingmin, LIU Yongli. EEG-Based Emotion Recognition by Using Convolutional Echo-State Network[J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 36-43.

References

[1] HWANG S, HONG K, SON G, et al. Learning CNN features from DE features for EEG-based emotion recognition[J]. Pattern Analysis and Applications, 2020, 23(3):1323-1335.
[2] ER M, CIG H, AYDILEK B B. A new approach to recognition of human emotions using brain signals and music stimuli[J/OL]. Applied Acoustics, 2021, 175:107840-107856[2021-03-12]. https://doi.org/10.1016/j.apacoust.2020.107840.
[3] CAO Q C, ZHANG W L, ZHU Y H. Deep learning-based classification of the polar emotions of "moe" -style cartoon pictures[J]. Tsinghua Science and Technology, 2021, 26(3):275-286.
[4] KEELAWAT P, THAMMASAN N, NUMAO M, et al. A comparative study of window size and channel arrangement on EEG-emotion recognition using deep CNN[J]. Sensors, 2021, 21(5):1678-1696.
[5] PERI R, PARTHASARATHY S, BRADSHAW C, et al. Disentanglement for audio-visual emotion recognition using multitask setup[EB/OL].(2021-03-11)[2021-03-24]. https://arxiv.org/abs/2102.06269.
[6] ABBASCHIAN B J, SIERRA S D, ELMAGHRABY A. Deep learning techniques for speech emotion recognition, from databases to models[J/OL]. Sensors, 2021, 21(4):1249-1275[2021-03-23]. https://www.mdpi.com/1424-8220/21/4/1249.
[7] JIA X, ZHANG T, PHILIP Chen C L, et al. Multi-channel EEG based emotion recognition using temporal convolutional network and broad learning system[C]//2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Piscataway, NJ:IEEE Press, 2020:2452-2457.
[8] XIN Q, HU S H, LIU S Q, et al. Epilepsy EEG classification based on convolution support vector machine[J]. Journal of Medical Imaging and Health Informatics, 2021, 11(1):25-32.
[9] YANG Y L, WU Q F, FU Y Z, et al. Continuous convolutional neural network with 3D input for EEG-based emotion recognition[C]//International Conference on Neural Information Processing. Berlin:Springer, 2018:433-443.
[10] CHEN J X, WANG L Y, JIA X Y, et al. EEG-based emotion recognition using deep convolutional neural network[J]. Computer Engineering and Applications, 2019, 55(18):103-110.
[11] GONZALEZ H A, MUZAFFAR S, YOO J, et al. BioCNN:a hardware inference engine for EEG-based emotion detection[J/OL]. IEEE Access, 2020, 8:140896-140914[2021-03-17]. https://ieeexplore.ieee.org/document/9151874.
[12] JAEGER H, HAAS H. Harnessing nonlinearity:predicting chaotic systems and saving energy in wireless communication[J]. Science, 2004, 304(5667):78-80.
[13] LUKOEVIIUS M L, JAEGER H, SCHRAUWAN H. Reservoir computing trends[J]. KI-Künstliche Intelligenz, 2012, 26(4):365-371.
[14] GAO R, DU L, DURU O, et al. Time series forecasting based on echo state network and empirical wavelet transformation[J/OL].Applied Soft Computing,2021,102:107111-107122[2021-03-19]. https://doi.org/10.1016/j.asoc.2021.107111.
[15] SUN L L, JIN B, YANG H Y, et al. Unsupervised EEG feature extraction based on echo state network[J]. Information Sciences, 2018, 475:1-17.
[16] FOURATI R, AMMAR B, SANCHEZ M J, et al. Unsupervised learning in reservoir computing for EEG-based emotion recognition[J]. IEEE Transactions on Affective Computing, 2020, 99:1-13.
[17] HART A G, OLDING K R, COX A, et al. Echo state networks for reinforcement learning[J]. Journal of Machine Research, 2000, 1:1-48.
[18] LI X, SONG D W, ZHANG P, et al. Emotion recognition from multi-channel EEG data through convolutional recurrent neural network[C]//Proceedings of IEEE International Conference on Bioinformatics and Biomedicine. Piscataway, NJ:IEEE Press, 2016:352-359.
[19] HADEEL H A, ANDERSON A K, ASSAF K. Comparing three models of arousal in the human brain[J]. Social Cognitive and Affective Neuroscience, 2020, 15(1):1-11.
[20] TRIPATHI S, ACHARYA S, SHARMA R D, et al. Using deep and convolutional neural networks for accurate emotion classification on DEAP dataset[C]//Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. Palo Alto:AAAI Press, 2017, 7:4746-4752.
[21] ALTURKI F A, ALSHARABI K, ABDURRAGEBD A M, et al. EEG signal analysis for diagnosing neurological disorders using discrete wavelet transform and intelligent techniques[J]. Sensors, 2020, 20(9):2505-2521.

EEG-Based Emotion Recognition by Using Convolutional Echo-State Network

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	ZHANG Tiankui, CAI Changli, LUO Xiaoliang, ZHU Yutao. Multi-Scale Feature Transformer Based Fine-Grained Image Classification Method [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 70-75.
[2]	HUO Weigang, MENG Lu, GUO Runxia. The Method of Multivariable Time Series Representation Learning Combining Reconstruction with Contrasting [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 83-90.
[3]	BAO Qianhui, WEN Juan, SHI Shuzhen, DONG Mengping, LIU Xue. Aspect Category Classification Integrated in Syntactic Dependency and BERT-Att-BiLSTM [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 123-128.
[4]	ZHOU Yuhao, SUN Zhe, WU Xiaofei, YU Ke. Chinese Spelling Correction Model Based on Gated Feature Fusion [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 91-96,122.
[5]	SU Xing, YU Ke, WU Xiaofei. Gated Interactive Fusion Network for Rumor Detection [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(4): 97-102.
[6]	张涛 Ma Chunmei. Research on Behavior Recognition Based on Key-frame Sampling for Heterogeneous Time Series Data [J]. Journal of Beijing University of Posts and Telecommunications, 0, (): 0-0.
[7]	Qi-Wei GONG. PERC Roberta：Emotion Recognition in Conversation using ERC Roberta with Learning [J]. Journal of Beijing University of Posts and Telecommunications, 0, (): 0-0.
[8]	SUN Yanhua, SHI Yahui, WANG Zhuwei, LI Meng, SI Pengbo. A Personalized Federated Learning Algorithm Based on Meta-Learning and Knowledge Distillation [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(1): 12-18.
[9]	YAO Rihui, CHEN Wenbai, CHEN Qili, WU Peiliang. Construction and Application of Knowledge Graph for Home Service Robot [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(5): 72-78.
[10]	YANG Jie, ZHANG Shujie. Defect Recognition of Printed Circuit Board Based on YOLOv3-Dense [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(5): 42-48.
[11]	LIU Shaohua, SUN Jingkai, WANG Yisu, LIU Haibo, MAO Tianlu. Human Trajectory Prediction by Multi-resolution Interaction [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(5): 1-6.
[12]	LIU Jintong, YANG Guoxing, LIU Xiaohong, WANG Guangyu. Smoothing Attack Algorithm Based on Electrocardiogram Classification [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 44-50.
[13]	HUANG Liuting, LIU Kexin, NIU Kai, CHANG Chun, HE Zhiqiang. Automatic Recognition of Mucus Impaction in CT Images of Asthmatic Patients Using Deep Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 58-63.
[14]	WU Xingkun, LUO Tao, LIU Aijun, YANG Ming, ZHANG Wenjing. Design of Neural Network Model for Auxiliary Diagnosis of Coarctation of Aorta [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 1-6.
[15]	XIE Pan, PENG Caijing, HE Zhihui, ZHANG Yuan. A Sleep Staging Method Combining Grouping Convolution with Semi-Supervised Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 7-12.