Dynamic Gesture Recognition Based on Characteristics of Encoded Video Data

doi:10.13190/j.jbupt.2020-056

Journal of Beijing University of Posts and Telecommunications ›› 2020, Vol. 43 ›› Issue (5): 91-97.doi: 10.13190/j.jbupt.2020-056

• PAPERS • Previous Articles Next Articles

Dynamic Gesture Recognition Based on Characteristics of Encoded Video Data

XIE Xiao-yan¹, ZHAO Huan¹, JIANG Lin²

1. School of Computer, Xi'an University of Posts&Telecommunications, Xi'an 710121, China;
2. Integrated Circuit Design Laboratory, Xi'an University of Science and Technology, Xi'an 710054, China

Received:2020-06-07 Published:2021-03-11

Abstract

Abstract: Aiming at the challenges to scene adaptability and computational complexity of dynamic gesture recognition, a method based on characteristics of encoded video data is proposed. Firstly, density-based spatial clustering of applications with noise is used to extract motion trend features from motion vectors. Then, the motion trends are classified by random forest. Finally, combined by the hand shape features extracted by convolutional neural network(CNN), the dynamic gesture is recognized. The experiment shows that the proposed method has an average recognition rate of 94.22% and 94.48% respective for university of Cambridge and Northwestern University hand gesture data sets. Compared with the scheme combine of CNN and long short-term memory, the gesture recognition time is reduced by 85%. It can still maintain a higher recognition rate for the complex background with insufficient illumination, represents a higher robustness.

Key words: dynamic gesture recognition, motion vector, density-based spatial clustering of applications with noise, random forest, convolutional neural network

CLC Number:

TP391.4

XIE Xiao-yan, ZHAO Huan, JIANG Lin. Dynamic Gesture Recognition Based on Characteristics of Encoded Video Data[J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 91-97.

References

[1] Deller M, Ebert A, Bender M, et al. Flexible gesture recognition for immersive virtual environments[C]//IV'06. London:IEEE, 2006:563-568.
[2] Elmezain M, Al-Hamadi A, Michaelis B. Hand trajectory-based gesture spotting and recognition using HMM[C]//ICIP. Cairo:IEEE, 2009:3577-3580.
[3] Barros P, Maciel-Junior N T, Fernandes B J T, et al. A dynamic gesture recognition and prediction system using the convexity approach[J]. CVIU, 2017, 155:139-149.
[4] Tang Hao, Liu Hong, Xiao Wei, et al. Fast and robust dynamic hand gesture recognition via key frames extraction and feature fusion[J]. Neurocomputing, 2019, 331:424-433.
[5] Patil A R, Subbaraman S. A spatiotemporal approach for vision-based hand gesture recognition using Hough transform and neural network[J]. Signal, Image and Video Processing, 2019, 13(2):413-421.
[6] Gatto B B, dos Santos E M, Da Silva W S. Orthogonal Hankel subspaces for applications in gesture recognition[C]//SIBGRAPI. Niteroi:IEEE, 2017:429-435.
[7] Molchanov P, Gupta S, Kim K, et al. Hand gesture recognition with 3D convolutional neural networks[C]//CVPR. Boston:IEEE, 2015:1-7.
[8] Lu Dongwei, Qiu Chu, Xiao Yi. Temporal convolutional neural network for gesture recognition[C]//ICIS. Singapore:IEEE, 2018:367-371.
[9] Muralidhar P, Rao C B R. Analysis of block matching motion estimation algorithms[C]//ICCCNT. Tiruchengode:IEEE, 2013:1-4.
[10] Singha J, Roy A, Laskar R H. Dynamic hand gesture recognition using vision based approach for human-computer interaction[J]. Neural Computing and Applications, 2018, 29(4):1129-1141.
[11] 杨真真, 匡楠, 范露, 等. 基于卷积神经网络的图像分类算法综述[J]. 信号处理, 2018, 34(12):1474-1489. Yang Zhenzhen, Kuang Nan, Fan Lu, et al. Review of image classification algorithms based on convolutional neural networks[J]. Journal of Signal Processing, 2018, 34(12):1474-1489.
[12] Kim T K, Cipolla R. Canonical correlation analysis of video volume tensors for action categorization and detection[J]. TPAMI, 2009, 31(8):1415-1428.
[13] Shen Xiaohui, Hua Gang, Williams L, et al. Dynamic hand gesture recognition:an exemplar-based approach from motion divergence fields[J]. Image and Vision Computing, 2012, 30(3):227-235.

[1]	run jiayu. A Deep Learning-Based DoA Estimation Method in Low SNR [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(6): 119-125.
[2]	YE Kang, ZHANG Shujun, GUO Qi, LI Hui, CUI Xuehong. Continuous Sign Language Recognition Based on CM-Transformer [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(5): 49-53,78.
[3]	. Design of Three-dimensional Convolution Neural Network Model for Intelligent Aided Diagnosis of Coarctation of Aorta [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 1-6.
[4]	WU Xingkun, LUO Tao, LIU Aijun, YANG Ming, ZHANG Wenjing. Design of Neural Network Model for Auxiliary Diagnosis of Coarctation of Aorta [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 1-6.
[5]	XU Tongle, MENG Liang, KONG Xiaojia, SU Yuanhao, SUN Yanfei. ICNN Fault Diagnosis Method Based on EEMD [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 110-116.
[6]	LI Xiaohui, WANG Xianwen, FAN Tao, LIU Jiawen, WAN Hongjie. A High-Performance Downlink Synchronization Algorithm Based on Convolutional Neural Network for 5G Systems [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 117-123.
[7]	PU Yun-wei, GUO Jiang, LIU Tao-tao, WU Hai-xiao. A Recognition Method for Radar Emitter Signals Based on Convolutional Neural Network with Multiple Learning Units [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(6): 74-82.
[8]	LIU Yong-li, ZHU Ya-meng, CHAO Hao. Hyperparameter Optimization of Convolutional Neural Network Based on Multi-Strategy MRFO Algorithm [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(6): 83-88,95.
[9]	WANG Yi-fei, MO Shuang, WU Wen-rui, FAN Shao-hua, XIAO Ding. Internal-External Convolutional Networks for Network Intrusion Detection [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(5): 94-100.
[10]	YI Qian, LI Wei, YI Shu-ping, XIE Jun-dong. Trustworthy Identity Authentication Based on Joint Time-Frequency Analysis of Mouse Behavior [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(4): 121-128.
[11]	LIU Guo-zhen, CHEN Hong-long. Convolutional Memory Graph Collaborative Filtering [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(3): 21-26.
[12]	PENG Peng, LI Zhuo, LIANG Ji-feng, MA Tian-xiang, LIU Kai-hua. Research on Pending Interest Table of Named Data Networking Supporting Interest Flooding Attack Detection [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(2): 61-67.
[13]	PU Yue-yi, WANG Wen-han, ZHU Qiang, CHEN Peng-peng. Urban Short-Term Traffic Flow Prediction Algorithm Based on CNN-ResNet-LSTM Model [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 9-14.
[14]	Lü Xing-feng, LI Jin-bao. A Method of Detecting Sleep Apnea Using Random Forest [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 64-70.
[15]	WEI Juan, GU Xing-quan, NING Fang-li. An Abnormal Sound Recognition Method Based on EEMD [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 112-117.

Dynamic Gesture Recognition Based on Characteristics of Encoded Video Data

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments