北京邮电大学学报

  • EI核心期刊

北京邮电大学学报 ›› 2023, Vol. 46 ›› Issue (5): 93-98.

• 论文 • 上一篇    下一篇

面向异构时序数据的关键帧动态采样行为识别

马春梅2 3,马涛3,史闻东2,雷祥2,赵宏1   

  1. 1.南开大学

    2.珠海华发实业股份有限公司

    3.天津师范大学

  • 收稿日期:2022-09-02 修回日期:2022-11-25 出版日期:2023-10-28 发布日期:2023-11-03
  • 通讯作者: 马春梅 E-mail:mcmxhd@163.com
  • 基金资助:
    天津市教委科研计划项目

Research on Behavior Recognition Based on Key-frame Sampling for Heterogeneous Time Series Data

张 涛1,Ma Chunmei   

  • Received:2022-09-02 Revised:2022-11-25 Online:2023-10-28 Published:2023-11-03
  • Contact: Ma Chunmei E-mail:mcmxhd@163.com

摘要: 摘要:如何从接触式感知数据中准确地识别出各种行为对人机交互的发展至关重要.针对不同行为数据间存在冗余以及标识行为的动作往往只是在一些关键帧的事实,提出基于关键帧动态采样的行为识别网络KDAS(Key-frame DynAmic Sampling Network),旨在挖掘代表行为的关键帧,剔除行为的冗余帧,从数据源提高不同行为的区分度,进而增强它们深层特征的判别性,提高识别精度.首先利用BLSTM网络搭建行为识别的预处理模块,用于原始感知数据状态初始化及获得初始行为预测结果;其次基于每一数据帧的初始化信息,使用BLSTM建立关键帧选择网络,通过该网络预测每一数据帧被选择的概率,进而确定关键帧;最后通过选择的关键帧再进行行为预测,将两次预测结果形成效用函数用于关键帧选择网络的训练.在三个公开数据集UCI HRR、Opportunity、UCI MHEALTH上进行实验,实验结果表明,与现有的几种先进的行为识别模型相比,KDAS能够获得更高的行为识别精度.

关键词: 关 键 词:接触式感知, 行为识别, 异构时序数据, 关键帧, 判别性特征

Abstract: Abstract:It is very important for the development of human-computer interaction that how to accurately recognize various behaviors from the contact sensing data. Based on the fact that there is redundancy between different behavior data and the action of identifying behavior is often only at some key points, a Key-frame DynAmic sampling network KDAS for behavior recognition is proposed, which aims to mine key-frames representing behaviors, eliminate redundant frames of behaviors, and improve the discrimination of different behaviors from the data source. Then, the discrimination of their deep features is enhanced and the recognition accuracy is improved. First, a pre-processing module for behavior recognition based on BLSTM network is established, which is used to initialize the original perceived data state and obtain the initial behavior prediction result. Second, based on the initialization information of each data frame, a key frame selection network is established using BLSTM, through which the probability of each frame being selected is predicted and then the key frame is determined. Finally, the selected key frames are used for behavior prediction again. The two prediction results are used to form a utility function for the key frame selection network training. The experiment is conduct on three public data sets UCI HAR, Opportunity and UCI MHEALTH. The experimental results show that compared with several existing advanced behavior recognition models, KDAS can obtain higher behavior recognition accuracy.

Key words: Key words:contact sensing, behavior recognition, heterogeneous time series data, key fram, discriminative feature

中图分类号: