Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

Journal of Beijing University of Posts and Telecommunications ›› 2023, Vol. 46 ›› Issue (4): 83-90.

Previous Articles     Next Articles

The Method of Multivariable Time Series Representation Learning Combining Reconstruction with Contrasting

HUO Weigang1, MENG Lu1, GUO Runxia2   

  • Received:2022-07-26 Revised:2022-09-03 Online:2023-08-28 Published:2023-08-24
  • Contact: 霍纬纲 HuoWeigang E-mail: wghuo@ cauc. edu. cn

Abstract: The spatiotemporal coupling features of a single multivariate time series(MTS) sample and the invariant discriminative features between the MTS samples can not be simultaneously captured by most of the existing self-supervised representation learning models for MTS. To this end, the MTS representation learning model combining reconstruction with contrasting ( MTS-RC ) is proposed. First, the MTS samples are augmented through binary noise masks, and then the local context features of the MTS and its augmented samples and long-term time-dependent relationship of local context features are respectively extracted by dilated convolution and transformer encoder. Finally, the spatiotemporal coupling characteristics of a single MTS sample are captured by reconstructing the mask value of augmented samples, and the MTS invariant discriminative characteristics are extracted between samples by contrastive learning. Experiments on classification on multiple MTS public datasets show that the classification accuracy of the classifier trained by the representation vector obtained from the MTS-RC outperforms typical baseline models. The results of ablation experiments show that the quality of MTS representation vector can be improved by the combined design of reconstruction and contrasting.

Key words: multivariate time series representation learning, self-supervised learning, reconstruction, contrastive learning

CLC Number: