Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

JOURNAL OF BEIJING UNIVERSITY OF POSTS AND TELECOM ›› 2016, Vol. 39 ›› Issue (4): 1-6.doi: 10.13190/j.jbupt.2016.04.001

• Papers •     Next Articles

Video Super-Resolution Algorithm Based on Spatial-Temporal Feature and Neural Network

LI Ling-hui1, DU Jun-ping1, LIANG Mei-yu1, REN Nan1, JangMyung Lee2   

  1. 1. School of Computer Science, Beijing University of Posts and Telecommunications, Beijing 100876, China;
    2. Department of Electronics Engineering, Korea Pusan National University, Busan, Korea
  • Received:2016-01-19 Online:2016-08-28 Published:2016-08-28

Abstract: A video super-resolution algorithm based on spatial-temporal feature and neural network(STCNN) was proposed to improve the video visual resolution quality and details clarity. This algorithm comprehensively utilizes the correlation mapping relationship among external correlative blocks and the non-local similarity existed in the spatial-temporal neighboring internal blocks, thereafter, reconstructs the video details efficiently with the fitting parameters learned by deep convolutional neural network. Spatial-temporal feature similarities are introduced to optimize the reconstruction results, and to resolve the miss-match problem and improve the super-resolution performance by making full use of the complementary and redundant relationship between low-resolution video frames. Experiments demonstrate that the proposed algorithm outperforms existing algorithms in terms of both subjective visual effects and objective evaluation index.

Key words: super-resolution reconstruction, deep convolution neural network, spatial-temporal feature, non-local similarity

CLC Number: