Journal of Beijing University of Posts and Telecommunications

  • EI核心期刊

Journal of Beijing University of Posts and Telecommunications ›› 2021, Vol. 44 ›› Issue (5): 121-126.doi: 10.13190/j.jbupt.2020-268

• REPORTS • Previous Articles     Next Articles

Two-Stage Network Inpainting Algorithm Based on BDCN and U-net Edge Generation

LI Hai-yan1, WANG Wei-hua1, GUO Lei1, LI Hai-jiang2, LI Hong-song1   

  1. 1. School of Information Science and Engineering, Yunnan University, Kunming 650500, China;
    2. Yunnan Communications Investment and Construction Group Company Limited, Kunming 650299, China
  • Received:2020-07-01 Online:2021-10-28 Published:2021-09-06

Abstract: To repair the large irregular missing areas of an image, and obtain reasonable structure and fine-detailed textures,a two-stage network image inpainting algorithm based on bi-directional cascade network (BDCN) for perceptual edge detection and U-net incomplete edge generation is proposed. Firstly,the algorithm edges are extracted using the BDCN network. In the first stage,down-sampling is used to extract the features of the missing image edges based on the edge generation network of the U-net network architecture. The information inputted by the up-sampling layer and the information of each down-sampling layer is then combined to restore the image edge texture details. In the second stage,the hole convolution is applied for down-sampling and up-sampling,which adopts the residual network to reconstruct the missing image with rich details. The proposed algorithm is compared with the existing classic algorithm on the public datasets. Experimental results demonstrate that the proposed algorithm can obtain reasonable results and fine texture details,and its performance is superior to those of the contrast algorithms.

Key words: image inpainting, bi-directional cascade network for perceptual edge detection, U-net incomplete edge generator, the two-stage network

CLC Number: