Character Detection Method for PCB Image Based on Deep Learning

doi:10.13190/j.jbupt.2021-109

Journal of Beijing University of Posts and Telecommunications ›› 2022, Vol. 45 ›› Issue (1): 108-114.doi: 10.13190/j.jbupt.2021-109

• REPORTS • Previous Articles Next Articles

Character Detection Method for PCB Image Based on Deep Learning

ZHANG Binyu, ZHAO Yanyun, DU Yunhao, WAN Junfeng, TONG Zhihang

School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China

Received:2021-06-11 Online:2022-02-28 Published:2021-12-16

Abstract

Abstract: Retrieve the printed circuit board (PCB) image with characters is an effective method for PCB fragments tracing. To this end, a high-performance character detection method for PCB images is proposed, which adopts feature pyramid network based on residual network and has two detecting heads to predict character distribution heatmaps. The local pattern consistency loss function is introduced to optimize the network model. A heatmap generation algorithm of character region for network training is presented. A series of strategies are adopted, such as data augmentation and multi-scale detection, which increases the performance of character detection. The test results on PCB image set show that the character detection accuracy is 95.6% and the recall rate is 92.4%. Especially, F1 score can reach 93.6%, which exceeds the comparison methods, proving that the proposed comprehensive detection method outperforms the state of the art methods of character detection in natural scene images.

Key words: printed circuit board image, character detection, deep learning

CLC Number:

TP391.4

ZHANG Binyu, ZHAO Yanyun, DU Yunhao, WAN Junfeng, TONG Zhihang. Character Detection Method for PCB Image Based on Deep Learning[J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(1): 108-114.

References

[1] XING L J, TIAN Z, HUANG W L, et al. Convolutional character networks[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. Seoul:IEEE, 2019:9126-9136.
[2] ZHOU X Y, YAO C, WEN H, et al. East:an efficient and accurate scene text detector[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii:IEEE, 2017:5551-5560.
[3] LONG S B, RUAN J Q, ZHANG W J, et al. Textsnake:a flexible representation for detecting text of arbitrary shapes[C]//Proceedings of the European Conference on Computer Vision (ECCV). Munich:Springer, 2018:20-36.
[4] WANG Q T, ZHENG Y, BETKE M. A method for detecting text of arbitrary shapes in natural scenes that improves text spotting[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Seattle:IEEE, 2020:540-541.
[5] LIAO M H, WAN Z Y, YAO C, et al. Real-time scene text detection with differentiable binarization[C]//Proceedings of the AAAI Conference on Artificial Intelligence. New York:PKP, 2020:11474-11481.
[6] BAEK Y, LEE B, HAN D, et al. Character region awareness for text detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. California:IEEE, 2019:9365-9374.
[7] WANG W H, XIE E Z, LI X, et al. Pan++:towards efficient and accurate end-to-end spotting of arbitrarily-shaped text[EB/OL]. (2021-05-04)[2021-05-31]. https://ieeexplore.ieee.org/abstract/document/9423611.
[8] LI W, NEULLENS S, BREIER M, et al. Text recognition for information retrieval in images of printed circuit boards[C]//IECON 2014-40th Annual Conference of the IEEE Industrial Electronics Society. Dallas:IEEE, 2014:3487-3493.
[9] ZHANG B Y, ZHAO Y Y, DU Y H, et al. PCB-TD:PCB image dataset[EB/OL]. (2021-05-31)[2021-05-31]. https://mcprl.com/html/dataset/PCBTD.html.
[10] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[C]//3rd International Conference on Learning Representations (ICLR). San Diego:OpenReview, 2015:1-14.
[11] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recog-nition. Las Vegas:IEEE, 2016:770-778.
[12] WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment:from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4):600-612.
[13] CAO X K, WANG Z P, ZHAO Y Y, et al. Scale aggregation network for accurate and efficient crowd counting[C]//Proceedings of the European Conference on Computer Vision (ECCV). Munich:Springer, 2018:734-750.
[14] KARATZAS D, GOMEZ-BIGORDA L, NICOLAOU A, et al. ICDAR 2015 competition on robust reading[C]//2015 13th International Conference on Document Analysis and Recognition (ICDAR). Tunis:IEEE, 2015:1156-1160.
[15] SHI B G, YANG M K, WANG X G, et al. Aster:an attentional scene text recognizer with flexible rectification[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 41(9):2035-2048.

Character Detection Method for PCB Image Based on Deep Learning

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments

[1]	LIU Yang, TENG Yinglei, NIU Tao, ZHI Jialin. Filter Pruning Algorithm Based on Deep Reinforcement Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 31-36.
[2]	. Multi-Mode Guided Point Cloud Completion Method in Complex Environment [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(3): 103-108.
[3]	RONG Zhenyu, LIU Jianyi. Retinal Blood Vessel Segmentation Based on Transformer and MLP [J]. Journal of Beijing University of Posts and Telecommunications, 2023, 46(1): 26-31.
[4]	LIU Jintong, YANG Guoxing, LIU Xiaohong, WANG Guangyu. Smoothing Attack Algorithm Based on Electrocardiogram Classification [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 44-50.
[5]	HUANG Liuting, LIU Kexin, NIU Kai, CHANG Chun, HE Zhiqiang. Automatic Recognition of Mucus Impaction in CT Images of Asthmatic Patients Using Deep Learning [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(4): 58-63.
[6]	LIU Changyuan, HU Haoyuan, BI Xiaojun. Driver Distraction Recognition Using Bilinear Fusion Networks [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 79-84.
[7]	ZHANG Chongsheng, CHEN Jie, ZONG Ruixing, YANG Shuailei, FAN Gaojuan. Transformer Based Scene Character Detection over Low Quality Images [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(2): 124-130.
[8]	ZHAO Haiying, ZHU Hui, HOU Xiaogang. Traditional Custume Image Semantic Segmentation Based on Improved EMA Unit [J]. Journal of Beijing University of Posts and Telecommunications, 2022, 45(1): 69-74.
[9]	JIA Jun, FENG Chun-yan, XIA Hai-lun, ZHANG Tian-kui, LI Cheng-gang. Communication Networks Fault Prediction Method Based on Sample Equalization and Feature Interaction [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(6): 59-66.
[10]	PU Yun-wei, GUO Jiang, LIU Tao-tao, WU Hai-xiao. A Recognition Method for Radar Emitter Signals Based on Convolutional Neural Network with Multiple Learning Units [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(6): 74-82.
[11]	WANG Yi-fei, MO Shuang, WU Wen-rui, FAN Shao-hua, XIAO Ding. Internal-External Convolutional Networks for Network Intrusion Detection [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(5): 94-100.
[12]	GAO Hui, ZHANG Ji-wei, LAI Yang, WANG Wen-dong. Deep Learning Based Semi-Automatic Labeling System for Human Images [J]. Journal of Beijing University of Posts and Telecommunications, 2021, 44(1): 104-109.
[13]	PU Yue-yi, WANG Wen-han, ZHU Qiang, CHEN Peng-peng. Urban Short-Term Traffic Flow Prediction Algorithm Based on CNN-ResNet-LSTM Model [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 9-14.
[14]	MA Xiang-liang, LI Bing, YANG Dan, HUANG Ke-zhen, DUAN Xiao-yi. Reverse-Analysis of S-Box for SM4-Like Algorithms Based on Side Channel Technology [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(5): 118-124.
[15]	ZHANG Tian-qi, KANG Bo, MENG Xiang-fei, LIU Yi-lin, ZHOU Ying. U-Net Based Intracranial Hemorrhage Recognition [J]. Journal of Beijing University of Posts and Telecommunications, 2020, 43(3): 92-98.