Search by item HOME > Access full text > Search by item

JBE, vol. 25, no. 5, pp.776-788, September, 2020

DOI: https://doi.org/10.5909/JBE.2020.25.5.776

Proposal for License Plate Recognition Using Synthetic Data and Vehicle Type Recognition System

Seungju Lee and Gooman Park

C.A E-mail: gmpark@seoultech.ac.kr

Abstract:

In this paper, a vehicle type recognition system using deep learning and a license plate recognition system are proposed. In the existing system, the number plate area extraction through image processing and the character recognition method using DNN were used. These systems have the problem of declining recognition rates as the environment changes. Therefore, the proposed system used the one-stage object detection method YOLO v3, focusing on real-time detection and decreasing accuracy due to environmental changes, enabling real-time vehicle type and license plate character recognition with one RGB camera. Training data consists of actual data for vehicle type recognition and license plate area detection, and synthetic data for license plate character recognition. The accuracy of each module was 96.39% for detection of car model, 99.94% for detection of license plates, and 79.06% for recognition of license plates. In addition, accuracy was measured using YOLO v3 tiny, a lightweight network of YOLO v3.



Keyword: YOLO, Synthetic Data Generation, Object Detection, Text Recognition

Reference:
[1] Jung-Hwan Kim, Joonhong Lim, “License Plate Detection and Recognition Algorithm using Deep Learning,” Journal of IKEEE, 2019, 23.2: 642-651, http://dx.doi.org/10.7471/ikeee.2019.23.2.642
[2] Xuan-Truong Dang, Eung-Tae Kim, “Robust Motorbike License Plate Detection and Recognition using Image Warping based on YOLOv2,” JOURNAL OF BROADCAST ENGINEERING, 2019, 24.5: 713-725, https://doi.org/10.5909/JBE.2019.24.5.713
[3] REDMON, Joseph
FARHADI, Ali, “Yolov3: An incremental improvement,” arXiv preprint arXiv:1804.02767, 2018.
[4] GIRSHICK, Ross, et al, “Rich feature hierarchies for accurate object detection and semantic segmentation,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 580-587, 2014.
[5] GIRSHICK, Ross, “Fast r-cnn,” Proceedings of the IEEE international conference on computer vision, pp. 1440-1448, 2015.
[6] REN, Shaoqing, et al, “Faster r-cnn: Towards real-time object detection with region proposal networks,” Advances in neural information processing systems, pp. 91-99, 2015.
[7] HE, Kaiming, et al, “Mask r-cnn,” Proceedings of the IEEE international conference on computer vision, pp. 2961-2969, 2017.
[8] REDMON, Joseph, et al, “You only look once: Unified, real-time object detection,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 779-788, 2016.
[9] REDMON, Joseph
FARHADI, Ali, “YOLO9000: better, faster, stronger,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7263-7271, 2017.
[10] LIU, Wei, et al, “Ssd: Single shot multibox detector,” European conference on computer vision, Springer, Cham, pp. 21-37, 2016, https://doi.org/10.1007/978-3-319-46448-0_2.
[11] NEUMANN, Lukas
MATAS, Jiri, “Real-time scene text localization and recognition,” 2012 IEEE Conference on Computer Vision and Pattern Recognition, IEEE, pp. 3538-3545, 2012, doi:10.1109/CVPR. 2012.6248097.
[12] JADERBERG, Max, et al, “Reading text in the wild with convolutional neural networks,” International journal of computer vision, 116.1: 1-20, 2016, doi:10.1007/s11263-015-0823-z.
[13] GUPTA, Ankush
VEDALDI, Andrea
ZISSERMAN, Andrew, “Synthetic data for text localisation in natural images,” Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2315-2324, 2016.
[14] LOWE, David G, “Distinctive image features from scale-invariant keypoints,” International journal of computer vision, 60.2: 91-110, 2004, https://doi.org/10.1023/B:VISI.0000029664.99615.94.
[15] RUBLEE, Ethan, et al, “ORB: An efficient alternative to SIFT or SURF,” 2011 International conference on computer vision, Ieee, pp. 2564-2571, 2011, doi:10.1109/ICCV.2011.6126544.
[16] MUJA, Marius
LOWE, David G, “Scalable nearest neighbor algorithms for high dimensional data,” IEEE transactions on pattern analysis and machine intelligence, 36.11: 2227-2240, 2014, doi:10.1109/ CRV. 2012.60.
[17] Seungju Lee, Gooman Park, “Proposal for Deep Learning based Character Recognition System by Virtual Data Generation,” JOURNAL OF BROADCAST ENGINEERING, 25.2: 275-278. 2020, https://doi.org/10.5909/JBE.2020.25.2.275.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved