Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Efficient and unified license plate recognition via lightweight deep neural network

In this study, the authors are interested in building a unified deep learning framework to solve the recognition problem of both single-line and double-line car license plates. Most existing methods are designed for single-line license plate recognition. For double-line cases, detection and segmentation are usually adopted firstly to locate each line of characters. These methods are usually environmentally sensitive and will bring propagation of error between segmentation and recognition. To solve the problems, the authors propose a unified method that can recognise both single-line and double-line license plates in an end-to-end way without line segmentation and character segmentation. Specifically, an improved lightweight convolutional neural network is used to extract features efficiently. Then, the multi-task learning strategy is used to simultaneously perform license plate classification and character recognition. Finally, recognition task is treated as sequence labelling problems, which are solved by connectionist temporal classification directly. Experimental results indicate that the proposed method significantly outperforms the previous state-of-the-art methods on both public datasets and the synthetic dataset.

References

    1. 1)
      • 16. Li, H., Wang, P., Shen, C.: ‘Toward end-to-end car license plate detection and recognition with deep neural networks’, IEEE Trans. Intell. Transp. Syst., 2019, 20, (3), pp. 11261136.
    2. 2)
      • 33. Redmon, J., Farhadi, A.: ‘Yolov3: An incremental improvement’, arXiv:180402767, 2018.
    3. 3)
      • 30. He, K., Zhang, X., Ren, S., et al: ‘Deep residual learning for image recognition’. Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), Las Vegas, NV, USA, 2016.
    4. 4)
      • 26. Dong, M., liang, H., Luo, C., et al: ‘A cnn-based approach for automatic license plate recognition in the wild’. Proc. Conf. British Machine Vision, London, UK, 2017.
    5. 5)
      • 3. Silva, S.M., Jung, C.R.: ‘License plate detection and recognition in unconstrained scenarios’. Proc. Eur. Conf. Comput. Vis. (ECCV), Munich, Germany, 2018.
    6. 6)
      • 11. Yang, Y., Li, D., Duan, Z.: ‘Chinese vehicle license plate recognition using kernel-based extreme learning machine with deep convolutional features’, IET Intell. Trans. Syst., 2018, 12, (3), pp. 213219.
    7. 7)
      • 8. Hendry, , Chen, R.C.: ‘Automatic license plate recognition via sliding-window darknet-yolo deep learning’, Image Vision Comput., 2019, 87, pp. 4756.
    8. 8)
      • 28. Shi, B., Bai, X., Yao, C.: ‘An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition’, IEEE Trans. Pattern Anal. Mach. Intell., 2017, 39, (11), pp. 22982304.
    9. 9)
      • 32. Wei, L., Dragomir, A., Dumitru, E., et al: ‘Ssd: single shot multibox detector’. Proc. Eur. Conf. Comput. Vis. (ECCV), Amsterdam, The Netherlands, 2016.
    10. 10)
      • 21. Hsu, G., Chen, J., Chung, Y.: ‘Application-oriented license plate recognition’, IEEE Trans. Veh. Technol., 2013, 62, (2), pp. 552561.
    11. 11)
      • 20. Goel, S., Dabas, S.: ‘Vehicle registration plate recognition system using template matching’. Proc. Int. Conf. Signal Process. Commun. (ICSC), Noida, India, 2013, pp. 315318.
    12. 12)
      • 5. Wang, D., Tian, Y., Geng, W., et al: ‘Lpr-net: recognizing chinese license plate in complex environments’, Pattern Recognit. Lett., 2020, 130, pp. 148156.
    13. 13)
      • 31. Huang, G., Liu, Z., van der Maaten, L., et al: ‘Densely connected convolutional networks’. Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), Honolulu, HI, USA, 2017.
    14. 14)
      • 2. Zhuang, J., Hou, S., Wang, Z., et al: ‘Towards human-level license plate recognition’. Proc. Eur. Conf. Comput. Vis. (ECCV), Munich, Germany, 2018.
    15. 15)
      • 22. Gou, C., Wang, K., Yao, Y., et al: ‘Vehicle license plate recognition based on extremal regions and restricted boltzmann machines’, IEEE Trans. Intell. Transp. Syst., 2016, 17, (4), pp. 10961107.
    16. 16)
      • 15. Li, H., Wang, P., You, M., et al: ‘Reading car license plates using deep neural networks’, Image Vision Comput., 2018, 72, pp. 1423.
    17. 17)
      • 24. Bulan, O., Kozitsky, V., Ramesh, P., et al: ‘Segmentation- and annotation-free license plate recognition with deep localization and failure identification’, IEEE Trans. Intell. Transp. Syst., 2017, 18, (9), pp. 23512363.
    18. 18)
      • 35. Szegedy, C., Vanhoucke, V., Ioffe, S., et al: ‘Rethinking the inception architecture for computer vision’. Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), Las Vegas, NV, USA, 2016, pp. 28182826.
    19. 19)
      • 17. Zhang, S., Tang, G., Liu, Y., et al: ‘Robust license plate recognition with shared adversarial training network’, IEEE Access, 2020, 8, pp. 697705.
    20. 20)
      • 7. Yue, W., Jianmin, L.: ‘License plate recognition using deep fcn’. Proc. Int. Conf. Cognitive Syst. Signal Process. (ICCSIP), Beijing, People's Republic of China, 2016.
    21. 21)
      • 10. Xu, Z., Yang, W., Meng, A., et al: ‘Towards end-to-end license plate detection and recognition: a large dataset and baseline’. Proc. Eur. Conf. Comput. Vis. (ECCV), Munich, Germany, 2018.
    22. 22)
      • 23. Liu, Y., Huang, H., Cao, J., et al: ‘Convolutional neural networks-based intelligent recognition of chinese license plates’, Soft Comput., 2018, 22, pp. 24032419.
    23. 23)
      • 18. Alex, G., Santiago, F., Faustino, G., et al: ‘Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks’. Proc. Int. Conf. Mach. Learn. (ICML), Pittsburgh, PA, USA, 2006.
    24. 24)
      • 6. Ashtari, A.H., Nordin, M.J., Fathy, M.: ‘An iranian license plate recognition system based on color features’, IEEE Trans. Intell. Transp. Syst., 2014, 15, (4), pp. 16901705.
    25. 25)
      • 13. Rakhshani, S., Rashedi, E., Nezamabadi-pour, H.: ‘Representation learning in a deep network for license plate recognition’, Multimed Tools Appl., 2020, 79, pp. 1326713289.
    26. 26)
      • 19. Wu, H.-H.P., Chen, H.-H., Wu, R.-J., et al: ‘License plate extraction in low resolution video’. Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), Hong Kong, People's Republic of China, 2006, vol. 1, pp. 824827.
    27. 27)
      • 34. Ren, S., He, K., Girshick, R., et al: ‘Faster r-cnn: towards real-time object detection with region proposal networks’, IEEE Trans. Pattern Anal. Mach. Intell., 2017, 39, (6), pp. 11371149.
    28. 28)
      • 14. Wang, J., Huang, H., Qian, X., et al: ‘Sequence recognition of chinese license plates’, Neurocomputing, 2018, 317, pp. 149158.
    29. 29)
      • 27. Wu, S., Zhai, W., Cao, Y.: ‘Pixtextgan: structure aware text image synthesis for license plate recognition’, IET Image Process., 2019, 13, (14), pp. 27442752.
    30. 30)
      • 25. Laroca, R., Severo, E., Zanlorensi, L.A., et al: ‘A robust real-time automatic license plate recognition based on the yolo detector’. Proc. IEEE Int. Joint Conf. Neural Netw. (IJCNN), Rio de Janeiro, Brazil, 2018, pp. 110.
    31. 31)
      • 9. Gao, F., Cai, Y., Ge, Y., et al: ‘Edf-lpr: a new encoder-decoder framework for license plate recognition’, IET Intell. Trans. Syst., 2020, 14, (8), pp. 959969.
    32. 32)
      • 12. Zherzdev, S., Gruzdev, A.: ‘Lprnet: License plate recognition via deep neural networks’, arXiv:180610447, 2018.
    33. 33)
      • 29. Redmon, J., Divvala, S., Girshick, R., et al: ‘You only look once: unified, real-time object detection’. Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR), Las Vegas, NV, USA, 2016, pp. 779788.
    34. 34)
      • 1. Du, S., Ibrahim, M., Shehata, M., et al: ‘Automatic license plate recognition (alpr): a state-of-the-art review’, IEEE Trans. Circuits Syst. Video Technol., 2013, 23, (2), pp. 311325.
    35. 35)
      • 4. Khan, M.A., Sharif, M., Javed, M.Y., et al: ‘License number plate recognition system using entropy-based features selection approach with svm’, IET Image Proc., 2018, 12, (2), pp. 200209.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2020.1130
Loading

Related content

content/journals/10.1049/iet-ipr.2020.1130
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address