© The Institution of Engineering and Technology
Face recognition is a challenging and innovative research topic in the present sophisticated world of visual technology. In most of the existing approaches, the face recognition from the still images is affected by intra-personal variations such as pose, illumination and expression which degrade the performance. This study proposes a novel approach for video-based face recognition due to the availability of large intra-personal variations. The feature vector based on the normalised semi-local binary patterns is obtained for the face region. Each frame is matched with the signature of the faces in the database and a rank list is formed. Each ranked list is clustered and its reliability is analysed for re-ranking. To characterise an individual in a video, multiple re-ranked lists across the multiple video frames are fused to form a video signature. This video signature embeds diverse intra-personal and temporal variations, which facilitates in matching two videos with large variations. For matching two videos, their video signatures are compared using Kendall-Tau distance. The developed methods are deployed on the YouTube and ChokePoint videos, and they exhibit significant performance improvement owing to their approach when compared with the existing techniques.
References
-
-
1)
-
19. Cui, Z., Li, W., Xu, D., et al: ‘Fusing robust face region descriptors via multiple metric learning for face recognition in the wild’. IEEE CVPR, 2013, pp. 3554–3561.
-
2)
-
2. Faraji, M.R., Xiaojun, Q.: ‘Face recognition under varying illumination based on adaptive homomorphic eight local directional patterns’, IET Comput. Vis., 2015, 9, (3), pp. 390–399.
-
3)
-
32. Sun, Y., Wang, X., Tang, X.: ‘Deep learning face representation from predicting 10,000 classes’. Proc. IEEE CVPR, 2014, pp. 1891–1898.
-
4)
-
21. Viola, P., Michael, J.: ‘Robust real-time object detection’, Int. J. Comput. Vis., 2004, 57, (2), pp. 137–154.
-
5)
-
3. Ochoa, V., Nolazco-Flores, J.A., Barron-Cano, O., et al: ‘Addressing the illumination challenge in two-dimensional face recognition: a survey’, IET Comput. Vis.,2015, 9, (6), pp. 978–992.
-
6)
-
6. Barr, J.R., Bowyer, K.W., Flynn, P.J.: ‘Face recognition from video: a review’, J. Pattern Recognit. Artif. Intell., 2012, 26, (5), pp. 1–56.
-
7)
-
5. Zhenyao, Z., Ping, L., Xiaogang, W., et al: ‘Deep learning multi-view representation for face recognition’. Computer Vision and Pattern Recognition, 2014.
-
8)
-
31. Sun, Y., Chen, Y., Wang, X., et al: ‘Deep learning face representation by joint identification-verification’. Proc. NIPS, 2014, pp. 1988–1996.
-
9)
-
26. Kyungjoong, J., Choi, J., Jang, G.: ‘Semi-local structure patterns for robust face detection’, IEEE Signal Process. Lett., 2015, 22, (9), pp. 1400–1403.
-
10)
-
30. Sculley, D.: ‘Rank aggregation for similar items’. Proc. Int. Conf. on Data Mining, 2007, pp. 587–592.
-
11)
-
24. Huang, D., Shan, C., Ardabilian, M., et al: ‘Local binary patterns and its application to facial image analysis: a survey’, IEEE Trans. Syst. Man Cybern., 2011, 41, (6), pp. 765–781.
-
12)
-
9. Wolf, L., Hassner, T., Maoz, I.: ‘Face recognition in unconstrained videos with matched background similarity’. Int. Conf. on Computer Vision and Pattern Recognition, 2011, pp. 529–534.
-
13)
-
14. Kim, M., Kumar, S., Pavlovic, V., et al: ‘Face tracking and recognition with visual constraints in real-world videos’. Proc. Int. Conf. on Computer Vision and Pattern Recognition, 2008, pp. 1–8.
-
14)
-
28. Wong, Y., Chen, S., Mau, S., et al: ‘Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition’. IEEE Biometrics Workshop, Computer Vision and Pattern Recognition Workshops, 2011, pp. 81–88.
-
15)
-
11. Pengfei, Z., Wangmeng, Z., Lei, Z., et al: ‘Image set-based collaborative representation for face recognition’, IEEE Trans. Inf. Forensics Sec., 2014, 9, (7), pp. 1120–1132.
-
16)
-
15. Liu, X., Chen, T.: ‘Video-based face recognition using adaptive hidden Markov models’. Proc. Int. Conf. on Computer Vision and Pattern Recognition, 2003, pp. 340–345.
-
17)
-
23. Lee, T.S.: ‘Image representation using 2d Gabor wavelets’, IEEE Trans. PAMI, 1996, 18, (10), pp. 959–971.
-
18)
-
16. Jain, A., Nandakumar, k., Ross, A.: ‘Score normalization in multimodal biometric systems’, Pattern Recognit., 2005, 38, (12), pp. 2270–2285.
-
19)
-
4. Gary, B.H., Honglak, L., Ann, A.: ‘Learning hierarchical representations for face verification with convolutional deep belief networks’. IEEE Conf. on Computer Vision and Pattern Recognition, 2012, pp. 2518–2525.
-
20)
-
1. Hassaballah, M., Aly, S.: ‘Face recognition: challenges, achievements and future directions computer vision’, IET Comput. Vis., 2015, 9, (4), pp. 614–626.
-
21)
-
29. Zhang, J., Gao, J., Zhou, M., et al: ‘Improving the effectiveness of information retrieval with clustering and fusion’, J. Comput. Linguist. Chin. Lang. Process., 2001, 6, (1), pp. 109–125.
-
22)
-
25. Suruliandi, A., Meena, K., Reena, R.: ‘Local binary pattern and its derivatives for face recognition’, IET Comput. Vis.,2012, 6, (5), pp. 480–488.
-
23)
-
27. Kim, M., Kumar, S., Pavlovic, V., et al: ‘Face tracking and recognition with visual constraints in real-world videos’. IEEE Conf. on Computer Vision and Pattern Recognition, 2008.
-
24)
-
22. Belhumeur, P., Hespanha, J., Kriegman, D.: ‘Eigenfaces vs fisherfaces: recognition using class specific linear projection’, IEEE Trans. Pattern Anal. Mach. Intell., 1997, 20, (7), pp. 711–720.
-
25)
-
8. Yang, M., Zhu, P., Van, G.L., et al: ‘Face recognition based on regularized nearest points between image sets’. Proc. IEEE Conf. on Automatic Face and Gesture Recognition, 2013, pp. 1–7.
-
26)
-
12. Wang, R., Shan, S., Chen, X., et al: ‘Manifold-manifold distance and its application to face recognition with image sets’, IEEE Trans. Image Process., 2012, 21, (10), pp. 4466–4479.
-
27)
-
18. Gaopeng, G., Huang, D., Wang, Y.: ‘Video face recognition via combination of real-time local features and temporal-spatial cues’, IET Comput. Vis., 2014, 8, (4), pp. 347–357.
-
28)
-
7. Hu, Y., Mian, A.S., Owens, R.: ‘Sparse approximated nearest points for image set classification’. IEEE Conf. on Computer Vision and Pattern Recognition, 2011, pp. 27–40.
-
29)
-
10. Cui, Z., Shan, S., Zhang, H., et al: ‘Image sets alignment for video-based face recognition’. Proc. Int. Conf. on Computer Vision and Pattern Recognition, 2012, pp. 2626–2633.
-
30)
-
17. Bhatt, H.S., Singh, R., Vatsa, M.: ‘On rank aggregation for face recognition from videos’. Proc. Int. Conf. on Image Processing, 2013, pp. 1–5.
-
31)
-
20. O'Toole, A.J., Roark, D.A., Abdi, H.: ‘Recognizing moving faces: a psychological and neural synthesis’. Trends in Cognitive Sciences, 2002, pp. 261–266.
-
32)
-
13. Zhou, S., Krueger, V., Chellappa, R.: ‘Probabilistic recognition of human faces from video’, Comput. Vis. Image Underst., 2003, 91, (1/2), pp. 214–245.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2015.0394
Related content
content/journals/10.1049/iet-cvi.2015.0394
pub_keyword,iet_inspecKeyword,pub_concept
6
6