Video face recognition via combination of real-time local features and temporal–spatial cues
- Author(s): Gaopeng Gou 1 ; Di Huang 1 ; Yunhong Wang 1
-
-
View affiliations
-
Affiliations:
1:
State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing 100191, People's Republic of China
-
Affiliations:
1:
State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing 100191, People's Republic of China
- Source:
Volume 8, Issue 4,
August 2014,
p.
347 – 357
DOI: 10.1049/iet-cvi.2013.0025 , Print ISSN 1751-9632, Online ISSN 1751-9640
Video-based face recognition has attracted much attention and made great progress in the past decade. However, it still encounters two main problems, which are efficiently representing faces in frames and sufficiently exploiting temporal–spatial constraints between frames. The authors investigate the existing real-time features for face description, and compare their performance. Moreover, a novel approach is proposed to model temporal–spatial information which is then combined with real-time features to further enforce the consistent constraints between frames to improve the recognition performance. The experiments are validated on three video face databases and the results demonstrate that temporal–spatial cues combined with the most powerful real-time features largely improve the recognition rate.
Inspec keywords: video signal processing; image matching; face recognition
Other keywords: face description; recognition performance improvement; sparse matching; dense matching; real-time local features; video face recognition; video face databases; recognition rate; temporal-spatial cues
Subjects: Computer vision and image processing techniques; Video signal processing; Image recognition
References
-
-
1)
-
10. Gou, G., Huang, D., Wang, Y.: ‘A hybrid local feature for face recognition’. Proc. Pacific Rim Int. Conf. Artificial Intelligence, 2012, pp. 64–75.
-
-
2)
-
15. Zhou, S., Krueger, V., Chellappa, R.: ‘Face recognition from video: a condensation approach’. Proc. Int. Conf. Automatic Face and Gesture Recognition, 2002, pp. 221–226.
-
-
3)
-
25. Viola, P., Jones, M.: ‘Robust real-time face detection’. Proc. Int. Conf. Computer Vision, 2001, pp. 590–595.
-
-
4)
-
2. Sande, K., Gevers, T., Snoek, C.: ‘Evaluating color descriptors for object and scene recognition’, IEEE Trans. Pattern Anal. Mach. Intell., 2009, 32, (9), pp. 1582–1596 (doi: 10.1109/TPAMI.2009.154).
-
-
5)
- K.C. Lee , J. Ho , M.H. Yang , D. Kriegman . Visual tracking and recognition using probabilistic appearance manifolds. Comput. Vis. Image Understanding , 303 - 331
-
6)
-
29. Mian, A., Bennamoun, M., Owens, R.: ‘On the repeatability and quality of keypoints for local feature-based 3D object retrieval from cluttered scenes’, Int. J. Comput. Vis., 2010, 89, (2), pp. 348–361 (doi: 10.1007/s11263-009-0296-z).
-
-
7)
-
5. Wolf, L., Hassner, T., Taigman, Y.: ‘Descriptor based methods in the wild’. Proc. European Conf. Computer Vision, 2008, pp. 1–14.
-
-
8)
- D. Huang , C.F. Shan , M. Ardabilian , Y.H. Wang , L.M. Chen . Local binary patterns and its application to facial image analysis: survey. IEEE Trans. Syst. Man Cybern. C, Appl. Rev. , 765 - 781
-
9)
- D.G. Lowe . Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis , 2 , 91 - 110
-
10)
-
17. Tang, X., Li, Z.: ‘Audio-guided video-based face recognition’, IEEE Trans. Circuits Syst. Video Technol., 2040, 7, (19), pp. 955–964.
-
-
11)
-
18. Stallkamp, J., Ekenel, H., Stiefelhagen, R.: ‘Video-based face recognition on real-world data’. Proc. Int. Conf. Computer Vision, 2007, pp. 1–8.
-
-
12)
- X. Liu , T. Chen , S.M. Thornton . Eigenspace updating for non-stationary process and its application to face recognition. Pattern Recognit. , 9 , 1945 - 1959
-
13)
-
30. Phillips, P.J., Flynn, T., Scruggs, T., et al: ‘Overview of the face recognition grand challenge’. Proc. Computer Vision and Pattern Recognition, 2005, pp. 947–954.
-
-
14)
-
13. Mikolajczyk, K., Schmid, C.: ‘A performance evaluation of local descriptors’. Proc. IEEE Int. Conf. Computer Vision, 2003, pp. 257–263.
-
-
15)
- T. Ojala , M. Pietikǎinen , T. Mǎenpǎǎ . Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. , 7 , 971 - 987
-
16)
-
22. Dalal, N., Triggs, B.: ‘Histograms of oriented gradients for human detection’. Proc. Conf. Computer Vision and Pattern Recognition, 2005, pp. 886–893.
-
-
17)
-
23. Comaniciu, D., Ramesh, V., Meer, P.: ‘Real-time tracking of nonrigid objects using mean shift’. Proc. Conf. Computer Vision and Pattern Recognition, 2000, pp. 142–149.
-
-
18)
-
8. Liu, C., Wechsler, H.: ‘A Gabor feature classifier for face recognition’. Proc. Int. Conf. Computer Vision, 2001, pp. 270–275.
-
-
19)
-
6. Zhang, L., Chu, R., Xiang, S., Liao, S., Li, S.Z.: ‘Face detection based on multi-block LBP representation’. Proc. Int. Conf. Biometrics, 2007, pp. 11–18.
-
-
20)
- H. Bay , A. Ess , T. Tuytelaars , L.V. Gool . SURF: speeded up robust features. Comput. Vis. Image Underst. , 3 , 346 - 359
-
21)
-
9. Ozuysal, M., Calonder, M., Lepetit, V., Fua, P.: ‘Fast keypoint recognition using random ferns’, IEEE Trans. Pattern Anal. Mach. Intell., 2010, 32, (3), pp. 448–461 (doi: 10.1109/TPAMI.2009.23).
-
-
22)
- T. Ahonen , A. Hadid , M. Pietikäinen . Face description with local binary patterns: application to face recognition. IEEE Trans. Patt. Anal. Mach. Intell. , 12 , 2037 - 2041
-
23)
-
27. Sanderson, C., Paliwal, K.K.: ‘Polynomial features for robust face authentication’. Proc. Int. Conf. Image Processing, 2002, pp. 997–1000.
-
-
24)
- X. Tan , B. Triggs . Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. , 6 , 1635 - 1650
-
25)
-
3. Ahonen, T., Hadid, A., Pietikainen, M.: ‘Face recognition with local binary patterns’. Proc. European Conf. Computer Vision, 2004, pp. 469–481.
-
-
26)
-
28. Wong, Y., Chen, S., Mau, S., Sanderson, C., Lovell, B.C.: ‘Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition’. Proc. Computer Vision and Pattern Recognition Workshops, 2011, pp. 74–81.
-
-
27)
-
31. Biswas, S., Aggarwal, G., Flynn, P.J.: ‘Face recognition in low-resolution videos using learning-based likelihood measurement model’. Proc. Int. Joint Conf. Biometrics, 2011, pp. 1–7.
-
-
28)
-
16. Aggarwal, G., Chowdhury, A.K.R., Chellappa, R.: ‘A system identification approach for video-based face recognition’. Proc. Int. Conf. Pattern Recognition, 2004, pp. 175–178.
-
-
29)
- H. Othman , T. Aboulnasr . A separable low complexity 2D HMM with application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. , 10 , 1229 - 1238
-
30)
-
21. Lee, W., Chen, H.: ‘Histogram-based interest point detectors’. Proc. Conf. Computer Vision and Pattern Recognition, 2009, pp. 1590–1596.
-
-
31)
-
19. Gou, G., Shen, R., Wang, Y., Basu, A.: ‘Temporal-spatial face recognition using multi-atlas and Markov process model’. Proc. Int. Conf. Multimedia and Expo, 2011, pp. 1–4.
-
-
1)