Effects of pose and image resolution on automatic face recognition

Zahid Mahmood; Tauseef Ali; Samee U. Khan

Effects of pose and image resolution on automatic face recognition

View Fulltext

Author(s): Zahid Mahmood ¹ ; Tauseef Ali ² ; Samee U. Khan ¹
- Affiliations: 1: Electrical and Computer Engineering Department, North Dakota State University, Fargo, ND 58108-6050, USA ;
  2: Faculty of Computer Science, Mathematics, and Engineering, University of Twente, Enschede, Netherlands
Source: Volume 5, Issue 2, June 2016, p. 111 – 119
DOI: 10.1049/iet-bmt.2015.0008 , Print ISSN 2047-4938, Online ISSN 2047-4946

Received 05/02/2015, Accepted 14/09/2015, Revised 16/05/2015, Published 01/06/2016

The popularity of face recognition systems have increased due to their use in widespread applications. Driven by the enormous number of potential application domains, several algorithms have been proposed for face recognition. Face pose and image resolutions are among the two important factors that influence the performance of face recognition algorithms. In this study, the authors present a comparative study of three baseline face recognition algorithms to analyse the effects of two aforementioned factors. The algorithms studied include (a) the adaptive boosting (AdaBoost) with linear discriminant analysis as weak learner, (b) the principal component analysis (PCA)-based approach, and (c) the local binary pattern (LBP)-based approach. They perform an empirical study using the images with systematic pose variation and resolution from multi-pose, illumination, and expression database to explore the recognition accuracy. This evaluation is useful for practical applications because most engineers start development of a face recognition application using these baseline algorithms. Simulation results revealed that the PCA is more accurate in classifying the pose variation, whereas the AdaBoost is more robust in identifying low-resolution images. The LBP does not classify face images of size 20 × 20 pixels and below and has lower recognition accuracy than PCA and AdaBoost.

References

1. 1)
  - 1. Xiujuan, C., Shiguang, S., Xilin, C., et al: ‘Locally linear regression for pose-invariant face recognition’, IEEE Trans. Image Process., 2007, 16, (7), pp. 1716–1725 (doi: 10.1109/TIP.2007.899195).
2. 2)
  - 10. Yaniv, T., Ming, Y., Marc, R., et al: ‘Closing gap to human level performance in face verification’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 2013, pp. 1–8.
3. 3)
  - 11. Huang, G., Ramesh, M., Berg, T., et al: ‘Labeled faces in the wild: a database for studying face recognition in unconstrained environments’. Technical Report, 07–49, University of Massachusetts, Amherst, 2007.
4. 4)
  - 7. Turk, M., Pentland, A.: ‘Eigenfaces for recognition’, J. Cogn. Neurosci, 1991, 13, (1), pp. 71–86 (doi: 10.1162/jocn.1991.3.1.71).
5. 5)
  - 30. Junlin, H., Jiwen, L., Yap, T.: ‘Discriminative deep metric learning for face verification in the wild’. Int. Conf. on Computer Vision and Pattern Recognition (CVPR), 2014, pp. 1875–1882.
6. 6)
  - 8. Han, H., Shan, S., Chen, X., Gao, W.: ‘A comparative study on illumination preprocessing in face recognition’, Pattern Recogn., 2013, 46, (6), pp. 1691–1699 (doi: 10.1016/j.patcog.2012.11.022).
7. 7)
  - 2. Liu, D., Xiaoqing, D., Chi, F.: ‘Continuous pose normalization for pose-robust face recognition’, IEEE Signal Process. Lett., 2012, 19, (11), pp. 721–724 (doi: 10.1109/LSP.2012.2215586).
8. 8)
  - 22. Volker, B., Thomas, V.: ‘Face recognition based on fitting a 3-D morphable model’, IEEE Trans. Pattern Anal. Mach. Intell., 2003, 25, (9), pp. 1063–1074 (doi: 10.1109/TPAMI.2003.1227983).
9. 9)
  - 110. Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: ‘Multi-PIE’, Image Vis. Comput., 2010, 28, (5), pp. 807–813 (doi: 10.1016/j.imavis.2009.08.002).
10. 10)
  - 9. Hailing, Z., Ajmal, M., Lei, W.: ‘Recent advances on single modal and multimodal face recognition: a survey’, IEEE Trans. Human Mach. Syst., 2014, 44, (6), pp. 701–716 (doi: 10.1109/THMS.2014.2340578).
11. 11)
  - 23. Mahmood, Z., Ali, T., Khattak, S.: ‘Automatic player detection and recognition in images using AdaBoost’. Ninth Int. Bhurban Conf. on Applied Sciences and Technology (IBCAST), February 2012, pp. 64–69.
12. 12)
  - 5. Lu, J., Wang, G., Deng, W., et al: ‘Reconstruction-based metric learning for unconstrained face verification’, IEEE Trans. Inf. Forensics Sec., 2015, 10, (1), pp. 79–89 (doi: 10.1109/TIFS.2014.2363792).
13. 13)
  - 27. Tan, X., Triggs, B.: ‘Enhanced local texture feature sets for face recognition under difficult lighting conditions’, IEEE Trans. Image Process., 2010, 19, (6), pp. 1635–1650 (doi: 10.1109/TIP.2010.2042645).
14. 14)
  - 7. Liu, Z., Lv, S., Lv, Y., et al: ‘A natural visible and infrared facial expression database for expression recognition and emotion inference’, IEEE Trans. Multimedia, 2010, 12, (7), pp. 682–691 (doi: 10.1109/TMM.2010.2060716).
15. 15)
  - 21. Shu, L., Albert, C.: ‘A novel Markov random field based deformable model for face recognition’. CVPR, 2010, pp. 2675–2682.
16. 16)
  - 28. Ahonen, T., Hadid, A., Pietikainen, M.: ‘Face description with local binary patterns: application to face recognition’, IEEE Trans. Pattern Anal. Mach. Intell., 2006, 28, (12), pp. 2037–2041 (doi: 10.1109/TPAMI.2006.244).
17. 17)
  - 13. Shervin, R., Josef, K.: ‘Energy normalization for pose-invariant face recognition based on MRF model image matching’, IEEE Trans. on Pattern Anal. Mach. Intell., 2011, 33, (6), pp. 1274–1280 (doi: 10.1109/TPAMI.2010.209).
18. 18)
  - 20. Phillips, J., Wechsler, H., Huang, J.S., et al: ‘The FERET database and evaluation procedure for face recognition algorithms’, Image Vis. Comput., 1998, pp. 295–306 (doi: 10.1016/S0262-8856(97)00070-X).
19. 19)
  - 19. Jingang, S., Chun, Q.: ‘From local geometry to global structure: learning latent subspace for low-resolution face image recognition’, IEEE Signal Process. Lett., 2015, 22, (5), pp. 554–558 (doi: 10.1109/LSP.2014.2364262).
20. 20)
  - 15. Phillips, P.J., Flynn, P.J., Scruggs, T., et al: ‘Overview of the face recognition grand challenge’, Comput. Vis. Pattern Recognit., 2005, (1), pp. 947–954.
21. 21)
  - 8. The BJUT-3D large-scale Chinese face database. Available at http://www.bjut.edu.cn/sci/multimedia/mul-lab/3dface/pdf/ MISKL-TR-05-FM FR-001.pdf.
22. 22)
  - 18. Mahmood, Z., Ali, T., Khattak, S., et al: ‘Automatic player detection and identification for sports entertainment applications’, Pattern Anal. Appl., 2015, doi: 10.1007/s10044-014-0416-4.
23. 23)
  - 6. Grgic, M., Delac, K., Grgic, S.: ‘SC face-surveillance cameras face database’, J. Multimedia Tools Appl., 2011, 51, (3), pp. 863–879 (doi: 10.1007/s11042-009-0417-2).
24. 24)
  - 24. Bishop, C.M.: ‘Pattern recognition and machine leaning’ (Springer, New York, 2006), (1).
25. 25)
  - 107. Georghiades, A., Belhumeur, P., Kriegman, D.: ‘From few to many: illumination cone models for face recognition under variable lighting and pose’, IEEE Trans. Pattern Anal. Mach. Intell., 2001, 23, (6), pp. 643–660 (doi: 10.1109/34.927464).
26. 26)
  - 31. Ngoc, V.: ‘Exploring patterns of gradient orientations and magnitudes for face recognition’, IEEE Trans. Inf. Forensics Sec., 2013, 8, (2), pp. 295–304 (doi: 10.1109/TIFS.2012.2224866).
27. 27)
  - 33. Zhen, C., Wen, L., Dong, X., et al: ‘Fusing robust face region descriptors via multiple metric learning for face recognition in the wild’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 2013, pp. 3554–3561.
28. 28)
  - 10. Viola, P., Jones, M.: ‘Robust real-time face detection’, Int. J. Comput. Vis., 2004, 2, (57), pp. 137–154 (doi: 10.1023/B:VISI.0000013087.49260.fb).
29. 29)
  - 12. Sun, Y., Xiaogang, W., Xiaoou, T.: ‘Deep learning face representation from predicting 10,000 classes’. Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 2013, pp. 1–8.
30. 30)
  - 4. Oswald, , et al: ‘Inverse rendering of faces with a 3D morphable model’, IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35, (5), pp. 1080–1093 (doi: 10.1109/TPAMI.2012.206).
31. 31)
  - 17. Yang, A., Zhou, Z.: ‘Fast l-1-minimization algorithms for robust face recognition’, IEEE Trans. Image Process., 2013, 8, (22), pp. 1598–1603.
32. 32)
  - 26. Lu, J., Plataniotis, K., Venetsanopoulos, A., et al: ‘Ensemble-based discriminant learning with boosting for face recognition’, IEEE Trans. Neural Netw., 2006, 17, (1), pp. 166–178 (doi: 10.1109/TNN.2005.860853).
33. 33)
  - 32. Changxing, D., Shang, X., Dacheng, T.: ‘Multi-task pose-invariant face recognition’, IEEE Trans. Image Process., 2015, 24, (3), pp. 980–993 (doi: 10.1109/TIP.2015.2390959).

Login

Not registered yet?

Share

Tools

Login to add to favourites

Key

Effects of pose and image resolution on automatic face recognition

References

Related content