Impact of eye detection error on face recognition performance
Abstract
The locations of the eyes are the most commonly used features to perform face normalisation (i.e. alignment of facial features), which is an essential preprocessing stage of many face recognition systems. In this study, the authors study the sensitivity of open source implementations of five face recognition algorithms to misalignment caused by eye localisation errors. They investigate the ambiguity in the location of the eyes by comparing the difference between two independent manual eye annotations. They also study the error characteristics of automatic eye detectors present in two commercial face recognition systems. Furthermore, they explore the impact of using different eye detectors for training/enrolment and query phases of a face recognition system. These experiments provide an insight into the influence of eye localisation errors on the performance of face recognition systems and recommend a strategy for the design of training and test sets of a face recognition algorithm.
8 References
1.
Riopka T. and Boult T.: ‘The eyes have it’. Proc. of the 2003 ACM SIGMM Workshop on Biometrics Methods and Applications, WBMA'03, New York, NY, USA, 2003, pp. 9–16
2.
Min J., Bowyer K.W., and Flynn P.J.: ‘Eye perturbation approach for robust recognition of inaccurately aligned faces’, in Kanade T., Jain A.K., and Ratha N.K. (Eds.): ‘Audio- and video-based biometric person authentication’ (Springer, Berlin, Heidelberg, 2005), (LNCS 3546), pp. 41–50
3.
Rodriguez Y., Cardinaux F., Bengio S., and Mariéthoz J.: ‘Measuring the performance of face localization systems’, Image Vis. Comput., 2006, 24, (8), pp. 882–893 (10.1016/j.imavis.2006.02.012)
4.
Wang H. and Flynn P.J.: ‘Sensitivity of face recognition performance to eye location accuracy’. Biometric Technology for Human Identification II, Proc. SPIE 5779, 2005, pp. 122–131
5.
Turk M. and Pentland A.: ‘Eigenfaces for recognition’, J. Cognitive Neurosci., 1991, 3, (1), pp. 71–86 (10.1162/jocn.1991.3.1.71)
6.
Belhumeur P.N., Hespanha J.P., and Kriegman D.: ‘Eigenfaces vs. Fisherfaces: recognition using class specific linear projection’, IEEE Trans. Pattern Anal. Mach. Intell., 1997, 19, (7), pp. 711–720 (10.1109/34.598228)
7.
Günther M., Haufe D., and Würtz R.P.: ‘Face recognition with disparity corrected Gabor phase differences’, in Villa A.E.P., Duch W., Érdi P., Masulli F., and Palm G. (Eds.): ‘Artificial neural networks and machine learning’ (Springer, Berlin, 2012), (LNCS 7552), pp. 411–418
8.
Zhang W., Shan S., Gao W., Chen X., and Zhang H.: ‘Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition’. IEEE Int. Conf. on Computer Vision (ICCV), 2005, vol. 1, pp. 786–791
9.
Wallace R., McLaren M., McCool C., and Marcel S.: ‘Inter-session variability modelling and joint factor analysis for face authentication’. Int. Joint Conf. on Biometrics (IJCB), 2011, pp. 1–8
10.
Shan S., Chang Y., Gao W., Cao B., and Yang P.: ‘Curse of mis-alignment in face recognition: problem and a novel mis-alignment learning solution’. IEEE Int. Conf. on Automatic Face and Gesture Recognition (FG), 2004, pp. 314–320
11.
Marques J., Orlans N.M., and Piszcz A.T.: ‘Effects of eye position on eigenface-based face recognition scoring’, Image, 2000, 8
12.
Wang P., Green M.B., Ji Q., and Wayman J.: ‘Automatic eye detection and its validation’. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition – Workshops, 2005, CVPR Workshops, June 2005, pp. 164–164
13.
Wang P., Ji Q., and Wayman J.L.: ‘Modeling and predicting face recognition system performance based on analysis of similarity scores’, IEEE Trans. Pattern Anal. Mach. Intell., 2007, 29, (4), pp. 665–670 (10.1109/TPAMI.2007.1015)
14.
Wagner A., Wright J., Ganesh A., Zhou Z., Mobahi H., and Ma Y.: ‘Towards a practical face recognition system: robust alignment and illumination by sparse representation’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, (2), pp. 372–386 (10.1109/TPAMI.2011.112)
15.
Ekenel H.K. and Stiefelhagen R.: ‘Face alignment by minimizing the closest classification distance’. IEEE Third Int. Conf. on Biometrics: Theory, Applications, and Systems, 2009, BTAS'09, Septemebr 2009, pp. 1–6
16.
Günther M., Wallace R., and Marcel S.: ‘An open source framework for standardized comparisons of face recognition algorithms’. Computer Vision – ECCV 2012. Workshops and Demonstrations, 2012, pp. 547–556
17.
Anjos A., El Shafey L., Wallace R., Günther M., McCool C., and Marcel S.: ‘Bob: a free signal processing and machine learning toolbox for researchers’. 20th ACM Conf. on Multimedia Systems (ACMMM), Nara, Japan, October 2012, pp. 1449–1452
18.
Gross R., Matthews I., Cohn J., Kanade T., and Baker S.: ‘Multi-PIE’. IEEE Int. Conf. on Automatic Face Gesture Recognition (FG), 2008, pp. 1–8
19.
Jesorsky O., Kirchberg K.J., and Frischholz R.W.: ‘Robust face detection using the Hausdorff distance’. Audio-and Video-based Biometric Person Authentication, 2001, pp. 90–95
20.
El Shafey L., McCool C., Wallace R., and Marcel S.: ‘A scalable formulation of probabilistic linear discriminant analysis: applied to face recognition’, IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), 2013, 35, (7), pp. 1788–1794 (10.1109/TPAMI.2013.38)
21.
Martinez A.M. and Kak A.C.: ‘PCA versus LDA’, IEEE Trans. Pattern Anal. Mach. Intell. (TPAMI), 2001, 23, (2), pp. 228–233 (10.1109/34.908974)
22.
Mantasari M.I., Günther M., Wallace R., Saedi R., Marcel S., and Van Leeuwen D.: ‘Score calibration in face recognition’, IET Biometrics, 2014, 3, (4), pp. 246–256 (10.1049/iet-bmt.2013.0066)
23.
Cognitec Systems GmbH. FaceVACS C + + SDK Version 8.4.0. Software Development Kit (SDK), 2010
24.
Neurotechnology Biometric SDK 4.2. Verilook 5.1. Software Development Kit (SDK), 2011
25.
Wallace R., McLaren M., McCool C., and Marcel S.: ‘Cross-pollination of normalisation techniques from speaker to face authentication using Gaussian mixture models’, IEEE Trans. Inf. Forensics Secur., 2012, 7, (2), pp. 553–562 (10.1109/TIFS.2012.2184095)
Information & Authors
Information
Published in
Copyright
© The Institution of Engineering and Technology.
History
Received: 02 June 2014
Accepted: 31 October 2014
Published in print: September 2015
Published online: 14 March 2024
Inspec keywords
Keywords
Authors
Funding Information
BBFor2 (European Commission's Marie-Curie ITN-project FP7-PEOPLE-ITN-2008): 238803
Metrics & Citations
Metrics
Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
View Options
View options
Access content
Please select your options to get access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.