Local gradient-based illumination invariant face recognition using local phase quantisation and multi-resolution local binary pattern fusion
- Author(s): Soodeh Nikan 1 and Majid Ahmadi 1
-
-
View affiliations
-
Affiliations:
1:
Department of Electrical and Computer Engineering, University of Windsor, Windsor, Ontario N9B 3P4, Canada
-
Affiliations:
1:
Department of Electrical and Computer Engineering, University of Windsor, Windsor, Ontario N9B 3P4, Canada
- Source:
Volume 9, Issue 1,
January 2015,
p.
12 – 21
DOI: 10.1049/iet-ipr.2013.0792 , Print ISSN 1751-9659, Online ISSN 1751-9667
A local-based illumination insensitive face recognition algorithm is proposed which is the combination of image normalisation and illumination invariant descriptors. Illumination insensitive representation of image is obtained based on the ratio of gradient amplitude to the original image intensity and partitioned into smaller sub-blocks. Local phase quantisation and multi-scale local binary pattern, extract the sub-regions characteristics. Distance measurements of local nearest neighbour classifiers are fused at the score level to find the best match and decision-level fusion combines the results of two matching techniques. Entropy, class posterior probability and mutual information are utilised as the weights of fusion components. Simulation results on the YaleB, Extended YaleB, AR, Multi-PIE and FRGC databases show the improved performance of the proposed algorithm under severe illumination with low computational complexity and no reconstruction or training requirement.
Inspec keywords: entropy; image matching; probability; face recognition; image fusion; quantisation (signal); image resolution
Other keywords: image representation; decision-level fusion; local gradient-based illumination invariant face recognition; distance measurement; multiresolution local binary pattern fusion; local phase quantisation; image normalisation; AR database; image illumination invariant descriptors; subregions characteristics extraction; multiscale local binary pattern; Multi-PIE database; FRGC database; class posterior probability; entropy; image matching; Extended YaleB database
Subjects: Image recognition; Other topics in statistics; Other topics in statistics; Computer vision and image processing techniques
References
-
-
1)
-
32. Martinez, A., Benavente, R.: ‘The AR face database’. CVC Technical Report, 1998, (24), Available (online) at: http://www2.ece.ohio-state.edu/~aliex/ARdatabase.html.
-
-
2)
-
22. Topc, B., Erdogan, H.: ‘Decision fusion for patch-based face recognition’. Proc. IEEE Int. Conf. on Pattern Recognition (ICPR10), Istanbul, Turkey, 2010, pp. 1348–1351.
-
-
3)
- T. Chen , W.T. Yin , X.S. Zhou , D. Comaniciu , T.S. Huang . Total variation models for variable lighting face recognition. IEEE Trans. Pattern Anal. Mach. Intell. , 1519 - 1524
-
4)
- J. Wright , A.Y. Yang , A. Ganesh , S.S. Sastry , Y. Ma . Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. , 210 - 227
-
5)
-
1. Lee, P.H., Wu, S.W., Hung, Y.P.: ‘Illumination compensation using oriented local histogram equalization and its application to face recognition’, IEEE Trans. Image Process., 2012, 21, (9), pp. 4280–4289 (doi: 10.1109/TIP.2012.2202670).
-
-
6)
-
36. Yang, M., Zhang, L., Shiu, S.C.K., Zhang, D.: ‘Gabor feature based robust representation and classification for face recognition with Gabor occlusion dictionary’, Pattern Recognit., 2013, 46, (7), pp. 1865–1878 (doi: 10.1016/j.patcog.2012.06.022).
-
-
7)
-
27. Ezoji, M., Faez, K.: ‘Use of matrix polar decomposition for illumination-tolerant face recognition in discrete cosine transform domain’, IET Image Process., 2011, 5, (1), pp. 25–35 (doi: 10.1049/iet-ipr.2009.0340).
-
-
8)
-
34. Qian, J., Yang, J., Gao, G.: ‘Discriminative histograms of local dominant orientation (D-HLDO) for biometric image feature extraction’, Pattern Recognit., 2013, 46, (10), pp. 2724–2739 (doi: 10.1016/j.patcog.2013.03.005).
-
-
9)
-
15. Li, Y., Shan, S., Zhang, H., Lao, S., Chen, X.: ‘Fusing magnitude and phase features for robust face recognition’. Proc. Asian Conf. on Computer Vision (ACCV12), Daejeon, 2012, pp. 601–612.
-
-
10)
- X. Tan , B. Triggs . Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. , 6 , 1635 - 1650
-
11)
-
14. Zang, D.: ‘Illumination invariant object tracking based on multiscale phase’. Proc. IEEE Int. Conf. on Image Processing (ICIP10), Hong Kong, 2010, pp. 357–360.
-
-
12)
-
9. Han, H., Shan, S., Chen, X., Gao, W.: ‘A comparative study on illumination preprocessing in face recognition’, Pattern Recogn., 2013, 46, (6), pp. 1691–1699 (doi: 10.1016/j.patcog.2012.11.022).
-
-
13)
-
13. Dhall, A., Asthana, A., Goecke, R., Gedeon, T.: ‘Emotion recognition using PHOG and LPQ features’. Proc. IEEE Int. Conf. on Automatic Face and Gesture Recognition and Workshops (FG11), Santa Barbara, CA, 2011, pp. 878–883.
-
-
14)
-
42. Vageeswaran, P., Mitra, K., Chellappa, R.: ‘Blur and illumination robust face recognition via set-theoretic characterization’, IEEE Trans. Image Process., 2013, 22, (4), pp. 1362–1372 (doi: 10.1109/TIP.2012.2228498).
-
-
15)
-
12. Nikan, S., Ahmadi, M.: ‘Human face recognition under occlusion using LBP and entropy weighted voting’. Proc. Int. Conf. on Pattern Recognition (ICPR12), Tsukuba, 2012, pp. 1699–1702.
-
-
16)
- T. Zhang , B. Fang , Y. Yuan . Multiscale facial structure representation for face recognition under varying illumination. Pattern Recognit. , 251 - 258
-
17)
-
11. Ahonen, T., Hadid, A., Pietikainen, M.: ‘Face recognition with local binary patterns’, Springer Comput. Vis., 2004, 3021, pp. 469–481.
-
-
18)
-
10. Nabatchian, A., Abdel-Raheem, E., Ahmadi, M.: ‘Illumination invariant feature extraction and mutual information based local matching for face recognition under illumination variation and occlusion’, Pattern Recognit., 2011, 44, (10–11), pp. 2576–2587 (doi: 10.1016/j.patcog.2011.03.012).
-
-
19)
- I. Naseem , R. Togneri , M. Bennamoun . Linear regression for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. , 11 , 2106 - 2112
-
20)
-
16. Chan, C.H., Tahir, M.A., Kittler, J., Pietikainen, M.: ‘Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 35, (5), pp. 1164–1177 (doi: 10.1109/TPAMI.2012.199).
-
-
21)
- C. Liu , H. Wechsler . Gabor feature based classification using the enhanced Fisher lineardiscriminant model for face recognition. IEEE Trans. Image Process. , 4 , 467 - 476
-
22)
-
37. Zhang, L., Yang, M., Feng, X.: ‘Sparse representation or collaborative representation: which helps face recognition?’. Proc. IEEE Int. Conf. on Computer Vision (ICCV11), Barcelona, 2011, pp. 471–478.
-
-
23)
-
35. Patel, V.M., Wu, T., Biswas, S., Phillips, P.J., Chellappa, R.: ‘Dictionary-based face recognition under variable lighting and pose’, IEEE Trans. Inf. Forensics Sec., 2012, 7, (3), pp. 954–965 (doi: 10.1109/TIFS.2012.2189205).
-
-
24)
-
38. Gross, R., Matthews, I., Cohn, J., Kanade, T., Baker, S.: ‘Multi-PIE’, Image Vis. Comput., 2010, 28, (5), pp. 807–813 (doi: 10.1016/j.imavis.2009.08.002).
-
-
25)
-
39. Phillips, P.J., Flynn, P., Scruggs, T., et al: ‘Overview of the face recognition grand challenge’. Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR05), San Diego, 2005, pp. 947–954.
-
-
26)
- K.C. Lee , J. Ho , D. Kriegman . Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. , 5 , 684 - 698
-
27)
-
6. Wang, B., Li, W., Yang, W., Liao, Q.: ‘Illumination normalization based on Weber's law with application to face recognition’, IEEE Signal Process. Lett., 2011, 18, (8), pp. 462–465 (doi: 10.1109/LSP.2011.2158998).
-
-
28)
-
40. Kana, M., Shana, S., Suc, Y., Xub, D., Chena, X.: ‘Adaptive discriminant learning for face recognition’, Pattern Recognit., 2013, 46, (9), pp. 2497–2509 (doi: 10.1016/j.patcog.2013.01.037).
-
-
29)
-
20. Jayaraman, S., Esakkirajan, S., Veerakumar, T.: ‘Digital image processing’ (Tata McGraw Hill, New Delhi, 2009).
-
-
30)
-
18. Ojansivu, V., Heikkilä, J.: ‘Blur insensitive texture classification using local phase quantization’. Proc. Int. Conf. on Image and Signal Processing (ICISP08), Cherbourg-Octeville, 2008, pp. 236–243.
-
-
31)
-
33. Lu, C.Y., Min, H., Gui, J., Zhu, L., Lei, Y.K.: ‘Face recognition via weighted sparse representation’, Vis. Commun. Image Represent., 2013, 24, (2), pp. 111–116 (doi: 10.1016/j.jvcir.2012.05.003).
-
-
32)
-
4. Xu, B., Zhang, T.P., Shang, Z.W.: ‘Multi-scale invariant abstracted under varying illumination’. Proc. IEEE Int. Conf. on Wavelet Analysis and Pattern Recognition (ICWAPR12), Xian, 2012, pp. 28–32.
-
-
33)
- W. Chen , M.J. Er , S. Wu . Illumination compensation and normalisation for robust face recognition using discrete cosine transform in logarithm domain. IEEE Trans. Syst. Man Cybern. B, Cybern. , 2 , 458 - 466
-
34)
-
21. Kuncheva, L.I.: ‘Combining pattern classifiers: methods and algorithms’ (John Wiley and Sons, New Jersey, 2004).
-
-
35)
-
7. Baradarani, A., Wu, Q.M.J., Ahmadi, M.: ‘An efficient illumination invariant face recognition framework via illumination enhancement and DD-DTCWT filtering’, Pattern Recognit., 2013, 46, (1), pp. 57–72 (doi: 10.1016/j.patcog.2012.06.007).
-
-
36)
-
5. Zhang, T., Tang, Y.Y., Fang, B., Shang, Z., Liu, X.: ‘Face recognition under illumination using gradientfaces’, IEEE Trans. Image Process., 2009, 18, (11), pp. 2599–2606 (doi: 10.1109/TIP.2009.2028255).
-
-
37)
-
5. Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: ‘Subspace learning from image gradient orientations’, IEEE Trans. Pattern Anal. Machine Intell., 2012, 34, (12), pp. 2454–2466 (doi: 10.1109/TPAMI.2012.40).
-
-
38)
-
32. Martinez, A., Benavente, R.: ‘The AR face database’. CVC Technical Report, 1998, (24), Available (online) at: 〈http://www2.ece.ohio-state.edu/~aliex/ARdatabase.html〉.
-
-
39)
-
17. Zhou, S.R., Yin, J.P., Zhang, J.M.: ‘LBP and LPQ based on Gabor filter for face representation’, Neurocomputing, 2013, 116, pp. 260–264 (doi: 10.1016/j.neucom.2012.05.036).
-
-
40)
- A.S. Georghiades , P.N. Belhumeur , D.J. Kriegman . From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. , 6 , 643 - 660
-
41)
- M.R. Banham , A.K. Katsaggelos . Digital image restoration. IEEE Signal Process. Mag. , 2 , 24 - 41
-
42)
-
30. Chengjun, L., Wechsler, H.: ‘Independent component analysis of Gabor features for face recognition’, IEEE Trans. Neural Netw., 2003, 14, (4), pp. 919–928 (doi: 10.1109/TNN.2003.813829).
-
-
43)
-
41. Su, Y., Shan, S., Chen, X., Gao, W.: ‘Adaptive generic learning for face recognition from a single sample per person’. Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR10), 2010, pp. 3699–2706.
-
-
1)