Fuzzy match index for scale-invariant feature transform (SIFT) features with application to face recognition with weak supervision

Seba Susan; Abhishek Jain; Aakash Sharma; Shikhar Verma; Siddhant Jain

Fuzzy match index for scale-invariant feature transform (SIFT) features with application to face recognition with weak supervision

View Fulltext

Author(s): Seba Susan ¹ ; Abhishek Jain ¹ ; Aakash Sharma ¹ ; Shikhar Verma ¹ ; Siddhant Jain ¹
- Affiliations: 1: Department of Computer Science and Engineering, Delhi Technological University, New Delhi, India
Source: Volume 9, Issue 11, November 2015, p. 951 – 958
DOI: 10.1049/iet-ipr.2014.0670 , Print ISSN 1751-9659, Online ISSN 1751-9667

Received 05/09/2014, Accepted 17/06/2015, Revised 14/05/2015, Published 29/07/2015

A fuzzy match index for scale-invariant feature transform (SIFT) features is proposed in this study that cumulatively involves all the test SIFT keypoints in the decision-making process. The new fuzzy SIFT classifier is adapted successfully for robust face recognition from complex backgrounds without using any face cropping tools and using only a single training template. The further incorporation of entropy weights ensures that the facial features have a greater role in the soft decision-making as compared with the background features. The highlights of the authors’ work are: (i) The development of a novel highly efficient fuzzy SIFT descriptor matching tool; (ii) incorporation of feature entropy weights to highlight the contribution of facial features; (iii) application to robust face recognition from uncropped images having diverse backgrounds with a single template for each subject. The authors thus allow for weak supervision of the face recognition experiment and obtain high accuracy for 20 subjects of the CALTECH-256 face database, 133 subjects of the labelled faces for the wild dataset and 994 subjects of the FERET database, with state-of-the-art comparisons indicating the supremacy of the authors’ approach.

References

1. 1)
  - 32. Eickeler, S., Müller, S., Rigoll, G.: ‘Recognition of JPEG compressed face images based on statistical methods’, Image Vis. Comput., 2000, 18, (4), pp. 279–287 (doi: 10.1016/S0262-8856(99)00055-4).
2. 2)
  - 1. Lowe, D.: ‘Distinctive image features from scale-invariant keypoints’, Int. J. Comp. Vis., 2003, 20, pp. 91–110.
3. 3)
  - 29. Susan, S., Hanmandlu, M.: ‘A non-extensive entropy feature and its application to texture classification’, Neurocomputing, 2013, 120, pp. 214–225 (doi: 10.1016/j.neucom.2012.08.059).
4. 4)
  - 3. Kisku, D.R., Rattani, A., Grosso, E., Tistarelli, M.: ‘Face identification by SIFT-based complete graph topology’. Proc. IEEE AUTOID, 2007, pp. 63–68.
5. 5)
  - 34. Huang, G.B., Ramesh, M., Berg, T., ,Learned-Miller, E.: Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Vol. 1, No. 2. Technical Report 07-49, University of Massachusetts, Amherst, 2007.
6. 6)
  - 10. Viola, P., Jones, M.: ‘Robust real-time face detection’, Int. J. Comput. Vis., 2004, 2, (57), pp. 137–154 (doi: 10.1023/B:VISI.0000013087.49260.fb).
7. 7)
  - 8. Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: ‘Object retrieval with large vocabularies and fast spatial matching’. CVPR, 2007.
8. 8)
  - 18. Estévez, P.A., Tesmer, M., Perez, C.A., Zurada, J.M.: ‘Normalized mutual information feature selection’, IEEE Trans. Neural Netw., 2009, 20, (2), pp. 189–201 (doi: 10.1109/TNN.2008.2005601).
9. 9)
  - 2. Belcher, C., Du, Y.: ‘Region-based SIFT approach to iris recognition’, Opt. Lasers Eng., 2009, 47, (1), pp. 139–147 (doi: 10.1016/j.optlaseng.2008.07.004).
10. 10)
  - 4. Luo, J., Ma, Y., Takikawa, E., Lao, S., Kawade, M., Lu, B.-L.: ‘Person-specific SIFT features for face recognition’, Proc. IEEE ICASSP, 2007, vol. 2, pp. 593–596.
11. 11)
  - 9. Brown, M., Lowe, D.G.: ‘Automatic panoramic image stitching using invariant features’, Int. J. Comput. Vis., 2007, 74, (1), pp. 59–73 (doi: 10.1007/s11263-006-0002-3).
12. 12)
  - 10. Yang, Q., Wang, C., Gao, Y., Qu, H., Chang, E.Y.: ‘Inertial sensors aided image alignment and stitching for panorama on mobile phones’. Proc. First Int. Workshop on Mobile Location-Based Service, 2011, ACM, pp. 21–30.
13. 13)
  - 28. Tou, J.T., Gonzalez, R.C.: ‘Pattern recognition principles’, 1974.
14. 14)
  - 23. Chang, L., Duarte, M.M., Sucar, L.E., Morales, E.F.: ‘A Bayesian approach for object classification based on clusters of SIFT local features’, Expert Syst. Appl., 2012, 39, (2), pp. 1679–1686 (doi: 10.1016/j.eswa.2011.06.059).
15. 15)
  - 17. Susan, S., Hanmandlu, M.: ‘A novel Fuzzy Entropy based on the non-extensive entropy and its application for feature selection’. 2013 IEEE Int. Conf. Fuzzy Systems (FUZZ), , IEEE, 2013, pp. 1–8.
16. 16)
  - 30. Weber, M.: ‘Caltech frontal face database’ (California Institute of Technology, 1999), http://www.vision.caltech.edu/html-files/ar-chive.html.
17. 17)
  - 11. Bicego, M., Lagorio, A., Grosso, E., Tistarelli, M.: ‘On the use of SIFT features for face authentication’. IEEE Conf. on Computer Vision and Pattern Recognition Workshop, 2006, CVPRW'06, IEEE, 2006, pp. 35–35.
18. 18)
  - 21. Kao, H.-Y., Lin, S.-H., Ho, J.-M., Chen, M.-S.: ‘Mining web informative structures and contents based on entropy analysis’, IEEE Trans. Knowl. Data Eng., 2004, 16, (1), pp. 41–55 (doi: 10.1109/TKDE.2004.1264821).
19. 19)
  - 14. Marszaek, M., Schmid, C.: ‘Spatial weighting for bag-of-features’. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, IEEE, 2006, vol 2.
20. 20)
  - 37. Phillips, P., Moon, H., Rizvi, S., Rauss, P.: ‘The FERET evaluation methodology for face-recognition algorithms’, IEEE Trans. Pattern Anal. Mach. Intell., 2000, 22, (10), pp. 1090–1104 (doi: 10.1109/34.879790).
21. 21)
  - 24. Battiato, S., Gallo, G., Puglisi, G., Scellato, S.: ‘Sift features tracking for video stabilization’. 14th Int. Conf. on Image Analysis and Processing, 2007. ICIAP 2007. , IEEE, 2007, pp. 825–830.
22. 22)
  - 20. Nister, D., Stewenius, H.: ‘Scalable recognition with a vocabulary tree’. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, IEEE, 2006, vol. 2, pp. 2161–2168.
23. 23)
  - 9. Mian, A., Bennamoun, M., Owens, R.: ‘An efficient multimodal 2D–3D hybrid approach to automatic face recognition’, IEEE Trans. Pattern Anal. Mach. Intell., 2007, 29, (11), pp. 1927–1943 (doi: 10.1109/TPAMI.2007.1105).
24. 24)
  - 13. Susan, S., Kadyan, P.: ‘A supervised fuzzy eye pair detection algorithm’. 2013 Fifth Int. Conf. on Computational Intelligence and Communication Networks (CICN), IEEE, 2013, pp. 306–310.
25. 25)
  - 27. Van Campenhout, J.M., Cover, T.M.: ‘Maximum entropy and conditional probability’, IEEE Trans. Inf. Theory, 1981, 27, (4), pp. 483–489 (doi: 10.1109/TIT.1981.1056374).
26. 26)
  - 5. Park, U., Pankanti, S., Jain, A.K.: ‘Fingerprint verification using SIFT features’. Proc. SPIE on Defense and Security Symp. Biometric Technologies for Human Identification, BTHI, 2008.
27. 27)
  - 7. Nister, D., Stewenius, H.: ‘Scalable recognition with a vocabulary tree’. CVPR, 2006.
28. 28)
  - 22. Valgren, C., Lilienthal, A.J.: ‘SIFT, SURF and seasons: long-term outdoor localization using local features’. EMCR, 2007.
29. 29)
  - 6. Ayers, B., Boutell, M.: ‘Home interior classification using SIFT keypoint histograms’. IEEE Conf. on Computer Vision and Pattern Recognition, 2007, CVPR'07, IEEE, 2007.
30. 30)
  - 19. Jing, L., Ng, M.K., Huang, J.Z.: ‘An entropy weighting k-means algorithm for subspace clustering of high-dimensional sparse data’, IEEE Trans. Knowl. Data Eng., 2007, 19, (8), pp. 1026–1041 (doi: 10.1109/TKDE.2007.1048).
31. 31)
  - 31. Kim, J., Choi, J., Yi, J., Turk, M.: ‘Effective representation using ICA for face recognition robust to local distortion and partial occlusion’, IEEE Trans. Pattern Anal. Mach. Intell., 2005, 27, (12), pp. 1977–1981 (doi: 10.1109/TPAMI.2005.242).
32. 32)
  - 33. Qiao, L., Chen, S., Tan, X.: ‘Sparsity preserving discriminant analysis for single training image face recognition’, Pattern Recognit. Lett., 2010, 31, (5), pp. 422–429 (doi: 10.1016/j.patrec.2009.11.005).
33. 33)
  - 16. Luukka, P.: ‘Feature selection using fuzzy entropy measures with similarity classifier’, Expert Syst. Appl., 2011, 38, (4), pp. 4600–4607 (doi: 10.1016/j.eswa.2010.09.133).
34. 34)
  - 12. Luo, J., Ma, Y., Takikawa, E., Lao, S., Kawade, M., Lu, B.-L.: ‘Person-specific SIFT features for face recognition’. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, 2007, ICASSP 2007, IEEE, 2007, vol. 2, p. II-593.
35. 35)
  - 26. Mian, A., Bennamoun, M., Owens, R.: ‘On the repeatability and quality of keypoints for local feature-based 3d object retrieval from cluttered scenes’, Int. J. Comput. Vis., 2010, 89, (2–3), pp. 348–361 (doi: 10.1007/s11263-009-0296-z).
36. 36)
  - 15. Collins, R.T., Liu, Y., Leordeanu, M.: ‘Online selection of discriminative tracking features’, IEEE Trans. Pattern Anal. Mach. Intell., 2005, 27, (10), pp. 1631–1643 (doi: 10.1109/TPAMI.2005.205).

Login

Not registered yet?

Share

Tools

Login to add to favourites

Key

Fuzzy match index for scale-invariant feature transform (SIFT) features with application to face recognition with weak supervision

References

Related content