Adaptive discriminative metric learning for facial expression recognition

Author(s): H. Yan ; M.H. Ang ; A.N. Poo
DOI: 10.1049/iet-bmt.2012.0006

For access to this article, please select a purchase option:

Buy article PDF

Buy Knowledge Pack

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership

Recommend Title Publication to library

IET Biometrics — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Author(s): H. Yan ¹ ; M.H. Ang ¹ ; A.N. Poo ¹
- Affiliations: 1: Department of Mechanical Engineering, Faculty of Engineering, National University of Singapore, Singapore
Source: Volume 1, Issue 3, September 2012, p. 160 – 167
DOI: 10.1049/iet-bmt.2012.0006 , Print ISSN 2047-4938, Online ISSN 2047-4946

The authors propose in this study a new adaptive discriminative metric learning method for facial expression recognition. Although a number of methods have been proposed for facial expression recognition, most of them apply the conventional Euclidean distance metric to measure the similarity/dissimilarity of face expression images and cannot effectively characterise such similarity/dissimilarity of these images because the intrinsic space of face images usually do not lie in such an Euclidean space. Motivated by the fact that between-class facial images with small differences are more easily mis-classified than those with large differences, the authors propose learning an adaptive metric by imposing large penalties on between-class samples with small differences and small penalties on those samples with large differences simultaneously, such that more discriminative information can be extracted in the learned distance metric for facial expression recognition. Experimental results on three widely used face datasets are presented to demonstrate the efficacy of the proposed method.

References

1. 1)
  - B. Fasel , J. Luettin . Automatic facial expression analysis: a survey. Pattern Recognit. , 1 , 259 - 275
2. 2)
  - M.J. Lyons , J. Budynek , S. Akamatsu . Automatic classification of single facial images. IEEE Trans. Pattern Anal. Mach. Intell. , 12 , 1357 - 1362
3. 3)
  - Y. Fu , S. Yan , T. Huang . Correlation metric for generalized feature extraction. IEEE Trans. Pattern Anal. Mach. Intell. , 12 , 2229 - 2235
4. 4)
  - X.F. He , S.C. Yan , Y.X. Hu , P. Niyogi , H.J. Zhang . Face recognition using Laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. , 3 , 328 - 340
5. 5)
  - Z. Zeng , M. Pantic , G.I. Roisman , T. Huang . A survey of affect recognition methods: audio, visual, and spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. , 1 , 39 - 58
6. 6)
  - M. Turk , A. Pentland . Eigenfaces for recognition. J. Cogn. Neurosci. , 71 - 86
7. 7)
  - R. Cowie , E. Douglas-Cowie , N. Tsapatsoulis . Emotion recognition in human-computer interaction. IEEE Signal Process. Mag. , 1 , 32 - 80
8. 8)
  - Kanade, T., Cohn, J., Tian, Y.L.: `Comprehensive database for facial expression analysis', Proc. IEEE Int. Conf. Face and Gesture Analysis, 2010, p. 46–53.
9. 9)
  - Raducanu, B., Dornaika, F.: `Dynamic facial expression recognition using Laplacian eigenmaps-based manifold learning', Proc. IEEE Int. Conf. Robotics and Automation, 2010, p. 156–161.
10. 10)
  - Y. Gao , M.K.H. Leung , S.C. Hui , M.W. Tananda . Facial expression recognition from line-based caricatures. IEEE Trans. Syst. Man Cybern. A, Syst. Humans , 3 , 407 - 412
11. 11)
  - Kokiopoulou, E., Saad, Y.: `Orthogonal neighborhood preserving projections', Proc. Int. Conf. Data Mining, 2005, p. 234–241.
12. 12)
  - Yan, H., Ang, M.H., Poo, A.N.: `Cross-dataset facial expression recognition', Proc. IEEE Int. Conf. Robotics and Automation, 2011, p. 5985–5990.
13. 13)
  - Wang, Z., Hu, Y., Chia, L.-T.: `Image-to-class distance metric learning for image classification', Proc. European Conf. Computer Vision, 2010, p. 706–719.
14. 14)
  - J. Lu , Y.-P. Tan . Nearest feature space analysis for classification. IEEE Signal Process. Lett. , 1 , 55 - 58
15. 15)
  - K.Q. Weinberger , J. Blitzer , L.K. Saul . Distance metric learning for large margin nearest neighbor classification. Adv. Neural Inf. Process. Syst. , 1 - 8
16. 16)
  - Shan, C., Gong, S., McOwan, P.W.: `A comprehensive empirical study on linear subspace methods for facial expression analysis', Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition Workshop, 2006, p. 153–158.
17. 17)
  - Wang, X., Hua, G., Han, T.X.: `Discriminative tracking by metric learning', Proc. European Conf. Computer Vision, 2010, p. 200–214.
18. 18)
  - Y. Cheon , D. Kim . Natural facial expression recognition using differential-AAM and manifold learning. Pattern Recognit. , 7 , 1340 - 1350
19. 19)
  - I. Kotsia , I. Pitas . Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Process. , 172 - 187
20. 20)
  - P. Belhumeur , J. Hespanha , D. Kriegman . Eigenfaces vs fusherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. , 7 , 711 - 720
21. 21)
  - Wallhoff F.: ‘Facial expressions and memotion database, October 2004, available at http://www.mmk.ei.tum.de/ waf/fgnet/feedtum.html.
22. 22)
  - C. Shan , S. Gong , P.W. McOwan . Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. , 803 - 816
23. 23)
  - S. Zafeiriou , I. Pitas . Discriminant graph structures for facial expression recognition. IEEE Trans. Multimedia , 8 , 1528 - 1540
24. 24)
  - J. Goldberger , S. Roweis , G. Hinton , R. Salakhutdinov . Neighbourhood components analysis. Adv. Neural Inf. Process. Syst. , 1 - 8
25. 25)
  - Zhi, R., Ruan, Q.: `Discriminant spectral analysis for facial expression recognition', Proc. IEEE Int. Conf. Image Processing, 2008, p. 1924–1927.
26. 26)
  - M. Pantic , L.J.M. Rothkrantz . Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell. , 12 , 1445 - 1424
27. 27)
  - S. Zafeiriou , T. Tefas , I. Buciu , I. Pitas . Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification. IEEE Trans. Neural Netw. , 3 , 683 - 695
28. 28)
  - J. Lu , Y.-P. Tan . A doubly weighted approach for appearance-based subspace learning. IEEE Trans. Inf. Forensics Security , 1 , 71 - 81
29. 29)
  - Yan, H., Ang, M.H., Poo, A.N.: `Weighted biased linear discriminant analysis for misalignment-robust facial expression recognition', Proc. IEEE Int. Conf. Robotics and Automation, 2011, p. 3881–3886.
30. 30)
  - R. Zhi , M. Flierl , Q. Ruan , W.B. Kleijn . Graph-preserving sparse nonnegative matrix factorization with application to facial expression recognition. IEEE Trans. Syst. Man Cybern. B , 1 , 38 - 52
31. 31)
  - J. Lu , Y.-P. Tan . Regularized locality preserving projections and its extensions for face recognition. IEEE Trans. Syst. Man Cybern. B, Cybern. , 3 , 958 - 963

Adaptive discriminative metric learning for facial expression recognition

Adaptive discriminative metric learning for facial expression recognition

Buy article PDF

Buy Knowledge Pack

Thank you

References

Related content