Facial biometrics for situational awareness systems
- Author(s): Ahmad Poursaberi 1 ; Jan Vana 2 ; Štěpán Mráček 2 ; Radim Dvora 2 ; Svetlana N. Yanushkevich 1 ; Martin Drahansky 2 ; Vlad P. Shmerko 1 ; Marina L. Gavrilova 1
-
-
View affiliations
-
Affiliations:
1:
ECE, University of Calgary, 2500 University Drive NW, Calgary, Alberta, Canada;
2: Department of Intelligent Systems (DITS), Brno University of Technology, 61266 Brno, Czech Republic
-
Affiliations:
1:
ECE, University of Calgary, 2500 University Drive NW, Calgary, Alberta, Canada;
- Source:
Volume 2, Issue 2,
June 2013,
p.
35 – 47
DOI: 10.1049/iet-bmt.2012.0065 , Print ISSN 2047-4938, Online ISSN 2047-4946
- « Previous Article
- Table of contents
- Next Article »
This study contributes to developing the concept of decision-making support in biometric-based situational awareness systems. Such systems assist users in gathering and analysing biometric data, and support the decision-making on the human behavioural pattern and/or authentication. As an example, the authors consider a facial biometric assistant that functions based on multi-spectral biometrics in visible and infrared bands; it involves facial expression recognition, face recognition in both spectra, as well as estimation of physiological parameters. The authors also investigate usage of facial biometrics for the semantic representation for advanced decision-making.
Inspec keywords: biometrics (access control); face recognition; data analysis; decision making
Other keywords: decision-making; facial expression recognition; biometric data gathering; infrared bands; situational awareness systems; human behavioural pattern; physiological parameter estimation; biometric-based situational awareness systems; facial biometrics; multispectral biometrics; biometric data analysis; visible bands
Subjects: Image recognition; Computer vision and image processing techniques; Data security
References
-
-
1)
-
24. Wang, P.S.P., (Ed.): ‘Pattern recognition, machine intelligence and biometrics’ (HEP and Springer, 2011).
-
-
2)
-
36. Buddharaju, P., Pavlidis, I., Kakadiaris, I.: ‘Face recognition in the thermal infrared spectrum’, CVPR, 2004, 8, pp. 133–138.
-
-
3)
-
33. Ng, E.Y.K., Kaw, G.J.L., Chang, W.M.: ‘Analysis of IR thermal imager for mass blind fever screening’, Microvasc. Res., 2004, 68, pp. 104–109 (doi: 10.1016/j.mvr.2004.05.003).
-
-
4)
-
3. Matey, J.R., Naroditsky, O., Hanna, K., et al: ‘Iris on the move: acquisition of images for iris recognition in less constrained environments’, Proc. IEEE, 2006, 94, (11), pp. 1936–1947 (doi: 10.1109/JPROC.2006.884091).
-
-
5)
-
29. Pavlidis, I., Levine, J.: ‘Thermal image analysis for polygraph testing’, IEEE Eng. Med. Biol. Mag., 2002, 21, (6), pp. 56–64 (doi: 10.1109/MEMB.2002.1175139).
-
-
6)
-
54. Equinox, Multimodal face database. http://www.equinoxsensors.com/products/HID.html (accessed May 2012).
-
-
7)
-
28. Ng, E.Y.K., Muljo, W., Wong, B.S.: ‘Study of facial skin and aural temperature’, IEEE Eng. Med. Biol. Mag., May 2006, 25, pp. 68–74 (doi: 10.1109/MEMB.2006.1636353).
-
-
8)
-
25. Wang, P.S.P., (Ed.): ‘Intelligent pattern recognition and machine vision’ (King-Sun Fu Memorial Book, River Pub.Co., Denmark, 2010).
-
-
9)
-
26. Sohail, A., Bhattacharya, P.: ‘Classification of facial expressions using k-nearest neighbor classifier’. Proc. Vision Computer Graphics Collaboration Techniques, 2007, pp. 555–566.
-
-
10)
-
7. http://en.wikipedia.org/wiki/Future_Attribute_Screening_Technology.
-
-
11)
-
20. Poursaberi, A., Ahmadi Noubari, H., Yanushkevich, S.N.: ‘Gauss–Laguerre wavelet textural feature fusion with geometrical information for facial expression identification’, Eurasip J. Image and Video Process., 2012, 2012, pp. 17 (doi: 10.1186/1687-5281-2012-17).
-
-
12)
-
19. Lajevardi, S., Hussain, Z.: ‘Feature extraction for facial expression recognition based on hybrid face regions’, Adv. Electr. Comput. Eng., 2009, 9, (3), pp. 63–67 (doi: 10.4316/aece.2009.03012).
-
-
13)
-
56. Yanushkevich, S.N., Stoica, A., Shmerko, V.P., Popel, D.V.: ‘Biometric Inverse Problems’ (CRC Press/Taylor & Francis Group, 2005).
-
-
14)
-
27. Fujimasa, I., Chinzei, T., Saito, I.: ‘Converting far infrared image information to other physiological data’, IEEE Eng. Med. Biol. Mag., 2000, 19, (3), pp. 71–76 (doi: 10.1109/51.844383).
-
-
15)
-
45. Kanade, T., Cohen, J.F., Tian, Y.: ‘Comprehensive database for facial expression analysis’. Proc. FG, 2000, pp. 46–53.
-
-
16)
-
38. Arandjelovic, O., Hammoud, R.: ‘Multi-Sensory face biometric fusion for Personal Identification’. CVPRW, June 2006.
-
-
17)
-
9. Boulanov, O.R., Gavrilova, M.L., Poursaberi, A., et al: ‘Biometric-based intelligent agent systems’. IADIS Int. Conf. Intelligent Systems and Agents, 2011, pp. 162–164.
-
-
18)
-
6. Yanushkevich, S.N., Stoica, A., Shmerko, V.P.: ‘Experience of design and prototyping of a multi-biometric early warning physical access control security system (PASS) and a training system (T-PASS)’. Proc. 32nd Annual IEEE Industrial Electronics Society Conf., Paris, November 2006, pp. 2347–2352.
-
-
19)
-
32. Tsumura, N., Ojima, N., Sato, K., et al: ‘Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin’, ACM Trans. Graph., 2003, 22, (3), pp. 770–779 (doi: 10.1145/882262.882344).
-
-
20)
-
44. Lynos, M., Akamatsu, S., Kamachi, M., Gyoba, J.: ‘Coding facial expressions with Gabor wavelets’. Proc. FG, 1998, pp. 200–206.
-
-
21)
-
5. Chague, S., Droit, B., Boulanov, O., Yanushkevich, S.N., Shmerko, V.P., Stoica, A.: ‘Biometric-based decision support assistance in physical access control systems’. Proc. Conf. Bio-inspired, Learning and Intelligent Systems for Security, 2008, pp. 11–16.
-
-
22)
-
11. Monwar, M., Gavrilova, M.L.: ‘A multimodal biometric system using rank level fusion approach’, IEEE Trans. SMC. Part B, Special Issue on Cognitive Informatics and Cybernetics, 2009, 39, (5), pp. 867–878 (doi: 10.1109/TSMCB.2008.2009071).
-
-
23)
-
42. Jacovitti, G., Neri, A.: ‘Multiscale image features analysis with circular harmonic wavelets’, Proc. SPIE, 1995, 2569, (1), pp. 363–374 (doi: 10.1117/12.217592).
-
-
24)
-
17. Poursaberi, A., Yanushkevich, S.N.: ‘Modified multiscale vesselness filter for facial feature detection’. Proc. CCECE, Canada, 2012.
-
-
25)
-
12. Yanushkevich, S.N., Hurley, D., Wang, P.S.P.: ‘Analysis vs synthesis in biometrics’, Int. J. Pattern Recognit. Artif. Intell., 2008, 22, (3), pp. 367–369 (doi: 10.1142/S0218001408006466).
-
-
26)
-
23. Zhan, Y., Ye, J., Niu, D., Cao, P.: ‘Facial expression recognition based on Gabor wavelet transformation and elastic templates matching’. Proc. Image and Graphics, 2002, pp. 254–257.
-
-
27)
-
35. Hermosilla, G., Ruiz-del-Solar, J., Verschae, R., Correa, M.: ‘A comparative study of thermal face recognition methods in unconstrained environments’, Pattern Recognit., 2012, 45, (7), pp. 2445–2459 (doi: 10.1016/j.patcog.2012.01.001).
-
-
28)
-
55. Flynn, P.J., Bowyer, K.W., Phillips, P.J.: ‘Assessment of time dependency in face recognition: an initial study’. Audio and Video-Based Biometric Person Authentication, 2003, pp. 44–51.
-
-
29)
-
53. Guo, Y., Zhao, G., Pietikäinen, M.: ‘Dynamic facial expression recognition using longitudinal facial expression atlases’, ECCV, 2012, 2, pp. 631–644.
-
-
30)
-
48. Deng, H.B., Jin, L.W., Zhen, L.X., Huang, I.C.: ‘A new facial expression recognition method based on local gabor filter bank and PCA plus LDA’, Int. J. Inf. Technol., 2005, 11, (11), pp. 86–96.
-
-
31)
-
10. Jain, A.K., Nandakumar, K., Uludag, U., Lu, X.: ‘Multimodal biometrics: augmenting face with other cues’, in Zhao, W., Chellappa, R. (Eds.): ‘Face processing: advanced modeling and methods’ (Elsevier, 2006).
-
-
32)
-
8. DHS: ‘Privacy Impact Assessment for the Future Attribute Screening Technology (FAST) Project’. 15 December, 2008, dhs.gov, retrieved May 2011.
-
-
33)
-
21. Jacovitti, G., Neri, A.: ‘Multiscale image features analysis with circular harmonic wavelets’. Proc. of SPIE 2569, Wavelets Applications: In Signal and Image Processing III, 1995, pp. 363–372.
-
-
34)
-
1. ‘Total Information Awareness DAPRA's Research Program’: Inf. Secur., 2003, 10, pp. 105–109.
-
-
35)
-
40. Dutch, D.: ‘Infrared facial image analysis’ Diploma project, HEFT/Biometric Technologies Laboratory (University of Calgary, 2011).
-
-
36)
-
31. Prokoski, F.J., Riedel, R.B.: ‘Infrared identification of faces and body parts’, in Jain, A., Bolle, R., Pankanti, S. (Eds.): ‘Biometrics: personal identification in networked society’, (Kluwer, 1999), pp. 191–212.
-
-
37)
-
50. Kotsia, I., Pitas, I.: ‘Facial expression recognition in image sequences using geometric deformation features and support vector machines’, IEEE Trans. Image Process., 2007, 16, (1), pp. 172–187 (doi: 10.1109/TIP.2006.884954).
-
-
38)
-
30. Sugimoto, Y., Yoshitomi, Y., Tomita, S.: ‘A method for detecting transitions of emotional states using a thermal facial image based on a synthesis of facial expressions’, Robot. Auton. Syst., 2000, 31, pp. 147–160 (doi: 10.1016/S0921-8890(99)00104-9).
-
-
39)
-
15. Tian, Y., Kanade, T., Cohn, J.F.: ‘Recognizing action units for facial expression analysis’, IEEE Trans. PAMI, 2001, 23, (2), pp. 97–115 (doi: 10.1109/34.908962).
-
-
40)
-
51. Zafeiriou, S., Pitas, I.: ‘Discriminant graph structures for facial expression recognition’, IEEE Trans. Multimed., 2008, 10, (8), pp. 1528–1540 (doi: 10.1109/TMM.2008.2007292).
-
-
41)
-
14. Ekman, P., Friesen, W.V., Hager, J.C.: ‘Facial action coding system: investigator's guide’. Research Nexus, Network Information Research Corporation, 2002.
-
-
42)
-
22. Deng, H., Zhu, J., Lyu, M.R., King, I.: ‘Two-stage multi-class AdaBoost for facial expression recognition’. Proc. IJCNN, 2007, pp. 3005–3010.
-
-
43)
-
37. Buddharaju, P., Pavlidis, I., Tsiamyrtzis, I., Bazakos, I.: ‘Physiology-based face recognition in the thermal infrared spectrum’, IEEE Trans. PAMI, 2007, 29, (4), pp. 613–626 (doi: 10.1109/TPAMI.2007.1007).
-
-
44)
-
34. Chen, X.: ‘PCA-based face recognition in infrared imagery: baseline and comparative studies’. Workshop on Analysis and Modeling of Faces and Gestures, April 2003, pp. 127–134.
-
-
45)
-
46. Pantic, M., Valstar, M.F., Rademaker, R., Maat, L.: ‘Web-based database for facial expression analysis’. Proc. ICME, 2005, pp. 317–321.
-
-
46)
-
49. Zhi, R., Ruan, Q.: ‘Facial expression recognition based on two dimensional discriminant locality preserving projections’, Neuro Comput., 2008, pp. 1730–1734.
-
-
47)
-
39. Vana, J., Mracek, S., Poursaberi, A., Yanushkevich, S.N., Drahansky, M.: ‘Applying fusion in thermal face recognition’. BIOSIG, Germany, September 2012.
-
-
48)
-
52. Wang, J., Yin, L.: ‘Static topographic modeling for facial expression recognition and analysis’, Comput. Vis. Image Underst., 2007, 108, pp. 19–34 (doi: 10.1016/j.cviu.2006.10.011).
-
-
49)
-
2. TSA Guidance Package: ‘Biometrics for Airport Access Control’. September, 2005, www.acconline.org/documents/biometrics_guidance.pdf.
-
-
50)
-
16. Capdiferro, L., Casieri, V., Laurenti, A., Jacovitti, G.: ‘Multiple feature based multiscale image enhancement’, Proc. DSP, 2002, 2, pp. 931–934.
-
-
51)
-
4. MorphoTrak, http://www.morphotrak.com/MorphoTrak/MorphoTrak/mt_whoweare.html.
-
-
52)
-
41. Lee, S.W., Wang, P.S.P., Yanushkevich, S.N.: ‘Reconstruction based on photometric stereo’, J. IJPRAI, 2008, 22, (3), pp. 389–410.
-
-
53)
-
18. Frangi, A., Niessen, W., Vincken, K., Viergever, M.: ‘Multiscale vessel enhancement filtering’. Proc. MICCAI,(LNCS), 1998, pp. 130–137.
-
-
54)
-
13. Yanushkevich, S.N., Stoica, A., Shmerko, V.P.: ‘Fundamentals of biometric-based training system design’, ‘Image Pattern Recognition: Synthesis and Analysis in Biometrics’ (World Scientific, 2007), pp. 365–406.
-
-
55)
-
43. Royal, R.F., Schutt, S.R.: ‘The gentle art of interviewing and interrogation: a professional manual and guide’ (Prentice-Hall, 1976).
-
-
56)
-
47. Lynos, M., Budynek, J., Akamatsu, S.: ‘Automatic classification of single facial images’, IEEE Trans. PAMI, 1999, 21, pp. 1357–1362 (doi: 10.1109/34.817413).
-
-
57)
-
57. Tonouchi, M.: ‘Cutting-edge terahertz technology’, Nat. Photonics, 2007, 1, (2), pp. 97–105 (doi: 10.1038/nphoton.2007.3).
-
-
1)