Analysis of results of large-scale multimodal biometric identity verification experiment
- Author(s): Andrzej Czyżewski 1 ; Piotr Hoffmann 1 ; Piotr Szczuko 1 ; Adam Kurowski 1 ; Michał Lech 1 ; Maciej Szczodrak 1
-
-
View affiliations
-
Affiliations:
1:
Multimedia Systems Department , Gdańsk University of Technology , Faculty of Electronics, Telecommunication and Informatics, ul. Narutowicza 11/12, Gdańsk , Poland
-
Affiliations:
1:
Multimedia Systems Department , Gdańsk University of Technology , Faculty of Electronics, Telecommunication and Informatics, ul. Narutowicza 11/12, Gdańsk , Poland
- Source:
Volume 8, Issue 1,
January
2019,
p.
92 – 100
DOI: 10.1049/iet-bmt.2018.5030 , Print ISSN 2047-4938, Online ISSN 2047-4946
An analysis of a large set of biometric data obtained during the enrolment and the verification phase in an experimental biometric system installed in bank branches is presented. Subjective opinions of bank clients and of bank tellers were also surveyed concerning the studied biometric methods in order to discover and to explore relations emerging from the obtained multimodal dataset. First, data acquisition and identity verification methods are described in this study. Then, relationships between ratios of successful and failed verifications between pairs, triplets, and quartets of biometric modalities are studied. An analysis of the sentiment of clients and of banking tellers related to each identity verification attempt was performed based on linguistic methods. The data mining process is described, based on the rough sets methodology, aimed at deriving rules pertaining to consecutive identity verification attempts.
Inspec keywords: rough set theory; biometrics (access control); data mining; data acquisition
Other keywords: bank clients; verification phase; studied biometric methods; rough sets methodology; consecutive identity verification attempts; identity verification methods; large-scale multimodal biometric identity verification experiment; bank branches; multimodal dataset; data acquisition; verifications; identity verification attempt; data mining process; biometric data; experimental biometric system; bank tellers; biometric modalities; subjective opinions; banking tellers; linguistic methods
Subjects: Knowledge engineering techniques; Computer vision and image processing techniques; Data handling techniques; Combinatorial mathematics
References
-
-
1)
-
14. Czyżewski, A., Bratoszewski, P., Hoffmann, P., et al: ‘Performance analysis of developed multimodal biometric identity verification system’, Elektron. Konstrukcje, Technologie, Zastosowania, 2018, 59, (4), doi: 10.15199/13.2018.4.7.
-
-
2)
-
1. Ross, A., Jain, A.K.: ‘Multimodal biometrics: an overview’. 12th European Signal Processing Conf. (EUSIPCO), Vienna, Austria, 2004, pp. 1221–1224.
-
-
3)
-
35. Janusz, A., Ślęzak, D.: ‘Random probes in computation and assessment of approximate reducts’. Proc. of RSEISP, Granada and Madrid, Spain, 2014(LNCS, 8537), pp. 53–64.
-
-
4)
-
36. Zhong, N., Dong, J., Ohsuga, S.: ‘Using rough sets with heuristics for feature selection’, J. Intell. Inf. Syst., 2001, 16, p. 199, doi: 10.1023/A:1011219601502.
-
-
5)
-
22. Szczodrak, M., Czyżewski, A.: ‘Evaluation of face detection algorithms for the bank client identity verification’, Found. Comput. Decis. Sci., 2017, 42, (2), pp. 137–148.
-
-
6)
-
23. Bratoszewski, P., Czyżewski, A., Hoffmann, P., et al: ‘Pilot testing of developed multimodal biometric identity verification system’. Signal Processing, Algorithms, Architectures, Arrangements, and Applications, Poznań, Poland, 2017, pp. 184–189. 20.9.2017-22.9.2017.
-
-
7)
-
6. Fierrez, J., Ortega-Garcia, J., Toledano, D.T., et al: ‘Biosec baseline corpus: a multimodal biometric database’, Pattern Recognit., 2007, 40, (4), pp. 1389–1392, doi: 10.1016/j.patcog.2006.10.014.
-
-
8)
-
29. Ma, Z., Feng, J., Chen, L., et al: ‘An improved approach to terms weighting in text classification’. Int. Conf. Computer and Management (CAMAN), Wuhan, China, 19–21 May 2011.
-
-
9)
-
21. McCool, C., Marcel, S., Hadid, A., et al: ‘Bi-Modal person recognition on a mobile phone: using mobile phone data’. IEEE ICME Workshop on Hot Topics in Mobile Mutlimedia, Melbourne, VIC, Australia, 2012.
-
-
10)
-
15. Szczuko, P., Czyżewski, A., Szczodrak, M.: ‘Variable length sliding models for banking clients face biometry’, in ‘Multimedia tools and Applications’ (Springer, 2018), pp. 1–18, doi: 10.1007/s11042-018-6432-4, in print.
-
-
11)
-
3. Faundez-Zanuy, M., Fierrez-Aguilar, J., Ortega-Garcia, J., et al: ‘Multimodal biometric databases: an overview’, IEEE Aerosp. Electron. Syst. Mag., 2006, 21, (8), pp. 29–37, doi: 10.1109/MAES.2006.1703234.
-
-
12)
-
27. Na, J.-C., Khoo, C., Horng Jyh Wu, P.: ‘Use of negation phrases in automatic sentiment classification of product reviews’, Libr. Collect., Acquis., Tech. Serv., 2005, 29, (2), pp. 180–191. https://doi.org/10.1016/j.lcats.2005.04.007.
-
-
13)
-
8. Ho, C.C., Ng, H., Tan, W.W., et al: ‘MMU GASPFA: a COTS multimodal biometric database’, Pattern Recognit. Lett., 2013, 34, (15), pp. 2043–2050, doi: 10.1016/j.patrec.2013.01.027.
-
-
14)
-
10. Shang, D., Zhang, X., Han, J., et al: ‘MultiModal-database-XJTU: an available database for biometrics recognition with its performance testing’. IEEE 3rd Information Technology and Mechatronics Engineering Conf. (ITOEC), Chongqing, China, 2017, pp. 521–526, doi: 10.1109/ITOEC.2017.8122351.
-
-
15)
-
7. Fierrez, J., Galbally, J., Ortega-Garcia, J., et al: ‘BiosecurID: a multimodal biometric database’, Pattern Anal. Appl., 2010, 13, p. 235, doi: org/10.1007/s10044-009-0151-4.
-
-
16)
-
31. Pawlak, Z.: ‘Rough sets’, Int. J. Comput. Inf. Sci., 1982, 11, p. 341, https://doi.org/10.1007/BF01001956.
-
-
17)
-
32. Bazan, J.G., Peters, J.F., Skowron, A.: ‘Behavioral pattern identification through rough set modelling’. Rough Sets, Fuzzy Sets, Data Mining, and Granular Gomputing. RSFDGrC, Springer, Berlin, Heidelberg, 2005(LNCS, 3642), pp. 688–697.
-
-
18)
-
24. Bratoszewski, P., Czyżewski, A.: ‘Face profile view retrieval using time of flight camera image analysis’. Pattern Recognition and Machine Intelligence, PReMI 2015, Warsaw, Poland, 2015(LNCS, 9124).
-
-
19)
-
18. Wang, H., Can, D., Kazemzadeh, A., et al: ‘A system for real-time Twitter sentiment analysis of 2012 U.S. Presidential election cycle’. Proc. ACL System Demonstrations, Jeju, Republic of Korea, 2012, pp. 115–120.
-
-
20)
-
12. Snelick, R., Uludag, U., Mink, A., et al: ‘Large-scale evaluation of multimodal biometric authentication using state-of-the-art systems’, IEEE Trans. Pattern Anal. Mach. Intell., 2005, 27, (3), pp. 450–455.
-
-
21)
-
13. Szczuko, P., Czyżewski, A., Hoffmann, P., et al: ‘Validating data acquired with experimental multimodal biometric system installed in bank branches’, J. Intell. Inf. Syst., 2017, pp. 1–31, doi: 10.1007/s10844-017-0491-2.
-
-
22)
-
26. Na, J., Sui, H., Khoo, C., et al: ‘Effectiveness of simple linguistic processing in automatic sentiment classification of product reviews’. Conf. Int. Society for Knowledge Organization (ISKO), Wurzburg, Germany, November 2004, pp. 49–54.
-
-
23)
-
33. Nguyen, S.H.: ‘On efficient handling of continuous attributes in large data bases’, Fundam. Inform., 2001, 48, (1), pp. 61–81.
-
-
24)
-
25. Fujitsu Identity Management and PalmSecure. Available at https://www.fujitsu.com/au/Images/PalmSecure_Global_Solution_Catalogue.pdf, accessed 20 January 2018.
-
-
25)
-
16. Greaves, F, Ramirez-Cano, D, Millett, C, et al: ‘Use of sentiment analysis for capturing patient experience from free-text comments posted online’, J. Med. Internet Res., 2013, 15, (11), p. 239. doi: 10.2196/jmir.2721.
-
-
26)
-
5. Ortega-Garcia, J., Fierrez-Aguilar, J., Simon, D., et al: ‘MCYT baseline corpus: a bimodal biometric database’, IEE Proc., Vis. Image Signal Process., 2003, 150, (6), pp. 395–401, doi: 10.1049/ip-vis:20031078.
-
-
27)
-
28. Trstenjak, B., Mikac, S., Donko, D.: ‘KNN with TF-IDF based framework for text categorization’, Procedia Eng., 2014, 69, pp. 1356–1364. https://doi.org/10.1016/j.proeng.2014.03.129.
-
-
28)
-
34. Janusz, A., Stawicki, S.: ‘Applications of approximate reducts to the feature selection problem’. Proc. Int. Conf. Rough Sets and Knowledge Technology (RSKT), Banff, Canada, vol. 6954, 2011, pp. 45–50.
-
-
29)
-
11. NIST FERET Face Recognition Technology, www.nist.gov/programs-projects/face-recognition-technology-feret.
-
-
30)
-
4. Garcia-Salicetti, S., Beumier, C., Chollet, G., et al: ‘BIOMET: a multimodal person authentication database including face, voice, fingerprint, hand and signature modalities’. Audio- and Video-Based Biometric Person Authentication (AVBPA 2003), Berlin, (LNCS, 2688), 2003, doi: 10.1007/3-540-44887-X_98.
-
-
31)
-
9. NIST BSSR1 biometric score set, Available at: www.nist.gov/itl/iad/image-group/nist-biometric-scores-set-bssr1.
-
-
32)
-
30. Pawlak, Z.: ‘Rough sets theoretical aspects of reasoning about data’ (Kluwer, Dordrecht, 1991).
-
-
33)
-
20. ALIZE, Open source recognition, University of Avignon. Available at http://mistral.univ-avignon.fr, accessed 21 January 2018.
-
-
34)
-
17. Duan, W., Cao, Q., Yu, Y., et al: ‘Mining online user-generated content: using sentiment analysis technique to study hotel service quality’. 46th Hawaii Int. Conf. System Sciences, Wailea, Maui, HI, USA, 2013, pp. 3119–3128. doi: 10.1109/HICSS.2013.400.
-
-
35)
-
19. Chen, W., Hong, Q., Li, X.: ‘GMM-UBM for text-dependent speaker recognition’. Int. Conf. Audio, Language and Image Processing, Shanghai, 2012, pp. 432–435.
-
-
36)
-
2. Jain, A., Nandakumar, K., Ross, A.: ‘Score normalization in multimodal biometric systems’, Pattern Recognit., 2005, 38, (12), pp. 2270–2285, doi: 10.1016/j.patcog.2005.01.012.
-
-
1)