access icon free ForenFace: a unique annotated forensic facial image dataset and toolset

© The Institution of Engineering and Technology
Received 02/11/2016, Accepted 16/05/2017, Revised 31/03/2017, Published 22/05/2017

Few facial image datasets are suitable for forensic research. In this study, the authors present ForenFace, a facial image and video dataset. It contains video sequences and extracted images of 97 subjects recorded with six different surveillance camera of various types. Moreover, it also contains high-resolution images and 3D scans. The novelty of this dataset lies in two aspects: (i) a subset of 435 images (87 subjects, five images per subject) has been manually annotated, yielding a very rich forensically relevant annotation of almost 19.000 facial parts, and (ii) making available a toolset to create, view, and extract the annotation. The authors present protocols and the result of a baseline experiment in which two commercial software packages and an annotated facial feature contained in this dataset are compared. The dataset, the annotation and tools are available under a usage license.

Inspec keywords: image resolution; image sensors; image forensics; video signal processing; video surveillance; face recognition; feature extraction; image sequences

Other keywords: forensic facial image toolset; video dataset; video sequences; annotated facial feature; image extraction; ForenFace; image resolution; commercial software packages; forensic facial image dataset; surveillance camera; forensic research

Subjects: Video signal processing; Television and video equipment, systems and applications; Computer vision and image processing techniques; Image sensors; Image recognition

References

    1. 1)
      • 25. Dallmeier website. Available at http://www.dallmeier.com, accessed 04 January 2016.
    2. 2)
      • 15. Face Recognition Vendor Test (FRVT) – Performance of Face Identification Algorithms, NIST Interagency Report 8009. Available at http://biometrics.nist.gov/cs_links/face/frvt/frvt2013/NIST_8009.pdf, accessed 07 April 2016.
    3. 3)
      • 23. Vera-Rodriguez, R., Tome, P., Fierrez, J., et al: ‘Analysis of the variability of facial landmarks in a forensic scenario’. Biometrics and Forensics (IWBF), 2013 Int. Workshop on, April 2013, pp. 1–4.
    4. 4)
      • 19. Grgic, M., Delac, K., Grgic, S.: ‘SCFace - surveillance cameras face database’, Multimedia Tools Appl., 2011, 51, (3), pp. 863–879.
    5. 5)
      • 17. Le, V., Brandt, J., Lin, Z., et al: ‘Interactive facial feature localization’, in Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (Eds.): ‘Computer vision ECCV 2012’ (Springer, Berlin Heidelberg, 2012), (LNCS, 7574), pp. 679–692.
    6. 6)
      • 24. ForenFace website. Available at http://scs.ewi.utwente.nl/downloads/show,ForenFace/, accessed 08 June 2016.
    7. 7)
      • 2. Prince, J.P.: ‘To examine emerging police use of facial recognition systems and facial image comparison procedures’, 2012. Available at www.churchilltrust.com.au/media/fellows/2012_Prince_Jason.pdf, accessed 22 April 2014.
    8. 8)
      • 8. Tome, P., Fierrez, J., Vera-Rodriguez, R., et al: ‘Identification using face regions: Application and assessment in forensic scenarios’, Forensic Science Int., 2013, 233, (13), pp. 75–83.
    9. 9)
      • 18. Neves, J.C., Santos, G., Filipe, S., et al: ‘Quis-Campi: extending in the wild biometric recognition to surveillance environments’ (Springer International Publishing, Cham, 2015), pp. 59–68.
    10. 10)
      • 14. Phillips, P.J., Scruggs, W.T., O'Toole, A.J., et al: ‘FRVT 2006 and ICE 2006 large-scale experimental results’, IEEE Trans. Pattern Anal. Mach. Intell., 2010, 32, (5), pp. 831–846.
    11. 11)
      • 22. Ricanek, K.Jr., Tesafaye, T.: ‘MORPH: a longitudinal image database of normal adult age-progression’. Proc. of the 7th Int. Conf. on Automatic Face and Gesture Recognition, FGR ‘06, Washington, DC, USA, 2006, IEEE Computer Society, pp. 341–345.
    12. 12)
      • 5. FISWG Facial Image Comparison Feature List for Morphological Analysis. Available at https://fiswg.org/FISWG_1to1_Checklist_v1.0_2013_11_22.pdf, accessed 09 January 2017.
    13. 13)
      • 11. Turk, M., Pentland, A.: ‘Eigenfaces for recognition’, J. Cogn. Neurosci., 1991, 3, (1), pp. 71–86.
    14. 14)
      • 3. FISWG website. Available at https://fiswg.org, accessed 22 April 2014.
    15. 15)
      • 9. Tome, P., Fierrez, J., Vera-Rodriguez, R., et al: ‘Facial soft biometric features for forensic face recognition’, Forensic Sci. Int., 2015, 257, pp. 271–284.
    16. 16)
      • 10. Kanade, T.: ‘Picture processing system by computer complex and recognition of human faces’. Doctoral dissertation, Kyoto University, November 1973.
    17. 17)
      • 20. Wong, Y., Chen, S., Mau, S., et al: ‘Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition’. IEEE Biometrics Workshop, Computer Vision and Pattern Recognition (CVPR) Workshops, IEEE, June 2011, pp. 81–88.
    18. 18)
      • 26. MeshLab website. Available at http://meshlab.sourceforge.net, accessed 08 January 2016.
    19. 19)
      • 21. NIST Mugshot Identification Database. Available at http://www.nist.gov/srd/nistsd18.cfm, accessed 25 April 2016.
    20. 20)
      • 13. Jonathon Phillips, P., Moon, H., Rizvi, S.A., et al: ‘The FERET evaluation methodology for face-recognition algorithms’, IEEE Trans. Pattern Anal. Mach. Intell., 2000, 22, (10), pp. 1090–1104.
    21. 21)
      • 30. Cognitec FaceVACS website. Available at http://www.cognitec.com/products.html, accessed 29 December 2015.
    22. 22)
      • 4. FISWG Guidelines for Facial Comparison Methods. Available at https://fiswg.org/FISWG_GuidelinesforFacialComparisonMethods_v1.0_2012_02_02.pdf, accessed 09 January 2017.
    23. 23)
      • 27. Bartels, R.H., Beatty, J.C., Barsky, B.A.: ‘An introduction to splines for use in computer graphics and geometric modeling’ (Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1987).
    24. 24)
      • 28. Park, U., Jillela, R., Ross, A., et al: ‘Periocular biometrics in the visible spectrum’, IEEE Trans. Inf. Forensics Sec., 2011, 6, (1), pp. 96–106.
    25. 25)
      • 29. Neurotechnology Verilook website. Available at http://www.neurotechnology.com/verilook.html, accessed 10 May 2016.
    26. 26)
      • 6. Zeinstra, C.G., Veldhuis, R.N.J., Spreeuwers, L.J.: ‘Towards the automation of forensic facial individualisation: comparing forensic to non forensic eyebrow features’. Proc. of the 35th WIC Symp. on Information Theory in the Benelux, Eindhoven, Netherlands, Enschede, May 2014, pp. 73–80, Centre for Telematics and Information Technology, University of Twente.
    27. 27)
      • 12. FRGC website. Available at http://www.nist.gov/itl/iad/ig/frgc.cfm, accessed 22 April 2014.
    28. 28)
      • 1. Spaun, N.A.: ‘Forensic Biometrics from Images and Video at the Federal Bureau of Investigation. In Biometrics: Theory, Applications, and Systems, 2007. BTAS 2007’. First IEEE Int. Conf. on, September 2007, pp. 1–3.
    29. 29)
      • 7. Zeinstra, C.G., Veldhuis, R. N.J., Spreeuwers, L.J.: ‘Beyond the eye of the beholder: on a forensic descriptor of the eye region’. 23rd European Signal Processing Conf., EUSIPCO 2015, Nice, IEEE Signal Processing Society, September 2015, pp. 779–783.
    30. 30)
      • 16. Huang, G.B., Ramesh, M., Berg, T., et al: ‘Labeled faces in the wild: a database for studying face recognition in unconstrained environments’. Technical Report 07-49, University of Massachusetts, Amherst, October 2007.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-bmt.2016.0160
Loading

Related content

content/journals/10.1049/iet-bmt.2016.0160
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading