Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Forensic video solution using facial feature-based synoptic Video Footage Record

© The Institution of Engineering and Technology
Received 28/07/2015, Accepted 05/01/2016, Revised 25/11/2015, Published 09/03/2016

Person specific identification is an important problem in computer vision. However, forensic video analysis is the tool in surveillance applications, such as a specific person Video Footage Record can be used to help personalised monitoring. This study proposes a solution to identify the specific person very quickly through offline which will be valuable to analyse the incident/crime earlier. The main idea of this study is to reduce the enormous volume of video data by using an object-based video synopsis. After that, Viola–Jones face detection, deformable part based models are used to detect the face attributes. Subsequently, histogram of oriented gradients and oriented centre symmetric local binary pattern features are extracted. Support vector machine classifier is used to classify the weak and strong features. These strong features are used to recognise the person. The algorithm works well even in complicated situations such as expression changes, pose, illumination variations and even if the face is partially as well as fully occluded in few frames. The advantage of synoptic video helps to recognise the person who is not occluded in some other frames. Experimental results on benchmark and real time datasets demonstrate the effectiveness of the proposed algorithm.

Inspec keywords: emotion recognition; feature extraction; face recognition; support vector machines; video signal processing; digital forensics

Other keywords: personalised monitoring; face attribute detection; facial feature; specific person video footage record; object-based video synopsis; incident-crime analysis; forensic video solution; feature extraction; oriented gradient histogram; oriented centre symmetric local binary pattern; support vector machine classifier; Viola-Jones face detection; synoptic video footage record; surveillance applications; deformable part

Subjects: Data security; Knowledge engineering techniques; Computer vision and image processing techniques; Video signal processing; Image recognition

References

    1. 1)
      • 23. Ojala, T., Pietikainen, M., Maenpaa, T.: ‘Multiresolution gray-scale and rotation invariant texture classification with local binary patterns’, IEEE Trans. Pattern Anal. Mach. Intell., 2002, 24, (7), pp. 971–987.
    2. 2)
      • 17. Huang, D., Shan, C., Wang, Y.: ‘Local binary patterns and its application to facial image analysis: a survey’, IEEE Trans. Syst. Man Cybern., 2011, 41, (6), pp. 765–781.
    3. 3)
      • 15. Felzenszwalb, P., McAllester, D., Ramanan, D.: ‘A discriminatively trained, multi scale, deformable part model’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Anchorage, June 2008, pp. 1–8.
    4. 4)
      • 18. Stauffer, C., Grimson, L.E.W.: ‘Adaptive background mixture models for real-time tracking’. Proc. IEEE Int. Conf. Computer Vision Pattern Recognition, Fort Collins, June 1999, pp. 23–25.
    5. 5)
      • 7. Petrovic, N., Jojic, N., Huang, S.T.: ‘Adaptive video fast forward’, Multimedia Tools Appl., 2005, 26, (3), pp. 327–344.
    6. 6)
      • 11. Zhang, B., Song, Y., Guan, S., et al: ‘Historic Chinese architectures image retrieval by SVM and pyramid histogram of oriented gradients features’, Int. J. Soft Comput., 2010, 5, (2), pp. 19–28.
    7. 7)
      • 21. Yu, X., Huang, J., Zhang, S., et al: ‘Pose-free facial landmark fitting via optimized part mixtures and cascaded deformable shape model’. Proc. IEEE Int. Conf. Computer Vision, Sydney, December 2013, pp. 1944–1951.
    8. 8)
      • 25. Eum, S., Suhr, K.J., Kim, J.: ‘Face recognizability evaluation for ATM applications with exceptional occlusion handling’. Proc. Computer Vision and Pattern Recognition Workshop, Colorado Springs, June 2011, pp. 82–89.
    9. 9)
      • 24. Ko, C., Jung, B., Nam, J.: ‘View-independent object detection using shared local features’, J. Vis. Lang. Comput., 2015, 28, (C), pp. 56–70.
    10. 10)
      • 10. Takeo, K.: ‘Picture processing by computer complex and recognition of human faces’. PhD thesis, Kyoto University, 1973.
    11. 11)
      • 22. Heikkila, M., Pietikainen, M., Schmid, C.: ‘Description of interest regions with center-symmetric local binary patterns’. Proc. Int. Conf. Vision Graphics and Image Processing, Madurai, India, December 2006, pp. 58–69.
    12. 12)
      • 26. Fischler, M., Elschlager, R.: ‘The representation and matching of pictorial structures’, IEEE Trans. Comput., 1973, 22, (1), pp. 67–92.
    13. 13)
      • 16. Dalal, N., Triggs, B.: ‘Histogram of oriented gradients for human detection’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Diego, June 2005, pp. 886–893.
    14. 14)
      • 9. Fu, W., Wang, J., Gui, L., et al: ‘Online video synopsis of structured motion’, Neurocomputing, 2014, 135, (50), pp. 155–162.
    15. 15)
      • 3. Truong, B., Venkatesh, S.: ‘Video abstraction: a systematic review and classification’, ACM Trans. Multimedia Comput. Commun. Appl. (TOMCCAP), 2007, 3, (1), pp. 1–37.
    16. 16)
      • 12. Zhu, Z., Gao, J., Yu, H.: ‘Real-time face detection algorithm using fractal features in MPEG-4 video stream’, J. Convergence Inf. Technol., 2012, 7, (6), pp. 54–62.
    17. 17)
      • 8. Smith, M., Kanade, T.: ‘Video skimming and characterization through the combination of image and language understanding techniques’. Proc. Conf. Computer Vision and Pattern Recognition, San Juan, June 1997, pp. 775–781.
    18. 18)
      • 14. Nikolaidis, A., Pitas, I.: ‘Facial feature extraction and pose determination’, Pattern Recognit., 2000, 33, (11), pp. 1783–1791.
    19. 19)
      • 2. Chakraborty, S., Tickoo, O., Iyer, R.: ‘Adaptive key frame selection for video summarization’. Proc. IEEE. Conf. Applications of Computer Vision, Waikoloa, January 2015, pp. 702–709.
    20. 20)
      • 27. Duin, R.P.W., Juszczak, P., Paclik, P., et al: ‘PRTools4.1, a matlab toolbox for pattern recognition’, Delft University of Technology, 2007.
    21. 21)
      • 20. Rav-Acha, A., Pritch, Y., Peleg, S.: ‘Making a long video short: dynamic video synopsis’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, New York, June 2006, pp. 435–441.
    22. 22)
      • 5. Teng, Li.: ‘Video M: multi-video synopsis’. Proc. IEEE Int. Conf. on Data Mining Workshops, Pisa, December 2008, pp. 854–861.
    23. 23)
      • 1. Pritch, Y., Rav-Acha, A., Peleg, S.: ‘Non-chronological video synopsis and indexing’, IEEE Trans. Pattern Anal. Mach. Intell., 2008, 30, (11), pp. 1971–1984.
    24. 24)
      • 13. Viola, P., Jones, M.: ‘Robust real-time object detection’, Int. J. Comput. Vis., 2004, 57, (2), pp. 137–154.
    25. 25)
      • 19. Damnjanovic, U.: ‘Event detection and clustering for surveillance video summarization’. Proc. IEEE Conf. Image Analysis for Multimedia Interactive Services, Klagenfurt, May 2008, pp. 63–66.
    26. 26)
      • 4. Pritch, Y.: ‘Clustered synopsis of surveillance video’. Proc. IEEE Int. Conf. Advanced Video and Signal Based Surveillance, Washington, September 2009, pp. 195–200.
    27. 27)
      • 6. Nie, Y., Xiao, C.: ‘Compact video synopsis via global spatiotemporal optimization’, IEEE Trans. Vis. Comput. Graph., 2013, 19, (10), pp. 1664–1676.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2015.0238
Loading

Related content

content/journals/10.1049/iet-cvi.2015.0238
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address