Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Tucker tensor decomposition-based tracking and Gaussian mixture model for anomaly localisation and detection in surveillance videos

© The Institution of Engineering and Technology
Received 10/10/2017, Accepted 01/05/2018, Revised 27/03/2018, Published 03/05/2018

The anomaly detection and localisation (ADL) gains remarkable interest as dealing with the complex surveillance videos for detecting the abnormal behaviour is tedious. The human effort in monitoring and classifying the abnormal object is inaccurate and time-consuming; therefore, the method is proposed using the Tucker tensor decomposition (TTD) and classification of the objects using Gaussian mixture model (GMM). Initially, the object is detected in the frames for easy recognition using simple background subtraction. The TTD decomposes the tensor as core tensor and factor matrices and the two decomposed tensors are compared using the cosine similarity measure that determines the location of the object in the frame. Finally, the features including shape and speed of the object are extracted that is used for classification using the GMM that follows the maximum posterior probability principle to detect and locate the anomaly in the video. The experimentation for anomaly detection proves that the proposed TTD and TTD-GMM method attains a higher rate of multiple object tracking precision, accuracy, sensitivity, and specificity at 0.96375, 0.975, 1, and 1, respectively.

Inspec keywords: tensors; probability; image classification; video surveillance; mixture models; object detection; Gaussian processes; object tracking; matrix decomposition

Other keywords: core tensor; Tucker tensor decomposition-based tracking; simple background subtraction; TTD-GMM method; maximum posterior probability principle; factor matrices; multiple object tracking precision; abnormal behaviour detection; ADL; abnormal object classification; anomaly detection and localisation; Gaussian mixture model; abnormal object monitoring; complex surveillance videos; cosine similarity measure; object detection

Subjects: Algebra; Video signal processing; Algebra; Other topics in statistics; Computer vision and image processing techniques; Other topics in statistics; Image recognition

References

    1. 1)
      • 22. Lu, C., Shi, J., Jia, J.: ‘Abnormal event detection at 150 FPS in MATLAB’. Proc. IEEE Int. Conf. Computer Vision, Sydney, Australia, 2013, pp. 2720–2727.
    2. 2)
      • 34. Giovanis, E.: ‘Application of logit model and self-organizing maps (SOMs) for the prediction of financial crisis periods in US economy’, J. Financ. Econ. Policy, 2010, 2, (2), pp. 98–125.
    3. 3)
      • 18. Zhu, X., Jin, X., Zhang, X.Y., et al: ‘Context-aware local abnormality detection in crowded scene’, Sci. China Inf. Sci., 2015, 58, (5), pp. 1–11.
    4. 4)
      • 27. Zoidi, O., Tefas, A., Pitas, I.: ‘Visual object tracking based on local steering Kernels and color histograms’, IEEE Trans. Circuits Syst. Video Technol., 2013, 23, (5), pp. 870–882.
    5. 5)
      • 30. Dataset. Available at http://www.svcl.ucsd.edu/projects/anomaly/dataset.htm, accessed September 2017.
    6. 6)
      • 8. Cong, Y., Yuan, J., Liu, J.: ‘Sparse reconstruction cost for abnormal event detection’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, RI, USA, June 2011, pp. 3449–3456.
    7. 7)
      • 6. Narasimhan, M.G., Kamath, S.S.: ‘Dynamic video anomaly detection and localization using sparse denoisingautoencoders’. Multimedia Tools Appl., 2017, pp. 1–23.
    8. 8)
      • 17. Li, H., Achim, A., Bull, D.: ‘Unsupervised video anomaly detection using feature clustering’, IET Signal Process., 2012, 6, (5), pp. 521–533.
    9. 9)
      • 31. Adam, A., Rivlin, E., Shimshoni, I., et al: ‘Robust real-time unusual event detection using multiple fixed-location monitors’, IEEE Trans. Pattern Anal. Mach. Intell., 2008, 30, (3), pp. 555–560.
    10. 10)
      • 28. Wang, D., Lu, H., Bo, C.: ‘Visual tracking via weighted local cosine similarity’, IEEE Trans. Cybern., 2015, 45, (9), p. 1838–1850.
    11. 11)
      • 32. Loy, C.C., Xiang, T., Gong, S.: ‘Modelling multi-object activity by Gaussian processes’. Proc. British Machine Vision Conf., London, UK, 2009, pp. 1–11.
    12. 12)
      • 5. Chaker, R., Aghbari, Z.A., Junejo, I.N.: ‘Social network model for crowd anomaly detection and localization’, Pattern Recognit., 2017, 61, pp. 266–281.
    13. 13)
      • 11. Sun, X., Yao, H., Ji, R., et al: ‘Unsupervised fast anomaly detection in crowds’. Proc. ACM Int. Conf. Multimedia, Scottsdale, AZ, USA, December 2011, pp. 1469–1472.
    14. 14)
      • 20. Yuan, Y., Wang, D., Wang, Q.: ‘Anomaly detection in traffic scenes via spatial-aware motion reconstruction’, IEEE Trans. Intell. Transp. Syst., 2017, 18, (5), pp. 1198–1209.
    15. 15)
      • 10. Wu, S., Moore, B.E., Shah, M.: ‘Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, USA, June 2010, pp. 2054–2060.
    16. 16)
      • 1. Sabokrou, M., Fayyaz, M., Fathy, M., et al: ‘Deep-cascade: cascading 3D deep neural networks for fast anomaly detection and localization in crowded scenes’, IEEE Trans. Image Process., 2017, 26, (4), pp. 1992–2004.
    17. 17)
      • 33. Hu, X., Hu, S., Huang, Y., et al: ‘Video anomaly detection using deep incremental slow feature analysis network’, IET Comput. Vis., 2016, 10, (4), pp. 258–265.
    18. 18)
      • 9. Kim, J., Grauman, K.: ‘Observe locally, infer globally: a space-time MRF for detecting abnormal activities with incremental updates’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, USA, June 2009, pp. 2921–2928.
    19. 19)
      • 7. Cheng, K.W., Chen, Y.T., Fang, W.H.: ‘Gaussian process regression-based video anomaly detection and localization with hierarchical feature representation’, IEEE Trans. Image Process., 2015, 24, (12), pp. 5288–5301.
    20. 20)
      • 13. Mahadevan, V., Li, W., Bhalodia, V., et al: ‘Anomaly detection in crowded scenes’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, USA, 2010, pp. 1975–1981.
    21. 21)
      • 19. Ye, R., Li, X.: ‘Collective representation for abnormal event detection’, J. Comput. Sci. Technol., 2017, 32, (3), pp. 470–479.
    22. 22)
      • 25. Kong, X., Wang, Y., Xiang, T.: ‘Robust complex behaviour modeling at 90 Hz’. Proc. Thirtieth AAAI Conf. Artificial Intelligence, Phoenix, AZ, USA, 2016, pp. 3516–3522.
    23. 23)
      • 3. Li, C.T., Lin, S.D.: ‘Social flocks: a crowd simulation framework for social network generation, community detection, and collective behaviour modelling’. Proc. 17th ACM SIGKDD Int. Conf. Knowledge Discovery and Data Mining, San Diego, CA, USA, August 2011, pp. 765–768.
    24. 24)
      • 15. Cong, Y., Yuan, J., Liu, J.: ‘Abnormal event detection in crowded scenes using sparse representation’, Pattern Recognit., 2013, 46, (7), pp. 1851–1864.
    25. 25)
      • 4. Biswas, S., Gupta, V.: ‘Abnormality detection in crowd videos by tracking sparse components’, Mach. Vis. Appl., 2017, 28, (1, 2), pp. 35–48.
    26. 26)
      • 29. Maligo, A., Lacroix, S.: ‘Classification of outdoor 3D lidar data based on unsupervised Gaussian mixture models’, IEEE Trans. Autom. Sci. Eng., 2017, 14, (1), pp. 5–16.
    27. 27)
      • 14. Zhu, X., Liu, J., Wang, J., et al: ‘Sparse representation for robust abnormality detection in crowded scenes’, Pattern Recognit., 2014, 47, (5), pp. 1791–1799.
    28. 28)
      • 26. Xu, Y., Yin, W.: ‘A block coordinate descent method for regularized multiconvex optimization with applications to nonnegative tensor factorization and completion’, SIAM J. Imaging Sci., 2013, 6, (3), pp. 1758–1789.
    29. 29)
      • 23. Chockalingam, T., Emonet, R., Odobez, J.M.: ‘Localized anomaly detection via hierarchical integrated activity discovery’. Proc. 10th IEEE Int. Conf. Advanced Video and Signal Based Surveillance, Krakow, Poland, 2013, pp. 51–56.
    30. 30)
      • 16. Raghavendra, R., Bue, A.D., Cristani, M., et al: ‘Optimizing interaction force for global anomaly detection in crowded scenes’. Proc. IEEE Conf. Computer Vision Workshops, Barcelona, Spain, November 2011, pp. 136–143.
    31. 31)
      • 2. Wyatt, D.: ‘Collective modeling of human social behavior’ AAAI Spring Symp.: Human BehaviorModeling, Palo Alto, CA, USA, 2009.
    32. 32)
      • 12. Li, W., Mahadevan, V., Vasconcelos, N.: ‘Anomaly detection and localization in crowded scenes’, IEEE Trans. Pattern Anal. Mach. Intell., 2014, 36, (1), pp. 18–32.
    33. 33)
      • 21. Zhou, S., Shen, W., Zeng, D., et al: ‘Spatial–temporal convolutional neural networks for anomaly detection and localization in crowded scenes’, Signal Process., Image Commun., 2016, 47, pp. 358–368.
    34. 34)
      • 24. Jouneau, E., Carincotte, C.: ‘Particle-based tracking model for automatic anomaly detection’. Proc. 18th IEEE Int. Conf. Image Processing, Brussels, Belgium, 2011, pp. 513–516.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2017.0469
Loading

Related content

content/journals/10.1049/iet-cvi.2017.0469
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address