The moving target detection and tracking in aerial video is a challenge task because of its moving background, smaller target sizes, lower resolution and limited onboard computing resources. In this study, a high confidence detection method based on background compensation and three-frame-difference method is designed, which can detect moving objects in a dynamic background accurately. First, the authors use local feature extraction and matching for image registration and demonstrate that speed-up robust feature key points are suitable for the stabilisation task. Then, they estimate the global camera motion parameters using affine transformation which are obtained by the random sample consensus algorithm. Finally, they detect moving object by three-frame-difference method. As the detection results of the frame-difference method generally exists ‘empty’ and noise, in order to select the two higher-quality differential images to perform the logic AND operation, they add image quality assessment to the three-frame-difference method to obtain more accurate moving objects. Moreover, the edge detection algorithm and morphological processing are integrated together to further boost the overall detecting performance. The extensive empirical evaluations on aerial videos demonstrate that the proposed detector is very promising for the various challenging scenarios.

References

1. 1)
  - 2. Lipton, A.J., Fujiyoshi, H., Patil, R.S.: ‘Moving target classification and tracking from real-time video’. Proc. Fourth IEEE Workshop on Applications of Computer, Princeton, NJ, USA, 1998, p. 8.
2. 2)
  - 4. Choi, Y., Zaijun, P., Kim, S., et al: ‘Salient motion information detection technique using weighted subtraction image and motion vector’. Int. Conf. Hybrid Information Technology, Cheju Island, South Korea, 2006, pp. 263–269.
3. 3)
  - 24. Chen, X., Yuren, D.U., Gao, X.: ‘A fast algorithm of image feature points matching based on surf’, J. Yangzhou Univ., 2012, 15, (4), pp. 64–67.
4. 4)
  - 28. Azad, V., Sharma, P.: ‘A review on objective image quality assessment techniques’, Int. J. Emerging Eng. Res. Technol., 2014, 2, (5), pp. 188–192.
5. 5)
  - 8. Xu, L., Lin, X.: ‘Digital image stabilization based on circular block matching’, IEEE Trans. Consum. Electron., 2006, 52, (2), pp. 566–574.
6. 6)
  - 30. Kasturi, R., Goldgof, D., Soundararajan, P., et al: ‘Framework for performance evaluation of face, text, and vehicle detection and tracking in video: data, metrics, and protocol’, IEEE Trans. Pattern Anal. Mach. Intell., 2009, 31, (2), pp. 319–336.
7. 7)
  - 20. Thakoor, N., Gao, J.: ‘Automatic object detection in video sequences with camera in motion’. Proceedings of Advanced Concepts for Intelligent Vision Systems, Brussels, Belgium, 2004, pp. 1–7.
8. 8)
  - 17. Elgammal, A., Duraiswami, R., Harwood, D., et al: ‘Background and foreground modeling using non-parametric kernel density estimation for visual surveillance’, Proc. IEEE, 2002, 90, (7), pp. 1151–1163.
9. 9)
  - 21. Zhang, Y., Kiselewich, S.J., Bauson, W.A., et al: ‘Robust moving object detection at distance in the visible spectrum and beyond using a moving camera’. 2006 Conf. Computer Vision and Pattern Recognition Workshop CVPRW ‘06, New York, USA, 2006, p. 131.
10. 10)
  - 5. Liu, H., Hong, T.-H., Herman, M., et al: ‘Accuracy vs. efficiency trade-offs in optical flow algorithms’, Comput. Vis. Image Underst., 1998, 72, (3), pp. 271–286.
11. 11)
  - 11. Battiato, S., Gallo, G., Puglisi, G., et al: ‘Sift features tracking for video stabilization’. Int. Conf. Image Analysis and Processing, Modena, Italy, 2009, pp. 825–830.
12. 12)
  - 31. Wang, X., Swears, E., Hoogs, A.: ‘A large-scale benchmark dataset for event recognition in surveillance video’. IEEE Int. Conf. Advanced Video & Signal based Surveillance, Klagenfurt, Austria, 2011.
13. 13)
  - 22. Ting, Z., Chang, H., Xiao, Y.: ‘Improvement of feature point extraction algorithm based on SIFT’, Inf. Commun., 2016, 158, (2), pp. 66–67.
14. 14)
  - 16. Walha, A., Wali, A., Alimi, A.M.: ‘Moving object detection system in aerial video surveillance’. Int. Conf. Advanced Concepts for Intelligent Vision Systems, Poznan, Poland, 2013, pp. 310–320.
15. 15)
  - 1. Roth, S., Black, M.J.: ‘On the spatial statistics of optical flow’. Tenth IEEE Int. Conf. Computer Vision, Beijing, China, 2005, pp. 42–49.
16. 16)
  - 18. Walha, A., Wali, A., Alimi, A.M.: ‘Support vector machine approach for detecting events in video streams’, Commun. Comput. Inf. Sci., 2012, 322, pp. 143–151.
17. 17)
  - 10. Roujol, S., de Senneville, B.D., Hey, S., et al: ‘Robust adaptive extended Kalman filtering for real time MR-thermometry guided HIFU interventions’, IEEE Trans. Med. Imaging, 2012, 31, (3), pp. 533–542.
18. 18)
  - 25. Qianwen, W.: ‘Research on improved SURF description and its application in clothes image retrieval’ (University of Electronic and Technology of China, 2014).
19. 19)
  - 23. Liu, Q., Ming-Yi, H.E.: ‘Image stitching based on SURF feature matching’, Meas. Control Technol., 2010, 29, (10), pp. 27–31.
20. 20)
  - 14. Cucchiara, R., Prati, A., Vezzani, R.: ‘Advanced video surveillance with pan tilt zoom cameras’. Proc. Workshop on Visual Surveillance (VS) at ECCV, Graz, Austrian, 2006.
21. 21)
  - 29. Mohammadi, P., Ebrahimimoghadam, A., Shirani, S.: ‘Subjective and objective quality assessment of image: a survey’, Majlesi J. Electr. Eng., 2015, 9, (1), pp. 55–83.
22. 22)
  - 3. Gao, M.F., Liu, D.: ‘Moving object detection based on consecutive blocks frame difference and background subtraction’, Appl. Res. Comput., 2013, 30, (1), pp. 299–302.
23. 23)
  - 27. Yan, A., Li, J., Wang, A., et al: ‘Color moving object segmentation based on mixture Gaussian models’. Int. Conf. Natural Computation, Yantai, China, 2010, pp. 1208–1211.
24. 24)
  - 12. Shen, Y., Guturu, P., Damarla, T., et al: ‘Video stabilization using principal component analysis and scale invariant feature transform in particle filter framework’, IEEE Trans. Consum. Electron., 2009, 55, (3), pp. 1714–1721.
25. 25)
  - 13. Bhat, K.S., Saptharishi, M., Khosla, P.K.: ‘Motion detection and segmentation using image mosaics’. IEEE Int. Conf. Multimedia and Expo, New York, USA, 2000, pp. 1577–15803.
26. 26)
  - 15. Guillot, C., Taron, M., Sayd, P., et al: ‘Background subtraction adapted to PTZ cameras by key point density estimation’. Proc. British Machine Vision Conf., Aberystwyth, United Kingdom, 2010, pp. 34–13410, doi:10.5244/C.24.34.
27. 27)
  - 6. Xu, G., Zhao, D., Zhou, Q.: ‘Moving target tracking based on adaptive background subtraction and improved camshift algorithm’. International Conference on Audio, Language and Image Processing, Shanghai, China, 2012, pp. 919–924.
28. 28)
  - 9. Censi, A., Fusiello, A., Roberto, V.: ‘Image stabilization by features tracking’. Proc. Int. Conf. Image Analysis and Processing, Venice, Italy, 1999, pp. 665–667.
29. 29)
  - 7. Erturk, S.: ‘Digital image stabilization with sub-image phase correlation based global motion estimation’, IEEE Trans. Consum. Electron., 2003, 49, (4), pp. 1320–1325.
30. 30)
  - 19. Lin, C.C., Wolf, M.: ‘Detecting moving objects using a camera on a moving platform’. Int. Conf. Pattern Recognition, Istanbul, Turkey, 2010, pp. 460–463.
31. 31)
  - 26. Cartography, A., Park, M.: ‘Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography’, Commun. ACM, 1981, 24, (6), pp. 381–395.

High confidence detection for moving target in aerial video

References

Related content