Tracking with scattering descriptor
- Author(s): Xiaolin Tian 1, 2 ; Licheng Jiao 1 ; Xiaowei Shang 1
-
-
View affiliations
-
Affiliations:
1:
Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xidian University, Xi'an, People's Republic of China;
2: Also with Institute of Intelligent Information Processing, Xidian University, P.O. Box 224, Xi'an 710071, People's Republic of China
-
Affiliations:
1:
Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, Xidian University, Xi'an, People's Republic of China;
- Source:
Volume 8, Issue 3,
June 2014,
p.
195 – 206
DOI: 10.1049/iet-cvi.2013.0124 , Print ISSN 1751-9632, Online ISSN 1751-9640
This study proposes a new method to track the moving object based on undecimated scattering transform (UST). The UST removes the down-sampling operation from the traditional scattering transform to produce a complete representation. Based on the UST, the structural information of object can be captured, which is a highly discriminative representation and facilitates the tracker to distinguish the object from background. The update parameter of tracking model is adaptively adjusted by the correlation coefficient. Occlusion identification is achieved by using a new cascaded model, which can correctly find occlusion and avoid the drift. Experimental results demonstrate that the proposed method is able to track the object accurately and reliably in realistic videos where the appearance and motion change drastically over time.
Inspec keywords: image representation; scattering; image motion analysis; object tracking
Other keywords: UST; correlation coefflcient; undecimated scattering transform; cascaded model; occlusion identification; moving object tracking; down-sampling operation; object structural information; scattering descriptor
Subjects: Optical, image and video signal processing; Computer vision and image processing techniques
References
-
-
1)
-
28. Everingham, M., Gool, L., Williams, C.K., Winn, J., Zisserman, A.: ‘The PASCAL visual object classes (VOC) challenge’, Int. J. Comput. Vis., 2010, 8, (2), pp. 303–338 (doi: 10.1007/s11263-009-0275-4).
-
-
2)
- C. Shen , J. Kim , H. Wang . Generalized kernel-based visual tracking. IEEE Trans. Circuits Syst. Video Technol. , 1 , 119 - 130
-
3)
-
14. Nigam, S., Khare, A.: ‘Curvelet transform-based technique for tracking of moving objects’, IET Comput. Vis., 2012, 6, (3), pp. 231–251 (doi: 10.1049/iet-cvi.2011.0023).
-
-
4)
- R. Szeliski . Image alignment and stitching: a tutorial. Found. Trends in Comput. Graph. Comput. Vis. , 1 , 1 - 104
-
5)
-
3. Zhang, S., Yao, H., Sun, X., lu, X.: ‘Sparse coding based visual tracking: review and experimental comparison’, Pattern Recognit., 2013, 46, (7), pp. 1772–1788 (doi: 10.1016/j.patcog.2012.10.006).
-
-
6)
-
16. Bruna, J., Mallat, S.: ‘Invariant scattering convolution networks’, IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35, (8), pp. 1872–1886 (doi: 10.1109/TPAMI.2012.230).
-
-
7)
- A. Jepson , D. Fleet , T. El-Maraghi . Robust online appearance models for visual tracking. IEEE Trans. Pattern Anal. Mach. Intell. , 10 , 1296 - 1311
-
8)
- D. Comaniciu , V. Ramesh , P. Meer . Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. , 564 - 577
-
9)
- D.G. Lowe . Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis , 2 , 91 - 110
-
10)
-
13. Feris, R.S., Krueger, V., Cesar, R.M.: ‘A wavelet subspace method for real-time face tracking’, Real-Time Imaging, 2004, 10, pp. 339–350 (doi: 10.1016/j.rti.2004.06.002).
-
-
11)
-
1. Babenko, B., Yang, M.H., Belongie, S.: ‘Robust object tracking with online multiple instance learning’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (8), pp. 1619–1632 (doi: 10.1109/TPAMI.2010.226).
-
-
12)
-
1. Szeliski, R.: ‘Image alignment and stitching: a tutorial’, Found. Trends Comput., 2006, 2, (1), pp. 1–104 (doi: 10.1561/0600000009).
-
-
13)
-
13. Feris, R.S., Krueger, V., Cesar, R.M.: ‘A wavelet subspace method for real-time face tracking’, Real-Time Imaging, 2004, 10, pp. 339–350 (doi: 10.1016/j.rti.2004.06.002).
-
-
14)
-
3. Shen, C., Kim, J., Wang, H.: ‘Generalized kernel-based visual tracking’, IEEE Trans. Circuits Syst. Video Technol., 2010, 20, (1), pp. 119–130 (doi: 10.1109/TCSVT.2009.2031393).
-
-
15)
-
5. Haritaoglu, I., Flickner, M.: ‘Detection and tracking of shopping groups in stores’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Kauai, USA, 2001, pp. 431–438.
-
-
16)
-
16. Bruna, J., Mallat, S.: ‘Invariant scattering convolution networks’, IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35, (8), pp. 1872–1886 (doi: 10.1109/TPAMI.2012.230).
-
-
17)
-
12. Khansari, M., Rabiee, H.R., Asadi, M., Ghanbari, M.: ‘Object tracking in crowded video scenes based on the undecimated wavelet features and texture analysis’, EURASIP J. Adv. Signal Process., 2008, 8, (2), article ID 243534, pp. 18, doi: 10.1155/2008/243534.
-
-
18)
-
25. Wang, S., Lu, H., Yang, F., Yang, M.H.: ‘Superpixel Tracking’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Colorado Springs, USA, 2011, pp. 1323–1330.
-
-
19)
-
6. Hager, G., Hager, G.D., Dewan, M., Stewart, C.V.: ‘Multiple kernel tracking with SSD’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Washington, DC, USA, 2004, pp. 790–797.
-
-
20)
-
22. Lim, J., Ross, D., Lin, R.-S., Yang, M.-H.: ‘Incremental learning for visual tracking’. Neural Information Processing Systems Conf., Vancouver, Canada, 2005, pp. 793–800.
-
-
21)
-
14. Nigam, S., Khare, A.: ‘Curvelet transform-based technique for tracking of moving objects’, IET Comput. Vis., 2012, 6, (3), pp. 231–251 (doi: 10.1049/iet-cvi.2011.0023).
-
-
22)
-
7. Comaniciu, D., Ramesh, V., Meer, P.: ‘Kernel-based object tracking’, IEEE Trans. Pattern Anal. Mach. Intell., 2003, 25, (5), pp. 564–575 (doi: 10.1109/TPAMI.2003.1195991).
-
-
23)
-
20. Babenko, B., Yang, M.-H., Belongie, S.: ‘Visual tracking with online multiple instance learning’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (8), pp. 1619–1632 (doi: 10.1109/TPAMI.2010.226).
-
-
24)
-
8. Lowe, D.G.: ‘Distinctive image features from scale-invariant keypoints’, Int. J. Comput. Vis., 2004, 60, (2), pp. 91–110 (doi: 10.1023/B:VISI.0000029664.99615.94).
-
-
25)
-
26. Zhang, S., Yao, H., Sun, X., Lu, X.: ‘Sparse coding based visual tracking: review and experimental comparison’, Pattern Recognit., 2013, 46, pp. 1772–1788 (doi: 10.1016/j.patcog.2012.10.006).
-
-
26)
-
17. Andén, J., Mallat, S.: ‘Multiscale scattering for audio classification’. Int. Society for Music Information Retrieval, Miami, USA, 2011, pp. 657–662.
-
-
27)
-
15. Bruna, J., Mallat, S.: ‘Classification with scattering operators’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Colorado Springs, USA, 2011, pp. 1561–1566.
-
-
28)
-
19. Sun, Z., Sun, J., Song, J., Qiao, S.: ‘Anti-occlusion arithmetic for moving object tracking’, Opt. Precis. Eng., 2007, 15, (2), pp. 267–271.
-
-
29)
-
9. Dalal, N., Triggs, B.: ‘Histograms of oriented gradients for human detection’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Diego, USA, 2005, pp. 886–893.
-
-
30)
-
4. Collins, R.T.: ‘Mean-shift blob tracking through scale space’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Madison, USA, 2003, pp. 234–240.
-
-
31)
-
23. Adam, A., Rivlin, E., Shimshoni, I.: ‘Robust fragments-based tracking using the integral histogram’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, New York, USA, 2006, pp. 798–805.
-
-
32)
-
21. Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J.M., Zisserman, A.: ‘The pascal visual object classes (voc) challenge’, Int. J. Comput. Vis., 2010, 88, (2), pp. 303–338 (doi: 10.1007/s11263-009-0275-4).
-
-
33)
-
18. Sevilla-Lara, L., Learned-Miller, E.G.: ‘Distribution fields for tracking’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, USA, 2012, pp. 1910–1917.
-
-
34)
-
11. Khare, A., Tiwary, U.S.: ‘Daubechies complex wavelet transform based moving object tracking’. IEEE Symp. Computational Intelligence in Image and Signal Processing, Honolulu, USA, 2007, pp. 36–40.
-
-
35)
-
2. Jepson, A.D., Fleet, D.J., El-Maraghi, T.: ‘Robust online appearance models for visual tracking’, IEEE Trans. Pattern Anal. Mach. Intell., 2003, 25, (10), pp. 1296–1311 (doi: 10.1109/TPAMI.2003.1233903).
-
-
36)
-
24. Kwon, J., Lee, K.M.: ‘Visual tracking decomposition’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, USA, 2010, pp. 1269–1276.
-
-
37)
-
10. Bay, H., Tuytelaars, T., Gool, L.V.: ‘SURF: speeded up robust features’. Proc. European Conf. Computer Vision, Graz, Austria, 2006, pp. 404–417.
-
-
1)