Tracking with spatial constrained coding

Xiaolin Tian; Licheng Jiao; Fandi Zhao; Xiaohua Zhang

Tracking with spatial constrained coding

View Fulltext

Author(s): Xiaolin Tian ¹ ; Licheng Jiao ¹ ; Fandi Zhao ¹ ; Xiaohua Zhang ¹
- Affiliations: 1: Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Xidian University, Xi'an, People's Republic of China
Source: Volume 9, Issue 1, February 2015, p. 63 – 74
DOI: 10.1049/iet-cvi.2014.0017 , Print ISSN 1751-9632, Online ISSN 1751-9640

Received 16/01/2014, Accepted 05/05/2014, Revised 25/04/2014, Published 11/06/2014

A video tracking method based on spatial constrained coding (SCC) is proposed in this study. To characterise local image structure information, the dense scale-invariant feature transform (SIFT) descriptor is extracted for each pixel in the image. The proposed tracking method uses SCC model which adopts a new constrained strategy – weighted code, which is achieved by considering the sum of the weighted codes based on grey values of neighbouring pixels and distances between them. The proposed model is able to obtain robust code of corresponding pixels in the frames of complex scenes by taking spatial information into account, which enhances the stability of coding and makes the tracker more robust for object tracking. Twelve challenging sequences involving partial or full occlusion, large pose variation and drastic illumination change are chosen to test the proposed method. The experimental results show the proposed method performs excellent in comparison with other previously proposed trackers.

References

1. 1)
  - 15. Liu, C., Yuen, J., Torralba, A.: ‘Sift flow: dense correspondence across scenes and its applications’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, pp. 978–994 (doi: 10.1109/TPAMI.2010.147).
2. 2)
  - 10. Hong, X., Chang, H., Shan, S., Zhong, B., Chen, X., Gao, W.: ‘Sigma set based implicit online learning for object tracking’, Signal Process. Lett., 2010, 17, (9), pp. 807–810 (doi: 10.1109/LSP.2010.2057507).
3. 3)
  - 29. Zha, Y., Yang, Y., Bi, D.: ‘Graph-based transductive learning for robust visual tracking’, Pattern Recognit., 2010, 43, (1), pp. 187–196 (doi: 10.1016/j.patcog.2009.06.011).
4. 4)
  - 9. Liu, B., Yang, L., Huang, J., Meer, P., Gong, L., Kulikowski, C.: ‘Robust and fast collaborative tracking with two stage sparse optimization’. Proc. European Conf. Computer Vision, Heraklion, Greece, 2010, pp. 624–637.
5. 5)
  - 12. Cands, E.J., Romberg, J.K., Tao, T.: ‘Stable signal recover from incomplete and inaccurate measurements’, IEEE Trans. Pattern Anal. Mach. Intell., 2006, 59, (8), pp. 1207–1223.
6. 6)
  - 35. Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., Gong, Y.: ‘Locality-constrained linear coding for image classification’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, USA, 2010, pp. 3360–3367.
7. 7)
  - 40. Ma, B., Hu, H., Liu, S., Chen, J.: ‘Robust visual tracking using local sparse covariance descriptor and matching pursuit’. Proc. Int. Conf. Neural Information Processing, Daegu, Korea, 2013, pp. 485–492.
8. 8)
  - 14. Mei, X., Ling, H., Wu, Y., Blasch, E., Bai, L.: ‘Minimum error bounded efficient l1 tracker with occlusion detection’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Colorado Springs, USA, 2011, pp. 1257–1264.
9. 9)
  - 41. Zhang, T., Ghanem, B., Liu, S.: ‘Robust visual tracking via structured multi-task sparse learning’, Int. J. Comput. Vis., 2013, 101, (2), pp. 367–383 (doi: 10.1007/s11263-012-0582-z).
10. 10)
  - 39. Learned-Miller, E.G., Lara, L.S.: ‘Distribution fields for tracking’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, USA, 2012.
11. 11)
  - 5. Ross, D., Lim, J., Lin, R., Yang, M.: ‘Incremental learning for robust visual tracking’, Int. J. Comput. Vis., 2007, 77, (8), pp. 125–141.
12. 12)
  - 30. Bai, T., Li, Y.F., Zhou, X.: ‘Robust and fast visual tracking using constrained sparse coding and dictionary learning’. Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Vilamoura, Algarve, Portugal, 2012, pp. 3824–3829.
13. 13)
  - 6. Babenko, B., Yang, M., Belongie, S.: ‘Visual tracking with online multiple instance learning’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Florida, USA, 2009, pp. 983–990.
14. 14)
  - 7. Grabner, H., Leistner, C., Bischof, H.: ‘Semi-supervised on-line boosting for robust tracking’. Proc. European Conf. Computer Vision, Marseille, France, 2008, pp. 234–247.
15. 15)
  - 3. Perez, P., Hue, C., Vermaak, J., Gangnet, M.: ‘Color-based probabilistic tracking’. Proc. European Conf. Computer Vision, Copenhagen, Denmark, 2002, pp. 661–675.
16. 16)
  - 32. Liu, R., Jing, Z., Jin, B., Wang, Y., Pan, H.: ‘Visual object tracking based on local constrained least square estimation’. Proc. IEEE Conf. Information Fusion, One Commonwealth, Singapore, 2012, pp. 1970–1975.
17. 17)
  - 18. Shahed, S.M.N., Ho, J., Yang, M.-H.: ‘Visual tracking with histograms and articulating blocks’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Alaska, USA, 2008, pp. 1–8.
18. 18)
  - 25. Hare, S., Saffari, A., Torr, P.H.S.: ‘Struck: structured output tracking with kernels’. Proc. IEEE Int. Conf. Computer Vision, 2011, pp. 263–270.
19. 19)
  - D. Comaniciu , V. Ramesh , P. Meer . Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. , 564 - 577
20. 20)
  - 37. Lim, J., Ross, D., Lin, R.-S., Yang, M.-H.: ‘Incremental learning for visual tracking’. Neural Information Processing Systems Conf., Whistler, Canada, 2005, pp. 793–800.
21. 21)
  - 24. Kalal, Z., Matas, J., Mikolajczyk, K.: ‘P-N learning: bootstrapping binary classifiers by structural constraints’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, USA, 2010, pp. 49–56.
22. 22)
  - 3. Zhang, S., Yao, H., Sun, X., lu, X.: ‘Sparse coding based visual tracking: review and experimental comparison’, Pattern Recognit., 2013, 46, (7), pp. 1772–1788 (doi: 10.1016/j.patcog.2012.10.006).
23. 23)
  - 28. Bai, Y., Tang, M.: ‘Robust tracking via weakly supervised ranking SVM’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, USA, 2012, pp. 1854–1861.
24. 24)
  - 16. Li, H., Shen, C., Shi, Q.: ‘Real-time visual tracking with compressed sensing’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Colorado Springs, USA, 2011, pp. 1305–1312.
25. 25)
  - 34. Zhang, H., Tao, F., Yang, G.: ‘Robust visual tracking based on structured sparse representation model’, Multimedia Tools Appl., 2013, doi:10.1007/s11042-013-1709-0.
26. 26)
  - A. Jepson , D. Fleet , T. El-Maraghi . Robust online appearance models for visual tracking. IEEE Trans. Pattern Anal. Mach. Intell. , 10 , 1296 - 1311
27. 27)
  - 31. Liu, H., Yuan, M., Sun, F., Zhang, J.: ‘Spatial neighborhood-constrained linear coding for visual object tracking’, IEEE Trans. Ind. Inf., 2014, 10, (1), pp. 469–480 (doi: 10.1109/TII.2013.2247613).
28. 28)
  - 17. Hua, G., Wu, Y.: ‘Measurement integration under inconsistency for robust tracking’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, New York, USA, 2006, pp. 650–657.
29. 29)
  - X. Mei , H. Ling . Robust visual tracking and vehicle classification via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. , 11 , 2259 - 2272
30. 30)
  - 38. Mei, X., Ling, H.: ‘Robust visual tracking using L1 minimization’. Proc. IEEE Int. Conf. Computer Vision, Kyoto, Japan, 2009, pp. 1436–1443.
31. 31)
  - 19. Kwon, J., Lee, K.M.: ‘Tracking of a non-rigid object via patch-based dynamic appearance modeling and adaptive basin hopping Monte Carlo sampling’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Florida, USA, 2009, pp. 1208–1215.
32. 32)
  - 57. Kalal, Z., Mikolajczyk, K., Matas, J.: ‘Tracking-learning-detection’, IEEE Trans. Pattern Anal. Mach. Intell., 2012, 34, (7), pp. 1409–1422 (doi: 10.1109/TPAMI.2011.239).
33. 33)
  - S. Avidan . Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. , 2 , 261 - 271
34. 34)
  - 8. Wang, S., Lu, H., Yang, F., Yang, M.H.: ‘Superpixel tracking’. Proc. IEEE Int. Conf. Computer Vision, 2011, pp. 1323–1330.
35. 35)
  - I. Matthews , T. Ishikawa , S. Baker . The template update problem. IEEE Trans. Pattern Anal. Mach. Intell. , 6 , 810 - 815
36. 36)
  - 22. Grabner, H., Grabner, M., Bischof, H.: ‘Real-time tracking via on-line boosting’. British Machine Vision Conf., 2006, pp. 1–10.
37. 37)
  - 21. Lucas, B.D., Kanade, T.: ‘An iterative image registration technique with an application to stereo vision’. Proc. DARPA Image Understanding Workshop, 1981, pp. 121–130.
38. 38)
  - 36. Drucker, H., Burges, C.J.C., Kaufman, L., Smola, A., Vapnik, V.: ‘Support vector regression machines’. Neural Information Processing Systems Conf., Breckenridge, USA, 1997, pp. 155–161.
39. 39)
  - 15. Liu, B., Yang, L., Huang, J., Meer, P., Gong, L., Kulikowski, C.: ‘Robust and fast collaborative tracking with two stage sparse optimization’. Proc. European Conf. Computer Vision, Heraklion, Greece, 2010, pp. 1–14.
40. 40)
  - 1. Babenko, B., Yang, M.H., Belongie, S.: ‘Robust object tracking with online multiple instance learning’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (8), pp. 1619–1632 (doi: 10.1109/TPAMI.2010.226).
41. 41)
  - 11. Adam, A., Rivlin, E., Shimshoni, I.: ‘Robust fragments-based tracking using the integral histogram’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, USA, 2010, pp. 798–805.

Login

Not registered yet?

Share

Tools

Login to add to favourites

Key

Tracking with spatial constrained coding

References

Related content