Visual target tracking has long been a challenging problem because of the variable appearance of the target with changing spatiotemporal factors. Therefore, it is important to design an effective and efficient appearance model for tracking tasks. This study proposes a tracking algorithm based on locality-constrained linear coding (LLC) under a particle filtering framework. A local feature descriptor is presented that can evenly represent the local information of each patch in the tracking region. LLC uses the locality constraints to project each local feature descriptor into its local-coordinate system. Compared with sparse coding, LLC can be performed very quickly for appearance modelling because it has an analytical solution derived by a three-step matrix calculation, and the computational complexity of the proposed tracking algorithm is $o ( η × m × n )$ . Both quantitative and qualitative experimental results demonstrate that the authors’ proposed algorithm performs favourably against the 10 state-of-the-art trackers on 12 challenging test sequences. However, related experimental results show that the performance of their tracker is not effective enough for small tracking targets owing to a lack of sufficient local region information.

References

1. 1)
  - 7. Zhang, K., Zhang, L., Yang, M.-H.: ‘Fast compressive tracking’, IEEE Trans. Pattern Anal. Mach. Intell., 2014, 36, (10), pp. 2002–2015.
2. 2)
  - 30. Mei, X., Ling, H.: ‘Robust visual tracking using L1 minimization’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Anchorage, Alaska, USA, 2009, pp. 1436–1443.
3. 3)
  - 37. Wang, G.F., Qin, X.Y., Zhong, F., et al: ‘Visual tracking via sparse and local linear coding’, IEEE Trans. Image Process., 2015, 24, (11), pp. 3796–3809.
4. 4)
  - 39. Liu, F.H., Zhou, T., Fu, K.R., et al: ‘Kernelized temporal locality learning for real-time visual tracking’, Pattern Recognit. Lett., 2017, 90, (4), pp. 72–79.
5. 5)
  - 14. Jia, X., Lu, H., Yang, M.-H.: ‘Visual tracking via adaptive structural local sparse appearance model’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, Rhode Island, USA, 2012, pp. 1822–1829.
6. 6)
  - 27. Wang, Q., Chen, F., Yang, J., et al: ‘Transferring visual prior for online object tracking’, IEEE Trans. Image Process., 2012, 21, (7), pp. 3296–3305.
7. 7)
  - 28. Zhang, S.P., Yao, H.X., Sun, X., et al: ‘Robust visual tracking using an effective appearance model based on sparse coding’, ACM Trans. Intell. Syst. Technol., 2012, 3, (3), pp. 1–18.
8. 8)
  - 1. Pan, Z., Liu, S., Fu, W.: ‘A review of visual moving target tracking’, Multimedia Tools Appl., 2017, 76, (16), pp. 16989–17018.
9. 9)
  - 9. Babenko, B., Yang, M.-H., Belongie, S.: ‘Robust object tracking with online multiple instance learning’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (8), pp. 1619–1632.
10. 10)
  - 8. Gao, Y., Zhou, H., Zhang, X.: ‘Enhanced fast compressive tracking based on adaptive measurement matrix’, IET Comput. Vis., 2015, 9, (6), pp. 857–863.
11. 11)
  - 36. Zha, Y., Cao, T.Y., Huang, H., et al: ‘Robust object tracking via local constrained and online weighted’, Multimedia Tools Appl., 2016, 75, (11), pp. 6481–6503.
12. 12)
  - 21. Yun, X., Jing, Z.-L.: ‘Kernel joint visual tracking and recognition based on structured sparse representation’, Neurocomputing, 2016, 193, (Si), pp. 181–192.
13. 13)
  - 43. Smeulders, A.W.M., Chu, D.M., Cucchiara, R., et al: ‘Visual tracking: an experimental survey’, IEEE Trans. Pattern Anal. Mach. Intell., 2014, 36, (7), pp. 1442–1468.
14. 14)
  - 4. Chen, F.S., Fu, C.M., Huang, C.L.: ‘Hand gesture recognition using a real-time tracking method and hidden Markov models’, Image Vis. Comput., 2003, 21, (8), pp. 745–758.
15. 15)
  - 3. Comaniciu, D., Ramesh, V., Meer, P.: ‘Real-time tracking of non-rigid objects using mean shift’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Hilton Head, SC, USA, 2000, pp. 142–149.
16. 16)
  - 32. Yang, Y., Xie, Y., Zhang, W., et al: ‘Global coupled learning and local consistencies ensuring for sparse-based tracking’, Neurocomputing, 2015, 160, (Si), pp. 191–205.
17. 17)
  - 42. Zhang, K.H., Zhang, L., Liu, Q.S., et al: ‘Fast visual tracking via dense spatio-temporal context learning’. Proc. European Conf. Computer Vision, Zürich, Switzerland, Germany, 2014, pp. 127–141.
18. 18)
  - 6. Chang, C., Ansari, R.: ‘Kernel particle filter for visual tracking’, IEEE Signal Process. Lett., 2005, 12, (3), pp. 242–245.
19. 19)
  - 25. Zhang, T., Ghanem, B., Liu, S., et al: ‘Robust visual tracking via structured multi-task sparse learning’, Int. J. Comput. Vis., 2013, 101, (2), pp. 367–383.
20. 20)
  - 34. Zhang, S.P., Zhou, H.Y., Jiang, F., et al: ‘Robust visual tracking using structurally random projection and weighted least squares’, IEEE Trans. Circuits Syst. Video Technol., 2015, 25, (11), pp. 1749–1760.
21. 21)
  - 23. Tian, C., Gao, X., Wei, W., et al: ‘Visual tracking based on the adaptive color attention tuned sparse generative object model’, IEEE Trans. Image Process., 2015, 24, (12), pp. 5236–5248.
22. 22)
  - 38. Liu, B.Y., Huang, J.Z., Kulikowski, C., et al: ‘Robust visual tracking using local sparse appearance model and K-selection’, IEEE Trans. Pattern Anal. Mach. Intell., 2013, 35, (12), pp. 2968–2981.
23. 23)
  - 11. Henriques, J., Caseiro, R., Martins, P., et al: ‘High-speed tracking with kernelized correlation filters’, IEEE Trans. Pattern Anal. Mach. Intell., 2015, 37, (3), pp. 583–596.
24. 24)
  - 22. Han, G., Wang, X., Liu, J., et al: ‘Robust object tracking based on local region sparse appearance model’, Neurocomputing, 2016, 184, (Si), pp. 145–167.
25. 25)
  - 26. Huang, H.T., Bi, D. Y, Zha, Y.F., et al: ‘Robust visual tracking based on product sparse coding’, Pattern Recognit. Lett., 2015, 56, pp. 52–59.
26. 26)
  - 18. Yang, J., Yu, K., Gong, Y., et al: ‘Linear spatial pyramid matching using sparse coding for image classification’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Anchorage, Alaska, USA, 2009, pp. 1794–1801.
27. 27)
  - 17. Ta, D.N., Chen, W.C., Gelfand, N., et al: ‘SURFTrac: efficient tracking and continuous object recognition using local feature descriptors’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, USA, 2009, pp. 2937–2944.
28. 28)
  - 13. Ross, D.A., Lim, J., Lin, R.S.: ‘Incremental learning for robust visual tracking’, Int. J. Comput. Vis., 2008, 77, (1–3), pp. 125–141.
29. 29)
  - 35. Yu, K., Zhang, T., Gong, Y.H.: ‘Nonlinear learning using local coordinate coding’. Proc. the 22nd Int. Conf. Neural Information Processing Systems, Vancouver, British Columbia, Canada, USA, 2009, pp. 2223–2231.
30. 30)
  - 10. Zhang, K., Song, H.: ‘Real-time visual tracking via online weighted multiple instance learning’, Pattern Recognit., 2013, 46, (1), pp. 397–411.
31. 31)
  - 24. Zhang, S., Yao, H., Sun, X., et al: ‘Sparse coding based visual tracking: review and experimental comparison’, Pattern Recognit., 2013, 46, (7), pp. 1772–1788.
32. 32)
  - 40. Isard, M., Blake, A.: ‘Condensation – conditional density propagation for visual tracking’, Int. J. Comput. Vis., 1998, 29, (1), pp. 5–28.
33. 33)
  - 20. Wang, J.J., Yang, J.C., Yu, K., et al: ‘Locality-constrained linear coding for image classification’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Francisco, CA, USA, 2010, pp. 3360–3367.
34. 34)
  - 41. Zhong, W., Lu, H., Yang, M.H.: ‘Robust object tracking via sparsity-based collaborative model’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, Rhode Island, USA, 2012, pp. 1838–1845.
35. 35)
  - 2. Yang, H., Shao, L., Zheng, F., et al: ‘Recent advances and trends in visual tracking: a review’, Neurocomputing, 2011, 74, (18), pp. 3823–3831.
36. 36)
  - 12. Li, Y., Zhu, J.K.: ‘A scale adaptive kernel correlation filter tracker with feature integration’. European Conf. Computer Vision, 2014, pp. 254–265.
37. 37)
  - 31. Zhang, L., Wu, W., Chen, T., et al: ‘Robust object tracking using semi-supervised appearance dictionary learning’, Pattern Recognit. Lett., 2015, 62, (Si), pp. 17–23.
38. 38)
  - 19. He, K., Zhang, X., Ren, S., et al: ‘Spatial pyramid pooling in deep convolutional networks for visual recognition’, IEEE Trans. Pattern Anal. Mach. Intell., 2015, 37, (9), pp. 1904–1916.
39. 39)
  - 5. Ali, N.H., Hassan, G.M.: ‘Kalman filter tracking’, Int. J. Comput. Appl., 2014, 89, (9), pp. 15–18.
40. 40)
  - 15. Bao, C., Wu, Y., Ling, H., et al: ‘Real time robust l1 tracker using accelerated proximal gradient approach’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, Rhode Island, USA, 2012, pp. 1830–1837.
41. 41)
  - 29. Zhang, S.P., Lan, X.Y., Yao, H.X., et al: ‘A biologically inspired appearance model for robust visual tracking’, IEEE Trans. Neural Netw. Learn. Syst., DOI 10.1109/TNNLS.2016.2586194, 2016, 99, (PP), pp. 1–14.
42. 42)
  - 16. Sevilla-Lara, L., Learned-Miller, E.: ‘Distribution fields for tracking’. Proc. IEEE Conf. Computer Vision and Pattern Recognition, Providence, Rhode Island, USA, 2012, pp. 1910–1917.
43. 43)
  - 33. Zhang, S.P., Yao, H.X., Zhou, H.Y., et al: ‘Robust visual tracking based on online learning sparse representation’, Neurocomputing, 2013, 100, (1), pp. 31–40.

Visual tracking using locality-constrained linear coding under a particle filtering framework

References

Related content