http://iet.metastore.ingenta.com
1887

Visual tracking via bag of features

Visual tracking via bag of features

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Image Processing — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

In this paper, we propose a visual tracking approach based on ‘bag of features’ (BoF) algorithm. First we use incremental PCA visual tracking (IVT) in the first few frames and collect image patches randomly sampled within the tracked object region in each frame for constructing the codebook; the tracked object then can be converted to a bag. Second we construct two codebooks using color (RGB) features and local binary pattern (LBP) features instead of only one codebook in traditional BoF, thereby extracting more informative details. We also devise an updating mechanism to deal with pose and appearance changes of objects. In the tracking process, a constant number of candidates are generated by sampling technique in each frame. Image patches are then randomly sampled and candidates are represented as bags by codebooks. Thus, we can compute patch similarity of a candidate with the codewords and bag similarity with trained bags. The actual object is then located by finding the maximal combined similarity of patches and bags. Experiments demonstrate that our approach is robust in handling occlusion, scaling and rotation.

References

    1. 1)
    2. 2)
      • Avidan, S.: `Ensemble tracking', Proc. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'05), June 2005, San Diego, CA, p. 494–501.
    3. 3)
      • Grabner, H., Bischof, H.: `On-line boosting and vision', Proc. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'06), June 2006, New York, NY, p. 260–267.
    4. 4)
      • J. Lim , D. Ross , R. Lin , M.-H. Yang . (2005) Incremental learning for visual tracking.
    5. 5)
      • Yin, Z., Collins, R.T.: `Object tracking and detection after occlusion via numerical hybrid local and global mode-seeking', Proc. 2008 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'08), June 2008, Anchorage, Alaska, p. 1–8.
    6. 6)
      • Adam, A., Rivlin, E., Shimshoni, I.: `Robust fragments-based tracking using the integral histogram', Proc. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'06), June 2006, New York, NY, p. 798–805.
    7. 7)
      • Yang, T., Li, S.Z., Pan, Q., Li, J.: `Real-time multiple objects tracking with occlusion handling in dynamic scenes', Proc. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'05), June 2005, San Diego, CA, p. 970–975.
    8. 8)
      • Song, X., Cui, J., Zha, H., Zhao, H.: `Vision-based multiple interacting targets tracking via on-line supervised learning', Proc. 10th European Conf. Computer Vision (ECCV'08), October 2008, Marseille, France, p. 642–655.
    9. 9)
      • Babenko, B., Yang, M.-H., Belongie, S.: `Visual tracking with online multiple instance learning', Proc. 2009 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'09), June 2009, Miami, FL.
    10. 10)
      • Lu, H., Zhou, Q., Wang, D., Ruan, X.: `A co-training framework for visual tracking with multiple instance', IEEE Conf. Automatic Face and Gesture Recognition, 2011.
    11. 11)
      • Zhou, Q., Lu, H., Yang, M.-H.: `Online multiple support instance tracking', IEEE Conf. Automatic Face and Gesture Recognition, 2011.
    12. 12)
      • Lu, H., Zhang, W., Chen, Y.-W.: `On feature combination and multiple kernel learning for object tracking', Asian Conf. on Computer Vision, 2010.
    13. 13)
      • Lu, H., Lu, S., Chen, Y.-W.: `Robust tracking based on pixel-wise spatial pyramid and biased fusion', Asian Conf. on Computer Vision, 2010.
    14. 14)
      • Yang, F., Lu, H., Chen, Y.-W.: `Human tracking by multiple Kernel boosting with locality affinity constraints', Asian Conf. on Computer Vision, 2010.
    15. 15)
      • Yang, F., Lu, H., Chen, Y.-W.: `Robust tracking based on boosted color soft segmentation and ICA-R', Int. Conf. on Image Processing, 2010.
    16. 16)
      • Wang, D., Lu, H., Chen, Y.-W.: `Object tracking by multi-cues spatial pyramid matching', Int. Conf. on Image Processing, 2010.
    17. 17)
      • Mikolajczyk, K., Schmid, C., Zisserman, A.: `Human detection based on a probabilistic assembly of robust part detectors', Proc. 8th European Conf. Computer Vision (ECCV'04), May 2004, Prague, Czech Republic, p. 69–82.
    18. 18)
    19. 19)
      • Zhao, T., Nevatia, R.: `Tracking multiple humans in crowded environment', Proc. 2004 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'04), June 2004, Washington, DC, p. 406–413.
    20. 20)
      • Wu, B., Nevatia, R.: `Tracking of multiple, partially occluded humans based on static body part detection', Proc. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'06), June 2006, New York, NY, p. 951–958.
    21. 21)
      • Joachims, T.: `Text categorization with support vector machines: learning with many relevant features', Proc. 10th European Conf. on Machine Learning, April 1998, Dorint-Parkhotel, Germany, p. 137–142.
    22. 22)
      • S. Tong , D. Koller . Support vector machine active learning with applications to text classification. J. Mach. Learn. Res. , 45 - 66
    23. 23)
      • H. Lodhi , J. Shawe-Taylor , N. Christianini , C. Watkins . Text classification using string kernels. J. Mach. Learn. Res. , 419 - 444
    24. 24)
    25. 25)
      • Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C.: `Visual categorization with bags of keypoints', Proc. 8th European Conf. Computer Vision (ECCV'04), May 2004, Prague, Czech Republic.
    26. 26)
      • Fei-Fei, L., Perona, P.: `A Bayesian hierarchical model for learning natural scene categories', Proc. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'05), June 2005, San Diego, CA, p. 524–531.
    27. 27)
      • Sivic, J., Russell, B.C., Efros, A.A., Zisserman, A., Freeman, W.T.: `Discovering object categories in image collections', Proc. IEEE Int. Conf. on Computer Vision (ICCV'05), October 2005, Beijing, China.
    28. 28)
      • Fergus, R., Fei-Fei, L., Perona, P., Zisserman, A.: `Learning object categories from Google's image search', Proc. IEEE Int. Conf. on Computer Vision (ICCV'05), October 2005, Beijing, China.
    29. 29)
      • Winn, J., Criminisi, A., Minka, T.: `Object categorization by learned universal visual dictionary', Proc. IEEE Int. Conf. on Computer Vision (ICCV'05), October 2005, Beijing, China.
    30. 30)
      • Nowak, E., Jurie, F., Triggs, B.: `Sampling strategies for bag of features image classification', Proc. 9th European Conf. Computer Vision (ECCV'06), May 2006, Graz, Austria, p. 490–503.
    31. 31)
      • Lu, L., Hager, G.D.: `A nonparametric treatment for location/segmentation based visual tracking', Proc. 2007 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR'07), June 2007, Minneapolis, MN, p. 1–8.
    32. 32)
      • Lu, H., Zhang, W., Yang, F., Wang, X.: `Robust tracking based on PSO and on-line AdaBoost', Int. Conf. on Intelligent Information Hiding and Multimedia Signal Processing, 2009, p. 690–693.
    33. 33)
      • Hofmann, T.: `Probabilistic latent semantic indexing', Proc. 22nd Annual Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, 1999, p. 50–57.
    34. 34)
    35. 35)
      • D. Blei , A. Ng , M. Jordan . Latent dirichlet allocation. J. Mach. Learn. Res. , 993 - 1022
    36. 36)
    37. 37)
    38. 38)
      • CAVIAR Database: http://groups.inf.ed.ac.uk/vision/caviar/.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-ipr.2010.0127
Loading

Related content

content/journals/10.1049/iet-ipr.2010.0127
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address