http://iet.metastore.ingenta.com
1887

Multi-object tracking using dominant sets

Multi-object tracking using dominant sets

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Computer Vision — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Multi-object tracking is an interesting but challenging task in the field of computer vision. Most previous works based on data association techniques merely take into account the relationship between detection responses in a locally limited temporal domain, which makes them inherently prone to identity switches and difficulties in handling long-term occlusions. In this study, a dominant set clustering based tracker is proposed, which formulates the tracking task as a problem of finding dominant sets in an auxiliary edge weighted graph. Unlike most techniques which are limited in temporal locality (i.e. few frames are considered), the authors utilised a pairwise relationships (in appearance and position) between different detections across the whole temporal span of the video for data association in a global manner. Meanwhile, temporal sliding window technique is utilised to find tracklets and perform further merging on them. The authors’ robust tracklet merging step renders the tracker to long term occlusions with more robustness. The authors present results on three different challenging datasets (i.e. PETS2009-S2L1, TUD-standemitte and ETH dataset (‘sunny day’ sequence)), and show significant improvements compared with several state-of-art methods.

References

    1. 1)
      • A. Ellis , J.M. Ferryman .
        1. Ellis, A., Ferryman, J.M.: ‘PETS2010 and PETS2009 evaluation of results using individual ground truthed single views’. Seventh IEEE Int. Conf. on Advanced Video and Signal Based Surveillance, AVSS 2010, Boston, MA, USA, 29 August–1 September 2010, 2010, pp. 135142.
        . Seventh IEEE Int. Conf. on Advanced Video and Signal Based Surveillance, AVSS 2010, Boston, MA, USA, 29 August–1 September 2010 , 135 - 142
    2. 2)
      • A. Andriyenko , K. Schindler .
        2. Andriyenko, A., Schindler, K.: ‘Multi-target tracking by continuous energy minimization’. The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, 2011, pp. 12651272.
        . The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011 , 1265 - 1272
    3. 3)
      • A. Ess , B. Leibe , K. Schindler .
        3. Ess, A., Leibe, B., Schindler, K., et al: ‘A mobile vision system for robust multi-person tracking’. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'08), June 2008.
        . IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'08)
    4. 4)
      • A. Yilmaz , O. Javed , M. Shah .
        4. Yilmaz, A., Javed, O., Shah, M.: ‘Object tracking: a survey’, ACM Comput. Surv., 2006, 38, (4), pp. 145.
        . ACM Comput. Surv. , 4 , 1 - 45
    5. 5)
      • A.G.A. Perera , C. Srinivas , A. Hoogs .
        5. Perera, A.G.A., Srinivas, C., Hoogs, A., et al: ‘Multi-object tracking through simultaneous long occlusions and split-merge conditions’. 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2006), 17–22 June 2006, New York, NY, USA, 2006, pp. 666673.
        . 2006 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2006), 17–22 June 2006, New York, NY, USA , 666 - 673
    6. 6)
      • H. Pirsiavash , D. Ramanan , C.C. Fowlkes .
        6. Pirsiavash, H., Ramanan, D., Fowlkes, C.C.: ‘Globally-optimal greedy algorithms for tracking a variable number of objects’. in The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, 2011, pp. 12011208.
        . in The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011 , 1201 - 1208
    7. 7)
      • J. Xing , H. Ai , S. Lao .
        7. Xing, J., Ai, H., Lao, S.: ‘Multi-object tracking through occlusions by local tracklets filtering and global tracklets association with detection responses’. 2009 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2009), 20–25 June 2009, Miami, Florida, USA, 2009, pp. 12001207.
        . 2009 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2009), 20–25 June 2009, Miami, Florida, USA , 1200 - 1207
    8. 8)
      • B. Yang , R. Nevatia .
        8. Yang, B., Nevatia, R.: ‘Online learned discriminative part-based appearance models for multi-human tracking’. Computer Vision – ECCV 2012 – 12th European Conf. on Computer Vision, Florence, Italy, 7–13 October 2012, Proc. Part I, 2012, pp. 484498.
        . Computer Vision – ECCV 2012 – 12th European Conf. on Computer Vision, Florence, Italy, 7–13 October 2012, Proc. Part I , 484 - 498
    9. 9)
      • A.R. Zamir , A. Dehghan , M. Shah .
        9. Zamir, A.R., Dehghan, A., Shah, M.: ‘Gmcp-tracker: Global multi-object tracking using generalized minimum clique graphs’. Computer Vision – ECCV 2012 – 12th European Conf. on Computer Vision, Florence, Italy, October 7-13, 2012, Proc., Part II, 2012, pp. 343356.
        . Computer Vision – ECCV 2012 – 12th European Conf. on Computer Vision, Florence, Italy, October 7-13, 2012, Proc., Part II , 343 - 356
    10. 10)
      • B. Wu , R. Nevatia .
        10. Wu, B., Nevatia, R.: ‘Detection and tracking of multiple, partially occluded humans by bayesian combination of edgelet based part detectors’, Int. J. Comput. Vis., 2007, 75, (2), pp. 247266.
        . Int. J. Comput. Vis. , 2 , 247 - 266
    11. 11)
      • H. Jiang , S. Fels , J.J. Little .
        11. Jiang, H., Fels, S., Little, J.J.: ‘A linear programming approach for multiple object tracking’. 2007 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2007), 18–23 June 2007, Minneapolis, Minnesota, USA, 2007.
        . 2007 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2007), 18–23 June 2007, Minneapolis, Minnesota, USA
    12. 12)
      • J. Berclaz , F. Fleuret , E. Türetken .
        12. Berclaz, J., Fleuret, F., Türetken, E., et al: ‘Multiple object tracking using k-shortest paths optimization’, IEEE Trans. Pattern Anal. Mach. Intell., 2011, 33, (9), pp. 18061819.
        . IEEE Trans. Pattern Anal. Mach. Intell. , 9 , 1806 - 1819
    13. 13)
      • W. Brendel , M.R. Amer , S. Todorovic .
        13. Brendel, W., Amer, M.R., Todorovic, S.: ‘Multiobject tracking as maximum weight in dependent set’. The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, 2011, pp. 12731280.
        . The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011 , 1273 - 1280
    14. 14)
      • G. Shu , A. Dehghan , O. Oreifej .
        14. Shu, G., Dehghan, A., Oreifej, O., et al: ‘Part-based multiple-person tracking with partial occlusion handling’. 2012 IEEE Conf. on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012, 2012, pp. 18151821.
        . 2012 IEEE Conf. on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012 , 1815 - 1821
    15. 15)
      • F. Porikli , O. Tuzel , P. Meer .
        15. Porikli, F., Tuzel, O., Meer, P.: ‘Covariance tracking using model update based on lie algebra’. CVPR (1), 2006, pp. 728735.
        . CVPR (1) , 728 - 735
    16. 16)
      • T.E. Fortmann , Y. Bar-Shalom , M. Scheffe .
        16. Fortmann, T.E., Bar-Shalom, Y., Scheffe, M.: ‘Multi-target tracking using joint probabilistic data association’. 19th IEEE Conf. on Decision and Control Including the Symp. on Adaptive Processes, 1980, vol. 19.
        . 19th IEEE Conf. on Decision and Control Including the Symp. on Adaptive Processes
    17. 17)
      • D.B. Reid .
        17. Reid, D.B.: ‘An algorithm for tracking multiple targets’, IEEE Trans. Autom. Control, 1979, 24, pp. 843854.
        . IEEE Trans. Autom. Control , 843 - 854
    18. 18)
      • T. Yang , S.Z. Li , Q. Pan .
        18. Yang, T., Li, S.Z., Pan, Q., et al: ‘Real-time multiple objects tracking with occlusion handling in dynamic scenes’. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2005), 20–26 June 2005, San Diego, CA, USA, 2005, pp. 970975.
        . 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2005), 20–26 June 2005, San Diego, CA, USA , 970 - 975
    19. 19)
      • L. Zhang , Y. Li , R. Nevatia .
        19. Zhang, L., Li, Y., Nevatia, R.: ‘Global data association for multi-object tracking using network flows’. 2008 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2008), 24–26 June 2008, Anchorage, Alaska, USA, 2008.
        . 2008 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2008), 24–26 June 2008, Anchorage, Alaska, USA
    20. 20)
      • H. Pirsiavash , D. Ramanan , C.C. Fowlkes .
        20. Pirsiavash, H., Ramanan, D., Fowlkes, C.C.: ‘Globally-optimal greedy algorithms for tracking a variable number of objects’. The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, 2011, pp. 12011208.
        . The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011 , 1201 - 1208
    21. 21)
      • H.B. Shitrit , J. Berclaz , F. Fleuret .
        21. Shitrit, H.B., Berclaz, J., Fleuret, F., et al: ‘Tracking multiple people under global appearance constraints’. IEEE Int. Conf. on Computer Vision, ICCV 2011, Barcelona, Spain, 6–13 November 2011, 2011, pp. 137144.
        . IEEE Int. Conf. on Computer Vision, ICCV 2011, Barcelona, Spain, 6–13 November 2011 , 137 - 144
    22. 22)
      • M. Pavan , M. Pelillo .
        22. Pavan, M., Pelillo, M.: ‘A new graph-theoretic approach to clustering and segmentation’. Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2003, pp. 145152.
        . Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR) , 145 - 152
    23. 23)
      • M. Pavan , M. Pelillo .
        23. Pavan, M., Pelillo, M.: ‘Dominant sets and pairwise clustering’, IEEE Trans. Pattern Anal. Mach. Intell., 2007, 29, (1), pp. 167172.
        . IEEE Trans. Pattern Anal. Mach. Intell. , 1 , 167 - 172
    24. 24)
      • M. Pavan , M. Pelillo .
        24. Pavan, M., Pelillo, M.: ‘Graph-theoretic approach to clustering and segmentation’. CVPR (1), 2003, pp. 145152.
        . CVPR (1) , 145 - 152
    25. 25)
      • S.R. Bulò , M. Pelillo , I.M. Bomze .
        25. Bulò, S.R., Pelillo, M., Bomze, I.M.: ‘Graph-based quadratic optimization: a fast evolutionary approach’, Comput. Vis. Image Underst., 2011, 115, (7), pp. 984995.
        . Comput. Vis. Image Underst. , 7 , 984 - 995
    26. 26)
      • N. Dalal , B. Triggs .
        26. Dalal, N., Triggs, B.: ‘Histograms of oriented gradients for human detection’. 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2005), 20–26 June 2005, San Diego, CA, USA, 2005, pp. 886893.
        . 2005 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition (CVPR 2005), 20–26 June 2005, San Diego, CA, USA , 886 - 893
    27. 27)
      • D. Coppi , S. Calderara , R. Cucchiara .
        27. Coppi, D., Calderara, S., Cucchiara, R.: ‘Appearance tracking by transduction in surveillance scenarios’. AVSS, 2011, pp. 142147.
        . AVSS , 142 - 147
    28. 28)
      • D. Coppi , S. Calderara , R. Cucchiara .
        28. Coppi, D., Calderara, S., Cucchiara, R.: ‘People appearance tracing in video by spectral graph transduction’. ICCV Workshops, 2011, pp. 920927.
        . ICCV Workshops , 920 - 927
    29. 29)
      • Y. Liu , G. Li , Z. Shi .
        29. Liu, Y., Li, G., Shi, Z.: ‘Covariance tracking via geometric particle filtering’, EURASIP J. Adv. Signal Process, 2010, 2010, pp. 122.
        . EURASIP J. Adv. Signal Process , 1 - 22
    30. 30)
      • M.J. Metternich , M. Worring , A.W.M. Smeulders .
        30. Metternich, M.J., Worring, M., Smeulders, A.W.M.: ‘Color based tracing in real-life surveillance data’, T. Data Hiding Multimedia Secur., 2010, 5, pp. 1833.
        . T. Data Hiding Multimedia Secur. , 18 - 33
    31. 31)
      • W. Frstner , B. Moonen . (1999)
        31. Frstner, W., Moonen, B.: ‘A metric for covariance matrices’. Technical Report, Dept. Geodesy Geoinform., Stuttgart Univ., Stuttgart, Germany, 1999.
        .
    32. 32)
      • C. Zhong , X. Yue , Z. Zhang .
        32. Zhong, C., Yue, X., Zhang, Z., et al: ‘A clustering ensemble: Two-level-refined co-association matrix with path-based transformation’, Pattern Recogn., 2015, 48, (8), pp. 26992709.
        . Pattern Recogn. , 8 , 2699 - 2709
    33. 33)
      • H. Wang , C. Weng , J. Yuan .
        33. Wang, H., Weng, C., Yuan, J.: ‘Multi-feature spectral clustering with minimax optimization’. The IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), June 2014.
        . The IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)
    34. 34)
      • V. Premachandran , R. Kakarala .
        34. Premachandran, V., Kakarala, R.: ‘Consensus of k-nns for robust neighborhood selection on graph-based manifolds’. 2013 IEEE Conf. on Computer Vision and Pattern Recognition, Portland, OR, USA, 23–28 June 2013, 2013, pp. 15941601.
        . 2013 IEEE Conf. on Computer Vision and Pattern Recognition, Portland, OR, USA, 23–28 June 2013 , 1594 - 1601
    35. 35)
      • A. Lourenço , S.R. Bulò , N. Rebagliati .
        35. Lourenço, A., Bulò, S.R., Rebagliati, N., et al: ‘Probabilistic consensus clustering using evidence accumulation’, Mach. Learn., 2015, 98, (1–2), pp. 331357.
        . Mach. Learn. , 331 - 357
    36. 36)
      • B. Yang , R. Nevatia .
        36. Yang, B., Nevatia, R.: ‘An online learned CRF model for multi-target tracking’. 2012 IEEE Conf. on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012, 2012, pp. 20342041.
        . 2012 IEEE Conf. on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012 , 2034 - 2041
    37. 37)
      • B. Yang , R. Nevatia .
        37. Yang, B., Nevatia, R.: ‘Multi-target tracking by online learning a CRF model of appearance and motion patterns’, Int. J. Comput. Vis., 2014, 107, (2), pp. 203217.
        . Int. J. Comput. Vis. , 2 , 203 - 217
    38. 38)
      • L. Leal-Taixé , A. Milan , I. Reid .
        38. Leal-Taixé, L., Milan, A., Reid, I., et al: ‘Motchallenge 2015: Towards a benchmark for multi-target tracking’. arXiv:1504.01942 [cs], April 2015, arXiv: 1504.01942.
        .
    39. 39)
      • A. Milan , L. Leal-Taix , K. Schindler .
        39. Milan, A., Leal-Taix, L., Schindler, K., et al: ‘Joint tracking and segmentation of multiple targets’. CVPR, 2015, pp. 53975406.
        . CVPR , 5397 - 5406
    40. 40)
      • C. Kuo , R. Nevatia .
        40. Kuo, C., Nevatia, R.: ‘How does person identity recognition help multi-person tracking?’. The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, 2011, pp. 12171224.
        . The 24th IEEE Conf. on Computer Vision and Pattern Recognition, CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011 , 1217 - 1224
    41. 41)
      • K. Bernardin , R. Stiefelhagen .
        41. Bernardin, K., Stiefelhagen, R.: ‘Evaluating multiple object tracking performance: The CLEAR MOT metrics’, EURASIP J. Image Video Process., 2008, 2008, pp. 1:11:10.
        . EURASIP J. Image Video Process. , 1:1 - 1:10
    42. 42)
      • K. Fragkiadaki , W. Zhang , G. Zhang .
        42. Fragkiadaki, K., Zhang, W., Zhang, G., et al: ‘Two-granularity tracking: Mediating trajectory and detection graphs for tracking under occlusions’. Computer Vision – ECCV 2012 – 12th European Conf. on Computer Vision, Florence, Italy, 7–13 October, 2012, Proc., Part V, 2012, pp. 552565.
        . Computer Vision – ECCV 2012 – 12th European Conf. on Computer Vision, Florence, Italy, 7–13 October, 2012, Proc., Part V , 552 - 565
    43. 43)
      • A. Milan , K. Schindler , S. Roth .
        43. Milan, A., Schindler, K., Roth, S.: ‘Detection- and trajectory-level exclusion in multiple object tracking’. 2013 IEEE Conf. on Computer Vision and Pattern Recognition, Portland, OR, USA, 23–28 June 2013, 2013, pp. 36823689.
        . 2013 IEEE Conf. on Computer Vision and Pattern Recognition, Portland, OR, USA, 23–28 June 2013 , 3682 - 3689
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2015.0297
Loading

Related content

content/journals/10.1049/iet-cvi.2015.0297
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address