http://iet.metastore.ingenta.com
1887

Enhancing person re-identification by late fusion of low-, mid- and high-level features

Enhancing person re-identification by late fusion of low-, mid- and high-level features

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Biometrics — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Person re-identification is the process of finding people across different cameras. In this process, focus often lies in developing strong feature descriptors or a robust metric learning algorithm. While the two aspects are the most important steps in order to secure a high performance, a less explored aspect is late fusion of complementary features. For this purpose, this study proposes a late fusing scheme that, based on an experimental analysis, combines three systems that focus on extracting features and provide supervised learning on different abstraction levels. To analyse the behaviour of the proposed system, both rank aggregation and score-level fusion are applied. The authors’ proposed fusion scheme increases results on both small and large datasets. Experimental results on VIPeR show accuracies 5.43% higher than related systems, while results on PRID450S and CUHK01 increase state-of-the-art results by 10.94 and 14.84%, respectively. Furthermore, a cross-dataset test shows an increased rank-1 accuracy of 28.26% when training on CUHK02 and testing on VIPeR. Finally, an analysis of the late fusion shows aggregation to be better when individual results are unequally distributed within top-10 while score-level fusion provides better results when two individual results lie within top-5 while the last lies outside top-10.

References

    1. 1)
      • Z. Liu , Z. Zhang , Q. Wu .
        1. Liu, Z., Zhang, Z., Wu, Q., et al: ‘Enhancing person re-identification by integrating gait biometric’, Neurocomputing, 2015, 168, pp. 11441156.
        . Neurocomputing , 1144 - 1156
    2. 2)
      • B. DeCann , A. Ross .
        2. DeCann, B., Ross, A.: ‘Modelling errors in a biometric re-identification system’, IET Biometrics, 2015, 4, (4), pp. 209219.
        . IET Biometrics , 4 , 209 - 219
    3. 3)
      • A. Schumann , E. Monari .
        3. Schumann, A., Monari, E.: ‘A soft-biometrics dataset for person tracking and reidentification’. Proc. AVSS, 2014, pp. 193198.
        . Proc. AVSS , 193 - 198
    4. 4)
      • W. Li , R. Zhao , T. Xiao .
        4. Li, W., Zhao, R., Xiao, T., et al: ‘Deepreid: deep filter pairing neural network for person re-identification’. Proc. CVPR, 2014, pp. 152159.
        . Proc. CVPR , 152 - 159
    5. 5)
      • L. Zheng , L. Shen , L. Tian .
        5. Zheng, L., Shen, L., Tian, L., et al: ‘Scalable person re-identification: a benchmark’. Proc. ICCV, 2015, pp. 11161124.
        . Proc. ICCV , 1116 - 1124
    6. 6)
      • D. Gray , H. Tao .
        6. Gray, D., Tao, H.: ‘Viewpoint invariant pedestrian recognition with an ensemble of localized features’. Proc. ECCV, 2008, pp. 262275.
        . Proc. ECCV , 262 - 275
    7. 7)
      • L. Bazzani , M. Cristani , V. Murino .
        7. Bazzani, L., Cristani, M., Murino, V.: ‘Symmetry-driven accumulation of local features for human characterization and re-identification’, Comput. Vis. Image Underst., 2013, 117, (2), pp. 130144.
        . Comput. Vis. Image Underst. , 2 , 130 - 144
    8. 8)
      • S. Bak , F. Brémond . (2014)
        8. Bak, S., Brémond, F.: ‘Re-identification by covariance descriptors’, in Gong, S., Cristani, M., Yan, S., et al (Eds.): ‘Person re-identification, volume 1 of advances in computer vision and pattern recognition’ (Springer, London, 2014, 1st edn.), Ch. 4, pp. 7191.
        .
    9. 9)
      • R. Zhao , W. Ouyang , X. Wang .
        9. Zhao, R., Ouyang, W., Wang, X.: ‘Learning mid-level filters for person re-identification’. Proc. CVPR, 2014, pp. 144151.
        . Proc. CVPR , 144 - 151
    10. 10)
      • S. Lazebnik , C. Schmid , J. Ponce .
        10. Lazebnik, S., Schmid, C., Ponce, J.: ‘Beyond bags of features: spatial pyramid matching for recognizing natural scene categories’. Proc. CVPR, 2006, vol. 2, pp. 21692178.
        . Proc. CVPR , 2169 - 2178
    11. 11)
      • A. Krizhevsky , I. Sutskever , G.E. Hinton .
        11. Krizhevsky, A., Sutskever, I., Hinton, G.E.: ‘Imagenet classification with deep convolutional neural networks’. Proc. NIPS, 2012, pp. 10971105.
        . Proc. NIPS , 1097 - 1105
    12. 12)
      • M. Koestinger , M. Hirzer , P. Wohlhart .
        12. Koestinger, M., Hirzer, M., Wohlhart, P., et al: ‘Large scale metric learning from equivalence constraints’. Proc. CVPR, 2012, pp. 22882295.
        . Proc. CVPR , 2288 - 2295
    13. 13)
      • F. Xiong , M. Gou , O. Camps .
        13. Xiong, F., Gou, M., Camps, O., et al: ‘Person re-identification using kernel-based metric learning methods’. Proc. ECCV, 2014, pp. 116.
        . Proc. ECCV , 1 - 16
    14. 14)
      • M. Pantic , L.J. Rothkrantz .
        14. Pantic, M., Rothkrantz, L.J.: ‘Toward an affect-sensitive multimodal human-computer interaction’, Proc. IEEE, 2003, 91, (9), pp. 13701390.
        . Proc. IEEE , 9 , 1370 - 1390
    15. 15)
      • J. Kittler , M. Hatef , R.P. Duin .
        15. Kittler, J., Hatef, M., Duin, R.P., et al: ‘On combining classifiers’, IEEE Trans. Pattern Anal. Mach. Intell., 1998, 20, (3), pp. 226239.
        . IEEE Trans. Pattern Anal. Mach. Intell. , 3 , 226 - 239
    16. 16)
      • C. Dwork , R. Kumar , M. Naor .
        16. Dwork, C., Kumar, R., Naor, M., et al: ‘Rank aggregation methods for the web’. Proc. WWW, 2001, pp. 613622.
        . Proc. WWW , 613 - 622
    17. 17)
      • R. Zhao , W. Ouyang , X. Wang .
        17. Zhao, R., Ouyang, W., Wang, X.: ‘Unsupervised salience learning for person re-identification’. Proc. CVPR, 2013, pp. 35863593.
        . Proc. CVPR , 3586 - 3593
    18. 18)
      • S. Liao , Y. Hu , X. Zhu .
        18. Liao, S., Hu, Y., Zhu, X., et al: ‘Person re-identification by local maximal occurrence representation and metric learning’. Proc. CVPR, 2015, pp. 21972206.
        . Proc. CVPR , 2197 - 2206
    19. 19)
      • Y. Yang , J. Yang , J. Yan .
        19. Yang, Y., Yang, J., Yan, J., et al: ‘Salient color names for person reidentification’. Proc. ECCV, 2014, pp. 536551.
        . Proc. ECCV , 536 - 551
    20. 20)
      • B. Prosser , W.-S. Zheng , S. Gong .
        20. Prosser, B., Zheng, W.-S., Gong, S., et al: ‘Person re-identification by support vector ranking’. Proc. BMVC, 2010, pp. 21.121.11.
        . Proc. BMVC , 21.1 - 21.11
    21. 21)
      • W.-S. Zheng , S. Gong , T. Xiang .
        21. Zheng, W.-S., Gong, S., Xiang, T.: ‘Person re-identification by probabilistic relative distance comparison’. Proc. CVPR, 2011, pp. 649656.
        . Proc. CVPR , 649 - 656
    22. 22)
      • L. Zheng , L. Shen , L. Tian .
        22. Zheng, L., Shen, L., Tian, L., et al: ‘Person re-identification meets image search’. CoRR, 2015, pp. 43214330, abs/1502.02171. Available at http://arxiv.org/abs/1502.02171, retrieved from: http://arxiv.org/abs/1502.02171.
        . CoRR , 4321 - 4330
    23. 23)
      • X. Liu , M. Song , D. Tao .
        23. Liu, X., Song, M., Tao, D., et al: ‘Semi-supervised coupled dictionary learning for person re-identification’. Proc. CVPR, 2014, pp. 35503557.
        . Proc. CVPR , 3550 - 3557
    24. 24)
      • E. Ahmed , M. Jones , T.K. Marks .
        24. Ahmed, E., Jones, M., Marks, T.K.: ‘An improved deep learning architecture for person reidentification’. Proc. CVPR, 2015, pp. 39083916.
        . Proc. CVPR , 3908 - 3916
    25. 25)
      • D. Yi , Z. Lei , S. Liao .
        25. Yi, D., Lei, Z., Liao, S., et al: ‘Deep metric learning for person re-identification’. Proc. ICPR, 2014, pp. 3439.
        . Proc. ICPR , 34 - 39
    26. 26)
      • S. Paisitkriangkrai , C. Shen , A. van den Hengel .
        26. Paisitkriangkrai, S., Shen, C., van den Hengel, A.: ‘Learning to rank in person re-identification with metric ensembles’. Proc. CVPR, 2015, pp. 18461855.
        . Proc. CVPR , 1846 - 1855
    27. 27)
      • S. Wu , Y.-C. Chen , W.-S. Zheng .
        27. Wu, S., Chen, Y.-C., Zheng, W.-S.: ‘An enhanced deep feature representation for person reidentification’. Proc. WACV, 2016, pp. 18.
        . Proc. WACV , 1 - 8
    28. 28)
      • L. Zheng , S. Wang , L. Tian .
        28. Zheng, L., Wang, S., Tian, L., et al: ‘Query-adaptive late fusion for image search and person re-identification’. Proc. CVPR, 2015, pp. 17411750.
        . Proc. CVPR , 1741 - 1750
    29. 29)
      • N. Martinel , C. Micheloni , G.L. Foresti .
        29. Martinel, N., Micheloni, C., Foresti, G.L.: ‘A pool of multiple person re-identification experts’, Pattern Recognit. Lett., 2016, 71, pp. 2330.
        . Pattern Recognit. Lett. , 23 - 30
    30. 30)
      • X. Liu , H. Wang , Y. Wu .
        30. Liu, X., Wang, H., Wu, Y., et al: ‘An ensemble color model for human reidentification’. Proc. WACV, 2015, pp. 868875.
        . Proc. WACV , 868 - 875
    31. 31)
      • M. Ye , J. Chen , Q. Leng .
        31. Ye, M., Chen, J., Leng, Q., et al: ‘Coupled-view based ranking optimization for person re-identification’. Proc. MMM, 2015, pp. 105117.
        . Proc. MMM , 105 - 117
    32. 32)
      • R.F. de Carvalho Prates , W.R. Schwartz .
        32. de Carvalho Prates, R.F., Schwartz, W.R.: ‘Cbra: color-based ranking aggregation for person re-identification’. Proc. ICIP, 2015, pp. 19751979.
        . Proc. ICIP , 1975 - 1979
    33. 33)
      • D.J. Jobson , Z.-u. Rahman , G.A. Woodell .
        33. Jobson, D.J., Rahman, Z.-u., Woodell, G.A.: ‘A multiscale retinex for bridging the gap between color images and the human observation of scenes’, IEEE Trans. Image Process., 1997, 6, (7), pp. 965976.
        . IEEE Trans. Image Process. , 7 , 965 - 976
    34. 34)
      • S. Liao , G. Zhao , V. Kellokumpu .
        34. Liao, S., Zhao, G., Kellokumpu, V., et al: ‘Modeling pixel process with scale invariant local patterns for background subtraction in complex scenes’. Proc. CVPR, 2010, pp. 13011306.
        . Proc. CVPR , 1301 - 1306
    35. 35)
      • S. Li , M. Shao , Y. Fu .
        35. Li, S., Shao, M., Fu, Y.: ‘Cross-view projective dictionary learning for person re-identification’. Proc. AAAI, 2015, pp. 21552161.
        . Proc. AAAI , 2155 - 2161
    36. 36)
      • Y.-C. Chen , W.-S. Zheng , J. Lai .
        36. Chen, Y.-C., Zheng, W.-S., Lai, J.: ‘Mirror representation for modeling view-specific transform in person re-identification’. Proc. IJCAI, 2015, pp. 34023408.
        . Proc. IJCAI , 3402 - 3408
    37. 37)
      • R.F. de Carvalho Prates , W.R. Schwartz .
        37. de Carvalho Prates, R.F., Schwartz, W.R.: ‘Appearance-based person re-identification by intra-camera discriminative models and rank aggregation’. Proc. ICB, 2015, pp. 6572.
        . Proc. ICB , 65 - 72
    38. 38)
      • J.M. Stuart , E. Segal , D. Koller .
        38. Stuart, J.M., Segal, E., Koller, D., et al: ‘A gene-coexpression network for global discovery of conserved genetic modules’, Science, 2003, 302, (5643), pp. 249255.
        . Science , 5643 , 249 - 255
    39. 39)
      • R. Kolde , S. Laur , P. Adler .
        39. Kolde, R., Laur, S., Adler, P., et al: ‘Robust rank aggregation for gene list integration and meta-analysis’, Bioinformatics, 2012, 28, (4), pp. 573580.
        . Bioinformatics , 4 , 573 - 580
    40. 40)
      • P.M. Roth , M. Hirzer , M. Köstinger . (2014)
        40. Roth, P.M., Hirzer, M., Köstinger, M.: ‘Mahalanobis distance learning for person re-identification’, Gong, S., Cristani, M., Yan, S., et al (Eds.): ‘Person re-identification, volume 1 of advances in computer vision and pattern recognition’ (Springer, London, 2014, 1st edn.), ch. 12, pp. 247267.
        .
    41. 41)
      • W. Li , R. Zhao , X. Wang .
        41. Li, W., Zhao, R., Wang, X.: ‘Human reidentification with transferred metric learning’. Proc. ACCV, 2012, pp. 3144.
        . Proc. ACCV , 31 - 44
    42. 42)
      • S.-Z. Chen , C.-C. Guo , J.-H. Lai .
        42. Chen, S.-Z., Guo, C.-C., Lai, J.-H.: ‘Deep ranking for person re-identification via joint representation learning’, IEEE Trans. Image Process., 2016, 25, (5), pp. 23532367.
        . IEEE Trans. Image Process. , 5 , 2353 - 2367
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-bmt.2016.0200
Loading

Related content

content/journals/10.1049/iet-bmt.2016.0200
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address