access icon openaccess Review of person re-identification techniques

Person re-identification across different surveillance cameras with disjoint fields of view has become one of the most interesting and challenging subjects in the area of intelligent video surveillance. Although several methods have been developed and proposed, certain limitations and unresolved issues remain. In all of the existing re-identification approaches, feature vectors are extracted from segmented still images or video frames. Different similarity or dissimilarity measures have been applied to these vectors. Some methods have used simple constant metrics, whereas others have utilised models to obtain optimised metrics. Some have created models based on local colour or texture information, and others have built models based on the gait of people. In general, the main objective of all these approaches is to achieve a higher-accuracy rate and lower-computational costs. This study summarises several developments in recent literature and discusses the various available methods used in person re-identification. Specifically, their advantages and disadvantages are mentioned and compared.

Inspec keywords: image colour analysis; video surveillance; feature extraction; image segmentation; video cameras; image texture

Other keywords: video frames; texture information; constant metrics; person re-identification technique; similarity measures; segmented still images; optimised metrics; disjoint view field; feature vector extraction; intelligent video surveillance; local colour; surveillance cameras; dissimilarity measures

Subjects: Computer vision and image processing techniques; Image recognition; Image sensors; Video signal processing

References

    1. 1)
      • 35. Goldmann, L.: ‘Appearance-based person recognition for surveillance applications’ (Technical University of Berlin, Communication Systems Group, 2006).
    2. 2)
      • 1. Allouch, A.: ‘People re-identification across a camera network’. Master's thesis in computer science at the school of computer science and engineering royal institute of technology, Stockholm, Sweden, 2010.
    3. 3)
      • 86. Bilmes, J.A.: ‘A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models’, (International Computer Science Institute, 1998), pp. 113.
    4. 4)
      • 10. Skog, D.: ‘Gait-based re-identification of people in urban surveillance video’. Master's thesis, Uppsala University, Department of Information Technology, 2010.
    5. 5)
    6. 6)
      • 68. Wong, K.M., Po, L.M., Cheung, K.W.: ‘Dominant color structure descriptor for image retrieval’. Proc. Int. Conf. Image Processing, San Antonio, USA, October 2007, vol. 4, pp. 365368.
    7. 7)
      • 78. Hirzer, M., Beznai, C., Roth, P.M., Bischof, H.: ‘Person re-identification by descriptive and discriminative classification’. Proc. 17th Scandinavian Conf. Image Analysis, Ystad Sltsjobad, Sweden, May 2011, pp. 91102.
    8. 8)
      • 99. Available at http://www.groups.inf.ed.ac.uk/vision/CAVIAR/CAVIARDATA1/.
    9. 9)
      • 54. Fieguth, P., Terzopoulos, D.: ‘Color-based tracking of heads and other mobile objects at video frame rates’. Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, San Juan, USA, June 1997, pp. 2127.
    10. 10)
      • 53. Wu, J., Geyer, C., Rehg, J.M.: ‘Real-time human detection using contour cues’. Proc. IEEE Int. Conf. Robotics and Automation (ICRA), Shanghai, China, May 2011, pp. 860867.
    11. 11)
      • 80. Fogel, I., Sagi, D.: ‘Gabor filters as texture discriminator’, Biol. Cybern., 1989, 61, (2), pp. 103113.
    12. 12)
      • 2. Cong, T., Achard, C., Khoudour, L., Douadi, L.: ‘Video sequences association for people re-identification across multiple non-overlapping cameras’. Proc. Int. Conf. Image Analysis and Processing (ICIAP), Vietri Sul Mare, Italy, September 2009, pp. 179189.
    13. 13)
    14. 14)
    15. 15)
      • 86. Bilmes, J.A.: ‘A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models’, (International Computer Science Institute, 1998), pp. 113.
    16. 16)
      • 24. D'Orazio, T., Cicirelli, G.: ‘People re-identification and tracking from multiple cameras: a review’. Proc. 19th IEEE Int. Conf. Image Processing (ICIP), FL, USA, October 2012, pp. 16011604.
    17. 17)
      • 106. Vaquero, D., Feris, R., Tran, D., Brown, L., Hampapur, A., Turk, M.: ‘Attribute-based people search in surveillance environments’. Proc. Workshop on Applications of Computer Vision (WACV), UT, USA, December 2009, pp. 18.
    18. 18)
      • 101. Cong, D-N.T., Khoudour, L., Achard, C., Phothisane, P.: ‘People re-identification by means of a camera network using a graph-based approach’. Proc. Conf. Machine Vision Applications, Minato, Japan, May 2009, pp. 152155.
    19. 19)
    20. 20)
      • 35. Goldmann, L.: ‘Appearance-based person recognition for surveillance applications’ (Technical University of Berlin, Communication Systems Group, 2006).
    21. 21)
      • 59. Khan, A., Zhang, J., Wang, Y.: ‘Appearance-based re-identification of people in video’. Proc. Int. Conf. Digital Image Computing: Techniques and Applications (DICTA ’10), Sydney, Australia, December 2010, pp. 357362.
    22. 22)
    23. 23)
      • 90. Prosser, B., Zheng, W.S., Gong, S., Xiang, T.: ‘Person re-identification by support vector ranking’. Proc. British Machine Vision Conf. (BMVC), Aberystwyth, UK, September 2010, vol. 2, no. 5, pp. 21.121.11.
    24. 24)
      • 17. Forsśen, P.E.: ‘Maximally stable color regions for recognition and matching’. Proc. Conf. Computer Vision and Pattern Recognition (CVPR), MN, USA, June 2007, pp. 18.
    25. 25)
      • 72. Bauml, M., Stiefelhagen, R.: ‘Evaluation of local features for person re-identification in image sequences’. Proc. Eighth IEEE Int. Conf. Advanced Video and Signal based Surveillance AVSS, Klagenfurt, Austria, September 2011, pp. 291296.
    26. 26)
      • 29. Zuriarrain, I., Aizpurua, J.I., Lerasle, F., Arana, N.: ‘Multiple-person tracking devoted to distributed multi smart camera networks’. Proc. IEEE Int. Conf. Intelligent Robots and Systems, Taipei, Taiwan, October 2010, pp. 24692474.
    27. 27)
    28. 28)
    29. 29)
      • 61. Zheng, W., Gong, Sh., Xiang, T.: ‘Person re-identification by probabilistic relative distance comparison’. Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), CO, USA, June 2011, pp. 649656.
    30. 30)
      • 19. Zhang, Y., Li, S.: ‘Gabor-LBP based region covariance descriptor for person re-identification’. Proc. Sixth Int. Conf. Image and Graphics (ICIG), Anhui, China, August 2011, pp. 368371.
    31. 31)
      • 41. Bak, S., Corvee, E., Brémond, F., Thonnat, M.: ‘Person re-identification using haar-based and DCD-based signature’. Proc. Seventh IEEE Int. Conf. Advanced Video and Signal Based Surveillance, Boston, USA, September 2010, pp. 18.
    32. 32)
    33. 33)
      • 20. Zheng, W., Gong, Sh., Xiang, T.: ‘Associating groups of people’. Proc. British Machine Vision Conf. (BMVC), London, UK, September 2009, pp. 23602367.
    34. 34)
      • 28. Musa, Z.B., Watada, J.: ‘A particle filter approach for multi-camera tracking systems in a large view space’, Int. J. Innov. Comput. Inf. Control, 2010, 6, (6), pp. 28272836.
    35. 35)
      • 31. Nguyen, H.Q., Ngo, A.Q.T.: ‘A novel content based image retrieval method based on splitting the image into homogeneous regions’, Int. J. Innov. Comput. Inf. Control, 2010, 6, (9), pp. 40294040.
    36. 36)
      • 1. Allouch, A.: ‘People re-identification across a camera network’. Master's thesis in computer science at the school of computer science and engineering royal institute of technology, Stockholm, Sweden, 2010.
    37. 37)
      • 91. Zhao, R., Ouyang, W., Wang, X.: ‘Unsupervised salience learning for person re-identification’. Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR ’13), Portland, USA, June 2013, pp. 35863593.
    38. 38)
    39. 39)
    40. 40)
      • 16. Farenzena, M., Bazzani, L., Perina, A., Murino, V., Cristani, M.: ‘Person re-identification by symmetry-driven accumulation of local features’. Proc. Int. Conf. Computer Vision and Pattern Recognition (CVPR), San Francisco, USA, June 2010, pp. 23602367.
    41. 41)
      • 68. Wong, K.M., Po, L.M., Cheung, K.W.: ‘Dominant color structure descriptor for image retrieval’. Proc. Int. Conf. Image Processing, San Antonio, USA, October 2007, vol. 4, pp. 365368.
    42. 42)
      • 50. Horprasert, T., Harwood, D., Davis, L.: ‘A statistical approach for real-time robust background subtraction and shadow detection’. Proc. IEEE Int. Conf. Computer Vision (ICCV), Kerkyra, Greece, September 1999, pp. 119.
    43. 43)
      • 9. Lantagne, M., Parizeau, M., Bergevin, R.: ‘VIP: vision tool for comparing images of people’. Proc. 16th IEEE Conf. Vision Interface, Halifax, Canada, June 2003, pp. 3542.
    44. 44)
    45. 45)
      • 67. Shao, H., Wu, Y., Cui, W., Zhang, J.: ‘Image retrieval based on MPEG-7 dominant color descriptor’. Proc. IEEE Ninth Int. Conf. Young Computer Scientists, Hunan, China, November 2008, pp. 753757.
    46. 46)
      • 7. Presti, L.Lo, Morana, M., Cascia, M.La.: ‘A data association algorithm for people re-identification in photo sequences’. Proc. IEEE Int. Symp. Multimedia, Taichung, Taiwan, December 2010, pp. 318323.
    47. 47)
      • 10. Skog, D.: ‘Gait-based re-identification of people in urban surveillance video’. Master's thesis, Uppsala University, Department of Information Technology, 2010.
    48. 48)
    49. 49)
      • 5. Guermazi, R., Hammami, M., Hama, A.B.: ‘Violent web images classification based on MPEG7 color descriptors’. Proc. IEEE Int. Conf. Systems Man and Cybernetics, San Antonio, USA, October 2009, pp. 31063111.
    50. 50)
      • 37. Xiang, Z.J., Chen, Q., Liu, Y.: ‘Person re-identification by fuzzy space color histogram’. Multimedia Tools and Applications, 2012, pp. 117.
    51. 51)
    52. 52)
      • 60. Martinel, N., Micheloni, C.: ‘Re-identify people in wide area camera network’. Proc. IEEE Conf. Computer Vision and Pattern Recognition Workshops, RI, USA, June 2012, pp. 3136.
    53. 53)
      • 79. Grauman, K., Darrell, T.: ‘The pyramid match kernel: discriminative classification with sets of image features’. Proc. 10th Int. Conf. Computer Vision (ICCV), Beijing, China, October 2005, pp. 14581465.
    54. 54)
    55. 55)
      • 45. Khedher, M.I., El-Yacoubi, M.A., Dorizzi, B.: ‘Probabilistic matching pair selection for SURF-based person re-identification’. Proc. Int. Conf. Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany, September 2012, pp. 16.
    56. 56)
      • 52. Eisenbach, M., Kolarow, A.: ‘View invariant appearance-based person re-identification using fast online feature selection and score level fusion’. Proc. IEEE Ninth Int. Conf. Advanced Video and Signal-based Surveillance (AVSS), Beijing, China, September 2012, pp. 184190.
    57. 57)
      • 84. Ohara, Y., Sagawa, R., Echigo, T., Yagi, Y.: ‘Gait volume spatio-temporal analysis of walking’. Proc. Fifth Workshop on Omni Directional Vision, Camera Networks and Non-Classical Cameras, Prague, Czech Republic, May 2004, pp. 7990.
    58. 58)
      • 49. Monari, E.: ‘Color constancy using shadow-based illumination maps for appearance-based person re-identification’. Proc. IEEE Ninth Int. Conf. Advanced Video and Signal-based Surveillance, Beijing, China, September 2012, pp. 197202.
    59. 59)
    60. 60)
    61. 61)
      • 27. Satta, R., Fumera, G., Roli, F., Cristani, M., Murino, V.: ‘A multiple component matching framework for person re-identification’. Proc. 16th Int. Conf. Image Analysis and Processing (ICIAP), Ravenna, Italy, September 2011, pp. 140149.
    62. 62)
      • 25. Bäuml, M., Bernardin, K., Fischer, M., Ekenel, H.K., Stiefelhagen, R.: ‘Multi-pose face recognition for person retrieval in camera networks’. Proc. Seventh IEEE Int. Conf. Advanced Video and Signal Based Surveillance, Boston, USA, September 2010, pp. 441447.
    63. 63)
      • 74. De Oliveira, I.O., De Souza Pio, J.L.: ‘People re-identification in a camera network’. Proc. Eighth Int. Conf. Dependable, Autonomic and Secure Computing (DASC), Chengdu, China, December 2009, pp. 461466.
    64. 64)
      • 104. Wang, J., Zucker, J.D.: ‘Solving the multiple-instance problem: a lazy learning approach’. Proc. Int. Conf. Machine Learning, CA, USA, February 2000, pp. 11191125.
    65. 65)
    66. 66)
      • 88. Sun, J., Zhang, W., Tang, X., Shum, H.Y.: ‘Back- ground cut’. Proc. Ninth European Conf. Computer Vision (ECCV), Graz, Austria, May 2006, pp. 628641.
    67. 67)
      • 66. Bhattacharyya, A.: ‘On a measure of divergence between two statistical populations defined by their probability distribution’, Bull. Calcutta Math. Soc., 1943, 35, pp. 99110.
    68. 68)
      • 3. Hamdoun, O., Moutarde, F., Stanciulescu, B., Steux, B.: ‘Person re-identification in multi-camera system by signature based on interest point descriptors collected on short video sequences’. Proc. IEEE Conf. Distributed Smart Cameras, CA, USA, September 2008, pp. 16.
    69. 69)
      • 75. Bak, S., Corvee, E., Bremond, F., Thonnat, M.: ‘Multiple-shot human re-identification by mean Riemannian covariance grid’. Proc. IEEE Int. Conf. Advanced Video and Signal-based Surveillance, Klagenfurt, Austria, September 2011, pp. 179184.
    70. 70)
    71. 71)
      • 102. Wang, S., Lewandowski, M.: ‘Re-identification of pedestrians with variable occlusion and scale’. Proc. IEEE Int. Conf. Computer Vision Workshops (ICCV Workshops), Barcelona, Spain, November 2011, pp. 18761882.
    72. 72)
      • 26. Siebler, C., Bernardin, K., Stiefelhagen, R.: ‘Adaptive color transformation for person re-identification in camera networks’. Proc. IEEE Int. Conf. Distributed Smart Cameras (ICDSC), Atlanta, USA, September 2010, pp. 199205.
    73. 73)
      • 33. Annesley, J., Orwell, J., Renno, J.P.: ‘Evaluation of MPEG7 color descriptors for visual surveillance retrieval’. Proc. Second Joint IEEE Int. Workshop on VS-PETS, Beijing, China, October 2005, pp. 105112.
    74. 74)
      • 39. Jojic, N., Perina, A., Cristani, M., Murino, V., Frey, B.: ‘Stel component analysis: modeling spatial correlations in image class structure’. Proc. Conf. Computer Vision and Pattern Recognition (CVPR), Miami, USA, June 2009, pp. 20442051.
    75. 75)
      • 43. Bak, S., Corvee, E., Brémond, F., Thonnat, M.: ‘Person re-identification using spatial covariance regions of human body parts’. Proc. Seventh IEEE Int. Conf. Advanced Video and Signal Based Surveillance, Boston, USA, September 2010, pp. 435440.
    76. 76)
      • 23. Saghafi, M.A., Hussain, A., Saad, H., Tahir, N., Zaman, H.B., Hannan, M.: ‘Appearance-based methods in re-identification: a brief review’. Proc. IEEE Eighth Int. Colloquium on Signal Processing and its Applications, Melaka, Malaysia, March 2012, pp. 404408.
    77. 77)
      • 97. Office, U.H.: ‘i-LIDS multiple camera tracking scenario definition’. Available at http://www.homeoffice.gov.uk/science-research/hosdb/i-lids/, 2008.
    78. 78)
      • 58. Hamdoun, O., Moutarde, F., Stanciulescu, B., Steux, B.: ‘Interest points harvesting in video sequences for efficient person identification’. Proc. Eighth Int. Workshop on Visual Surveillance, Marseille, France, October 2008.
    79. 79)
      • 8. Chang, T., Gong, S.: ‘Tracking multiple people with a multi-camera system’. Proc. IEEE Workshop on Multi-Object Tracking, Vancouver, Canada, July 2001, pp. 1926.
    80. 80)
      • 44. Bouchrika, I., Carter, J.N., Nixon, M.S.: ‘Recognizing people in non-intersecting camera views’. Proc. Third Int. Conf. Imaging for Crime Detection and Prevention (ICDP), London, UK, December 2009, pp. 44P44.
    81. 81)
      • 81. Schmid, C.: ‘Constructing models for content-based image retrieval’. Proc. IEEE Conf. Computer Society on Computer Vision and Pattern Recognition, HI, USA, December 2001, pp. 1139.
    82. 82)
    83. 83)
      • 105. Layne, R., Hospedales, T., Gong, Sh.: ‘Person re-identification by attributes’. Proc British Machine Vision Conf. (BMVC), 2012, vol. 2, p. 3.
    84. 84)
      • 96. Mignon, A., Jurie, F.: ‘PCCA: a new approach for distance learning from sparse pairwise constraints’. Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), Island, June 2012, pp. 26662672.
    85. 85)
    86. 86)
      • 42. Dalal, N., Triggs, B.: ‘Histograms of oriented gradients for human detection’. Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CPVR), CA., USA, June 2005, pp. 886893.
    87. 87)
      • 48. Corvee, E., Bak, S., Bremond, F.: ‘People detection and re-identification for multi surveillance cameras’. Proc. VISAPP Int. Conf. Computer Vision Theory and Applications, Rome, Italy, February 2012, pp. 8288.
    88. 88)
    89. 89)
      • 36. Huang, C., Wu, Y., Shih, M.: ‘Unsupervised pedestrian re-identification’. Advances in Image and Video Technology, Springer Berlin Heidelberg, 2009, pp. 771783.
    90. 90)
    91. 91)
      • 32. Kawai, R., Makihara, Y., Hua, C., Iwama, H., Yagi, Y.: ‘Person re-identification using view-dependent score-level fusion of gait and color features’. Proc. 21th Int. Conf. Pattern Recognition (ICPR), Tsukuba Science City, Japan, 2012, pp. 26942697.
    92. 92)
      • 34. Stauffer, C., Grimson, W.E.L.: ‘Adaptive background mixture models for real-time tracking’. Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 1999, vol. 2, no. C, pp. 246252.
    93. 93)
      • 103. Yang, H., Moody, J.: ‘Feature selection based on joint mutual information’. Proc. Int. ICSC Symp. Advances in Intelligent Data Analysis, NY, USA, June 1999, pp. 2225.
    94. 94)
      • 55. Aziz, K.E., Merad, D., Fertil, B.: ‘People re-identification across multiple non-overlapping cameras system by appearance classification and silhouette part segmentation’. Proc. Eighth IEEE Int. Conf. Advanced Video and Signal Based Surveillance (AVSS), Klagenfurt, Austria, September 2011, pp. 303308.
    95. 95)
      • 73. Bay, H., Tuytelaars, T., Gool, L.V.: ‘SURF: speeded up robust features’. Proc. Ninth European Conf. Computer Vision (ECCV'2006), 2006, Springer (LNCS3951), part 1, pp. 404417.
    96. 96)
      • 38. Xiang, J.: ‘Active learning for person re-identification’. Proc. Int. Conf. Machine Learning and Cybernetics (ICMLC), Xian, China, July 2012, pp. 336340.
    97. 97)
      • 62. Hirzer, M., Roth, P.M., Bischof, H.: ‘Person re-identification by efficient impostor-based metric learning’. Proc. Ninth Int. Conf. Advanced Video and Signal-based Surveillance, Beijing, China, September 2012, pp. 203208.
    98. 98)
      • 13. Schwartz, W., Davis, L.: ‘Learning discriminative appearance-based models using partial least squares’. Proc. XXII Brazilian Symp. Graphics and Image Processing (SIBGRAPI), Rio de Janeiro, Brazil, October 2009, pp. 322329.
    99. 99)
      • 56. Javed, O., Rasheed, Z., Alatas, O., Shah, M.: ‘KNIGHT™: a real time surveillance system for multiple and non-overlapping cameras’. Proc. Int. Conf. Multimedia and Expo (ICME'03), Baltimore, USA, July 2003, pp. I-649652.
    100. 100)
      • 18. Tuzel, O., Porikli, F., Meer, P.: ‘Region covariance: a fast descriptor for detection and classification’. Proc. Ninth European Conf. Computer Vision, Graz, Austria, May 2006, pp. 589600.
    101. 101)
      • 11. Gheissari, N., Sebastian, T.B., Tu, P.H., Rittscher, J., Hartley, R.: ‘Person re-identification using spatiotemporal appearance’. Proc. Conf. Computer Vision and Pattern Recognition CVPR, New York, USA, June 2006, pp. 15281535.
    102. 102)
      • 4. ‘word spy’. Available at http://www.wordspy.com/words/re-identification.asp.
    103. 103)
      • 65. Swain, M.J., Ballard, D.H.: ‘Indexing via color histograms’. Active Perception and Robot Vision, 1992, pp. 261273.
    104. 104)
      • 63. D'angelo, A., Dugelay, J.L.: ‘People re-identification in camera networks based on probabilistic color histograms’. Proc. Electronic Imaging Conf. 3D Image Processing (3DIP) and Applications, CA, USA, January 2011, pp. 2327.
    105. 105)
    106. 106)
      • 98. Ess, A., Leibe, B., Gool, L.V.: ‘Depth and appearance for mobile scene analysis’. Proc. IEEE 11th Int. Conf. Computer Vision, Rio De Janeiro, Brazil, October 2007, pp. 18.
    107. 107)
      • 95. Du, Y., Ai, H., Lao, S.: ‘Evaluation of color spaces for person re-identification’. Proc. Int. Conf. Pattern Recognition (ICPR), Tsukuba Science City, Japan, November 2012, pp. 13711374.
    108. 108)
      • 77. Wang, X., Doretto, G., Sebastian, T., Rittscher, J., Tu, P.: ‘Shape and appearance context modeling’. Proc. IEEE 11th Int. Conf. Computer Vision, Rio de Janeiro, Brazil, October 2007, pp. 18.
    109. 109)
      • 12. Gray, D., Tao, H.: ‘Viewpoint invariant pedestrian recognition with an ensemble of localized features’. Proc. 10th European Conf. Computer Vision (ECCV), Marseille, France, October 2008, pp. 262275.
    110. 110)
      • 6. Park, U., Jain, A.K., Kitahara, I., Kogure, K., Hagita, N.: ‘ViSE: visual search engine using multiple networked cameras’. Proc. 18th Int. Conf. Pattern Recognition, Hong Kong, China, August 2006, pp. 12041207.
    111. 111)
      • 76. Metzler, J.: ‘Appearance-based re-identification of humans in low-resolution videos using means of covariance descriptors’. Proc. Ninth Int. Conf. Advanced Video and Signal-based Surveillance, Beijing, China, September 2012, pp. 191196.
    112. 112)
      • 46. Simonnet, D., Lewandowski, M.: ‘Re-identification of pedestrians in crowds using dynamic time warping’. Computer Vision ECCV Workshops and Demonstrations, Springer Berlin, Heidelberg, 2012, pp. 423432.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2013.0180
Loading

Related content

content/journals/10.1049/iet-cvi.2013.0180
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading