Your browser does not support JavaScript!

Mutual feedback scheme for face detection and tracking aimed at density estimation in demonstrations

Mutual feedback scheme for face detection and tracking aimed at density estimation in demonstrations

For access to this article, please select a purchase option:

Buy article PDF
(plus tax if applicable)
Buy Knowledge Pack
10 articles for $120.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
IEE Proceedings - Vision, Image and Signal Processing — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Crowded video sequences like those of demonstrations offer an interesting challenge for object detection and tracking owing to their complexity: taken outdoors, often in different illumination conditions, showing faces not in frontal view, with perspective effects, complex background, etc. Tracking of the individuals becomes a difficult task due to the high number of occlusions. This paper proposes a mutual feedback spatiotemporal detection strategy to tackle these problems. The system improves its efficiency thanks to a cooperative approach between spatial detection and temporal tracking. Spatial detection is based on skin colour classification and shape analysis by morphological tools. Temporal tracking is based on the analysis of the optical flow. The mutual feedback scheme benefits both spatial detection and temporal tracking. In order to deal with multiple occlusions, a graph-based tracking technique taking advantage of the neighbourhood consistency has been introduced.


    1. 1)
      • Wang, J.Y.A., Adelson, E.H.: `Spatio-temporal segmentation of video data', Proc. SPIE: Image and Video Processing, 1994, II, p. 2182.
    2. 2)
      • Marana, A.N., Costa, L.F., Lotufo, R.A., Velastin, S.A.: `On the efficacy of texture analysis for crowd monitoring', Proc. of Computer Graphics, Image Processing, and Vision, 1998, Rio de Janeiro, Brazil, p. 354–361.
    3. 3)
      • S.F. Lin , J.Y. Chen , H.X. Chao . Estimation of number of people in crowded scenes using perspective transformation. IEEE Trans. Syst. Man Cybern. A Syst. Humans , 6 , 645 - 654
    4. 4)
      • Yang, J., Weier, L., Waibel, A.: `Skin-color modeling and adaptation', Proc. ACCV'98, 1997, Technical Report CMU-CS-97-146, CS department, CMU.
    5. 5)
      • Lucas, B., Kanade, T.: `An iterative image registration technique with an application to stereo vision', Proc. 7th Int. Joint Conf. on Artificial Intelligence (IJCAI), 1981, p. 674–679.
    6. 6)
      • Oren, M., Papageorgiou, C., Sinha, P., Osuna, E., Poggio, T.: `Pedestrian detection using wavelet templates', Proc. of the IEEE Comp. Soc. Conf. Computer Vision and Pattern Recognition, 1997, p. 193–199.
    7. 7)
      • de Dios, J.J., García, N.: `Face detection base on a new color space YCgCr', Proc. of Int. Conf. on Image Processing (ICIP), September 2003, Barcelona, Spain.
    8. 8)
      • M.H. Yang , D.J. Kriegman , N. Ahuja . Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. , 1
    9. 9)
      • Barron, J.L., Fleet, D.J., Beauchemin, S.: `Performance of optical flow techniques', Proc. Int. Joint Conf. of Computer Vision, 1994, 121, p. 43–77.
    10. 10)
      • L. Vincent , P. Soille . Watersheds in digital spaces: an efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. , 6 , 583 - 598
    11. 11)
      • Gomila, C.: `Mise en correspondance de partitions en vue du suivi d'objets', 2001, PhD Thesis, École des Mines de Paris, One River Road, Carlisle MA.
    12. 12)
      • Rowley, H., Baluja, S., Kanade, T.: `Neural network-based face detection', Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition, 1996, San Francisco (California), p. 203–207.
    13. 13)
      • Phung, S.L., Bouzerdoum, A., Chai, D.: `A novel skin color model in YCbCr color space and its applications to human face detection', Proc. IEEE Int. Conf. on Image Processing, September 2002, Rochester, New York, USA.
    14. 14)
      • Regazzoni, S., Tesei, A., Murino, V.: `A real-time vision system for crowding monitoring', Proc. of the Int. Conf. on Industrial Electronics (IECON), 1993, 3, p. 1860–1864.
    15. 15)
      • Yang, M.H., Ahuja, N.: `Gaussian mixture model for human skin color and its application in image and video databases', Proc. SPIE, Conf. on Storage and Retrieval for Image and Video Databases (SPIE), 1999, 3656, San Jose, p. 458–466.
    16. 16)
      • Jones, M.J., Rehg, J.M.: `Statistical color models with application to skin detection', Technical report, 1998.
    17. 17)
      • Gu, L., Bone, D.: `Skin colour region detection in MPEG video sequences', Proc. of Int. Conf. on Image Analysis and Processing (ICIAP), September 1999, Venice, Italy.
    18. 18)
      • Simoncelli, E.P., Adelson, E.H., Heeger, D.J.: `Probability distributions of optical flow. computer vision and pattern recognition', Proc. IEEE Computer Society Con. Pattern Recognition CVPR, 3–6 June 1991.
    19. 19)
      • El-Feghali, R., Mitiche, A.: `Fast computation of a boundary preserving estimate of optical flow', Proc. British Machine Vision Conf., BMVC, September 2000, Bristol, UK.
    20. 20)
      • B.K.P. Horn , B.G. Schunck . Determining optical flow. Artif. Intell. , 185 - 204
    21. 21)
      • Yang, M.H., Ahuja, N.: `Detecting human faces in color images', Proc. Int. Conf. on Image Processing, 1998, 1, p. 127–130.
    22. 22)
      • Gomila, C., Meyer, F.: `Graph-based object tracking', Proc. Int. Conf. Image Processing (ICIP), September 2003, Barcelona, Spain.
    23. 23)
      • O.D. Trier , A.K. Jian . Goal-directed evaluation of binarization methods. IEEE Trans. Pattern Anal. Mach. Intell. , 12 , 1191 - 1201
    24. 24)
      • Caetano, T.S., Olabarriaga, S.D., Barone, D.A.C.: `Performance evaluation of single and multiple-gaussian models for skin color modeling', Proc. of the XV Brazilian Symp. on Computer Graphics and Image Processing (SIBGRAPI), 2002, Brazil.
    25. 25)
      • Calabi, L., Hartnett, W.: `Shape recognition, prairie fires, convex deficiencies and skeletons', Technical Report 1, 1966.
    26. 26)
      • L. Vincent . (1992) Mathematical morphology, Image processing.
    27. 27)
      • Terrillon, J., Shirazi, M.N., Fukamachi, H., Akamatsu, S.: `Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images', Fourth IEEE Int. Conf. on Automatic Face and Gesture Recognition, March 2000, Grenoble (France).
    28. 28)
      • Yang, J., Stiefelhagen, R., Meier, U., Waibel, A.: `Real-time face and facial feature tracking and applications', Proc. of AVSP, 1998, Terrigal, Australia, p. 79–84.

Related content

This is a required field
Please enter a valid email address