Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

Face tracking and pose estimation with automatic three-dimensional model construction

Face tracking and pose estimation with automatic three-dimensional model construction

For access to this article, please select a purchase option:

Buy article PDF
£12.50
(plus tax if applicable)
Add to cart
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)
Add to cart

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Name:*
Email:*
Your details
Name:*
Email:*
Department:*
Why are you recommending this title?
Select reason:
 
 
 
 
 
IET Computer Vision — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

© The Institution of Engineering and Technology
Published

A method for robustly tracking and estimating the face pose of a person using stereo vision is presented. The method is invariant to identity and does not require previous training. A face model is automatically initialised and constructed online: a fixed point distribution is superposed over the face when it is frontal to the cameras, and several appropriate points close to those locations are chosen for tracking. Using the stereo correspondence of the cameras, the three-dimensional (3D) coordinates of these points are extracted, and the 3D model is created. The 2D projections of the model points are tracked separately on the left and right images using SMAT. RANSAC and POSIT are used for 3D pose estimation. Head rotations up to ±45° are correctly estimated. The approach runs in real time. The purpose of this method is to serve as the basis of a driver monitoring system, and has been tested on sequences recorded in a moving car.

Inspec keywords: cameras; stereo image processing; face recognition; pose estimation; visual perception; image sequences

Other keywords: image sequences; 3D pose estimation; car; automatic three-dimensional model construction; driver monitoring system; face tracking; cameras; stereo vision

Subjects: Image recognition; Computer vision and image processing techniques; Image recognition

References

    1. 1)
      • J. Buenaposada , E. Muñoz , L. Baumela . Recognising facial expressions in video sequences. Pattern Anal. Appl. , 1 , 101 - 116
    2. 2)
      • Gu, L., Kanade, T.: `3D Alignment of Face in a Single Image', Proc. 2006 IEEE Computer Society Conf. Computer Vision and Pattern Recognition, 2006, 1, p. 1305–1312.
    3. 3)
      • J. Nelder , R. Mead . A simplex method for function minimization. Comput. J. , 4 , 308 - 313
    4. 4)
      • Kapoor, A., Picard, R.: `Real-time, fully automatic upper facial feature tracking', Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE Int. Conf. on, 2002, p. 8–13.
    5. 5)
      • Liao, W., Medioni, G.: `3D face tracking and expression inference from a 2D sequence using manifold learning', Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on, 2008, p. 1–8.
    6. 6)
      • D.F. Dementhon , L.S. Davis . Model-based object pose in 25 lines of code. Int. J. Comput. Vision , 123 - 141
    7. 7)
      • T. Cootes , G. Wheeler , K. Walker , C. Taylor . View-based active appearance models. Image Vis. Comput. , 657 - 664
    8. 8)
      • E. Murphy-Chutorian , M. Trivedi . Head pose estimation in computer vision: a survey. IEEE Trans. Pattern Anal. Mach. Intell. , 4 , 607 - 626
    9. 9)
      • Morency, L., Sundberg, P., Darrell, T.: `Pose estimation using 3D view-based eigenspaces', Analysis and Modeling of Faces and Gestures, AMFG 2003. IEEE International Workshop on, 2003, p. 45–52.
    10. 10)
      • Dowson, R., Bowden, N.D.H.: `Simultaneous modeling and tracking (SMAT) of feature sets', IEEE Conf. Computer Vision and Pattern Recognition 2005, 2005, 2, p. 99–105.
    11. 11)
      • Pilet, J., Lepetit, V., Fua, P.: `Real-time non-rigid surface detection', IEEE Conf. Computer Vision and Pattern Recognition 2005, June 2005, San Diego, CA.
    12. 12)
      • Xiao, J., Baker, S., Matthews, I., Kanade, T.: `Real-time combined 2D+ 3D active appearance models', IEEE Conf. Computer Vision and Pattern Recognition 2004, 2004, 2, p. 535–542.
    13. 13)
      • Stiefelhagen, R., Yang, J., Waibel, : `Tracking eyes and monitoring eye gaze', Proceedings of PUI'97, 1997.
    14. 14)
      • T.F. Cootes , G.J. Edwards , C.J. Taylor . Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. , 681 - 685
    15. 15)
      • Breitenstein, M., Kuettel, D., Weise, T., van, Gool L., Pfister, H.: `Real-time face pose estimation from single range images', Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conf. on, June 2008, p. 1–8.
    16. 16)
      • Ozuysal, M., Fua, P., Lepetit, V.: `Fast keypoint recognition in ten lines of code', IEEE Conf. on Computer Vision and Pattern Recognition 2007, June 2007, Minneapolis, MI.
    17. 17)
      • A. Gee , R. Cipolla . Determining the gaze of faces in images. Image Vis Computing , 10 , 639 - 647
    18. 18)
      • Zhu, Z., Ji, Q.: `Robust real-time face pose and facial expression recovery', Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2006, p. 681–688.
    19. 19)
      • Murphy-Chutorian, E., Doshi, A., Trivedi, M.: `Head pose estimation for driver assistance systems: a robust algorithm and experimental evaluation', Proc. Intell. Transport. Syst. Conf. 2007, 2007, p. 709–714.
    20. 20)
      • P.N. Belhumeur , J.P. Hespanha , D.J. Kriegman . Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. , 7 , 711 - 720
    21. 21)
      • Yao, J., Cham, W.: `Efficient model-based linear head motion recovery from movies', Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition, 2004, 2.
    22. 22)
      • Cristinacce, D., Cootes, T.: `Feature detection and tracking with constrained local models', 17thBritish Machine Vision Conference, 2006, p. 929–938.
    23. 23)
      • Harris, C., Stephens, M.: `A combined corner and edge detector', Alvey Vision Conference, 1988, 15, p. 50.
    24. 24)
      • P. Viola , M. Jones . Robust real-time object detection. Int. J. Comput. Vision , 137 - 154
    25. 25)
      • V. Blanz , T. Vetter . Face recognition based on fitting a 3d morphable model. IEEE Trans. Pattern Anal. Mach. Intell. , 9 , 1063 - 1074
    26. 26)
      • Dornaika, F., Davoine, F.: `Head and facial animation tracking using appearance-adaptive models and particle filters', Computer Vision and Pattern Recognition Workshop, 2004 Conference on, 2004, p. 153–153.
    27. 27)
      • M. La Cascia , S. Sclaroff , V. Athitsos . Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3D models. IEEE Trans. Pattern Anal. Mach. Intell. , 322 - 336
    28. 28)
      • R. Senaratne , D. Hardy , B. Vanderaa , S. Halgamuge . (2007) Driver fatigue detection by fusing multiple cues, Lecture Notes in Computer Science.
    29. 29)
      • Zhu, Z., Ji, Q.: `Real time 3D face pose tracking from an uncalibrated camera', CVPR Workshop 2004, Conference on, 2004, p. 73–80.
    30. 30)
      • Jimenez, P., Nuevo, J., Bergasa, L.: `Face pose estimation and tracking using automatic 3D model construction', CVPR Workshops, 2008. IEEE Computer Society Conf. on, June 2008, p. 1–7.
    31. 31)
      • L.M. Bergasa , J. Nuevo , M.A. Sotelo , R. Barea , E. López . Real-time system for monitoring driver vigilance. IEEE Trans. Intell. Transp. Syst. , 1 , 1524 - 1538
    32. 32)
      • M.A. Fischler , R.C. Bolles . Random sample consensus: a paradigm formodel fitting with applications to image analysis and automated cartography. Commun. ACM , 6 , 381 - 395
    33. 33)
      • M. Yang , D. Kriegman , N. Ahuja . Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. , 1 , 34 - 58
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2008.0057
Loading

Related content

content/journals/10.1049/iet-cvi.2008.0057
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address