Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Human pose estimation method based on single depth image

© The Institution of Engineering and Technology
Received 30/10/2017, Accepted 18/04/2018, Revised 01/04/2018, Published 26/04/2018

Many of current human pose estimation methods based on depth images require training stage. However, the training stage costs huge work on making samples. And many methods for human pose occlusion condition cannot work well. In this study, a novel approach to estimate human pose with a depth image called model-based recursive matching (MRM) is introduced. A human skeleton model with customised parameters is created based on T-pose to fit different body types. The authors use depth image and 3D point cloud corresponding to input. In contrast to previous work, the proposed method avoids training step and can give an accurate estimation in the case of the human occlusion condition. They demonstrate the method by comparing to the method Kinect offered by using random forest on 20 human poses. And the ground truth of coordinates of pose joint is made by the motion capture system. The result shows that the proposed method not only works well on the general human pose but also can deal with human occlusion better. And the authors’ method can be also applied to the disabled people and other creatures.

Inspec keywords: image matching; image motion analysis; pose estimation

Other keywords: single depth image; T-pose; model-based recursive matching; 3D point cloud; Kinect method; training stage; pose joint; human pose estimation method; human skeleton model; MRM; motion capture system; human pose occlusion condition

Subjects: Image recognition; Computer vision and image processing techniques

References

    1. 1)
      • 4. Holte, M.B., Moeslund, T.B., Fihl, P.: ‘Fusion of range and intensity information for view invariant gesture recognition’. Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008, pp. 1–7.
    2. 2)
      • 6. Zuffi, S., Freifeld, O., Black, M.J.: ‘From pictorial structures to deformable structures’. IEEE Conf. Computer Vision and Pattern Recognition, Providence, RI, USA, 2012, pp. 3546–3553.
    3. 3)
      • 22. Xia, L., Chen, C., Aggarwal, J.K.: ‘View invariant human action recognition using histograms of 3D joints’. Computer Vision and Pattern Recognition, Providence, RI, USA, 2012, pp. 20–27.
    4. 4)
      • 17. Zuffi, S., Black, M.J.: ‘The stitched puppet: a graphical model of 3D human shape and pose’. Computer Vision and Pattern Recognition, Boston, MA, USA, 2015, pp. 3537–3546.
    5. 5)
      • 2. Bregler, C., Malik, J.: ‘Tracking people with twists and exponential maps’. Computer Vision and Pattern Recognition, Santa Barbara, CA, USA, 1998, pp. 8–15.
    6. 6)
      • 7. Shen, W., Zhao, K., Jiang, Y., et al: ‘Object skeleton extraction in natural images by fusing scale-associated deep side outputs’. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 2016, pp. 222–230.
    7. 7)
      • 20. Reyes, M., Dominguez, G., Escalera, S.: ‘Feature weighting in dynamic timewarping for gesture recognition in depth data’. Int. Conf. Computer Vision, Barcelona, Spain, 2011, pp. 1182–1188.
    8. 8)
      • 12. Siddiqui, M., Medioni, G.G.: ‘Human pose estimation from a single view point, real-time range sensor’. Computer Vision and Pattern Recognition, San Francisco, CA, USA, 2010, pp. 1–8.
    9. 9)
      • 1. Sarafianos, N., Boteanu, B., Ionescu, B., et al: ‘3D human pose estimation: a review of the literature and analysis of covariates’, Comput. Vis. Image Underst., 2016, 152, pp. 1–20.
    10. 10)
      • 24. Okada, R., Shirai, Y., Miura, J., et al: ‘Tracking a person with 3D motion by integrating optical flow and depth’, Syst. Comput. Jpn., 2001, 32, (7), pp. 29–38.
    11. 11)
      • 14. Shotton, J., Sharp, T., Kipman, A.A., et al: ‘Real-time human pose recognition in parts from single depth images’, Commun. ACM, 2013, 56, (1), pp. 116–124.
    12. 12)
      • 13. Anguelov, D., Taskarf, B., Chatalbashev, V., et al: ‘Discriminative learning of Markov random fields for segmentation of 3D scan data’. Computer Vision and Pattern Recognition, San Diego, CA, USA, 2005, pp. 169–176.
    13. 13)
      • 21. Zhu, Y., Dariush, B., Fujimura, K.: ‘Controlled human pose estimation from depth image streams’. Computer Vision and Pattern Recognition, Anchorage, AK, USA, 2008, pp. 1–8.
    14. 14)
      • 25. Handrich, S., Al-Hamadi, A.: ‘Full-body human pose estimation by combining geodesic distances and 3D-point cloud Registration’ (Springer International Publishing, New York, NY, USA, 2015).
    15. 15)
      • 19. Grest, D., Woetzel, J., Koch, R.: ‘Nonlinear body pose estimation from depth images’, Lect. Notes Comput. Sci., 2005, 3663, pp. 285–292.
    16. 16)
      • 15. Holt, B., Ong, E., Cooper, H., et al: ‘Putting the pieces together: connected poselets for human pose estimation’. Int. Conf. Computer Vision, Barcelona, Spain, 2011, pp. 1196–1201.
    17. 17)
      • 3. Shakhnarovich, G., Viola, P., Darrell, T.: ‘Fast pose estimation with parameter-sensitive hashing’. Int. Conf. Computer Vision, Nice, France, 2003, pp. 750–757.
    18. 18)
      • 23. Schwarz, L.A., Mkhitaryan, A., Mateus, D., et al: ‘Human skeleton tracking from depth data using geodesic distances and optical flow’, Image Vis. Comput., 2012, 30, (3), pp. 217–226.
    19. 19)
      • 9. Moeslund, T.B., Hilton, A., Kruger, V.: ‘A survey of advances in vision-based human motion capture and analysis’, Comput. Vis. Image Underst., 2006, 104, (2), pp. 90–126.
    20. 20)
      • 10. Poppe, R.: ‘Vision-based human motion analysis: an overview’, Comput. Vis. Image Underst., 2007, 108, (1), pp. 4–18.
    21. 21)
      • 5. Yang, Y., Ramanan, D.: ‘Articulated pose estimation with flexible mixtures-of-parts’. Computer Vision and Pattern Recognition, Providence, RI, USA, 2011, pp. 1385–1392.
    22. 22)
      • 11. Chen, L., Wei, H., Ferryman, J.M.: ‘A survey of human motion analysis using depth imagery’, Pattern Recognit. Lett., 2013, 34, (15), pp. 1995–2006.
    23. 23)
      • 18. Nishi, K., Miura, J.: ‘Generation of human depth images with body part labels for complex human pose recognition’, Pattern Recognit., 2017, 71, pp. 402–413.
    24. 24)
      • 16. Pons-Moll, G., Taylor, J., Shotton, J., et al: ‘Metric regression forests for correspondence estimation’, Int. J. Comput. Vis., 2015, 113, (3), pp. 163–175.
    25. 25)
      • 8. Pavlakos, G., Zhou, X., Derpanis, K.G., et al: ‘Harvesting multiple views for marker-less 3D human pose annotations’. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 2017.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cvi.2017.0536
Loading

Related content

content/journals/10.1049/iet-cvi.2017.0536
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address