Hand gestures are a natural way of communication among humans in everyday life. Presence of spatiotemporal variations and unwanted movements within a gesture called self co-articulation makes the segmentation a challenging task. The study reveals that the self co-articulation may be used as one of the feature to enhance the performance of hand gesture recognition system. It was detected from the gesture trajectory by addition of speed information along with the pause in the gesture spotting phase. Moreover, a new set of novel features in the feature extraction stage was used such as position of the hand, self co-articulated features, ratio and distance features. The ANN and SVM were used to develop two independent models using new set of features as input. The models based on CRF and HCRF was used to develop the baseline system for the present study. The experimental results suggest that the proposed new set of features provides improvement in terms of accuracy using ANN (7.48%) and SVM (9.38%) based models as compared with baseline CRF based model. There are also significant improvements in the performances of both ANN (2.08%) and SVM (3.98%) based models as compared with HCRF based model.

References

1. 1)
  - 20. Huang, D.Y., Hu, W.C., Chang, S.H.: ‘Gabor filter-based hand-pose angle estimation for hand gesture recognition under varying illumination’, Expert Syst. Appl., 2011, 38, (5), pp. 6031–6042 (doi: 10.1016/j.eswa.2010.11.016).
2. 2)
  - 5. Chen, F.S., Fu, C.M., Huang, C.L.: ‘Hand gesture recognition using a real-time tracking method and hidden Markov models’, Image Vis. Comput., 2003, 21, (8), pp. 745–758 (doi: 10.1016/S0262-8856(03)00070-2).
3. 3)
  - 6. Oka, K., Sato, Y., Koike, H.: ‘Real-time fingertip tracking and gesture recognition’, IEEE Comput. Graph. Appl., 2002, 22, (6), pp. 64–71 (doi: 10.1109/MCG.2002.1046630).
4. 4)
  - 16. Elmezain, M., Al-Hamadi, A., Michaelis, B.: ‘Hand gesture recognition based on combined feature extraction’, World Acad. Sci. Eng. Technol., 2009, 3, (12), pp. 822–827.
5. 5)
  - 2. Dardas, N.H., Georganas, N.D.: ‘Real time hand gesture detection and recognition using bag-of-features and support vector machine techniques’, IEEE Trans. Instrum. Meas., 2011, 60, (11), pp. 3592–3607 (doi: 10.1109/TIM.2011.2161140).
6. 6)
  - 8. Ren, Z., Meng, J., Yuan, J.: ‘Depth camera based hand gesture recognition and its applications in human–computer-interaction’. Proc. Eighth Int. Conf. on Information, Communications and Signal Processing, 2011, pp. 1–5.
7. 7)
  - 14. Quattoni, A., Wang, S., Morency, L.P., et al: ‘Hidden conditional random fields’, IEEE Trans. Pattern Anal. Mach. Intell., 2007, 29, (10), pp. 1848–1852 (doi: 10.1109/TPAMI.2007.1124).
8. 8)
  - 19. Haykin, S.: ‘Neural networks: a comprehensive foundation’ (Prentice-Hall Inc., NJ, 1999).
9. 9)
  - 3. Kim, I.C., Chien, S.I.: ‘Analysis of 3D hand trajectory gestures using stroke based composite hidden Markov models’, Appl. Intell., 2001, 15, (2), pp. 131–143 (doi: 10.1023/A:1011231305559).
10. 10)
  - 16. Chang, C.-C., Lin, C.-J.: ‘LIBSVM: a library for support vector machines’, ACM Trans. Intell. Syst. Technol. (TIST), 2011, 2, (3), pp. 1–27 (doi: 10.1145/1961189.1961199).
11. 11)
  - 15. Troglio, G., Benediktsson, J.A., Moser, G., et al: ‘Unsupervised change detection in multitemporal images of the human retina’, Multi Modality State-of-the-Art Med. Image Segmentation Registration Methodol. Springer US, 2011, 1, pp. 309–337 (doi: 10.1007/978-1-4419-8195-0_11).
12. 12)
  - 7. Liu, X., Fujimura, K.: ‘Hand gesture recognition using depth data’. Proc. Sixth IEEE Int. Conf. on Automatic Face and Gesture Recognition, 2004, pp. 529–534.
13. 13)
  - 4. Mistry, P., Maes, P., Chang, L.: ‘WUW-wear Ur world: a wearable gestural interface’, Proc. ACM CHI'09 Ext. Abstr. Hum. Factors Comput. Syst., 2009, pp. 4111–4116.
14. 14)
  - 10. Bhuyan, M.K., Kumar, D.A., MacDorman, K.F., et al: ‘A novel set of features for continuous hand gesture recognition’, J. Multimodal User Interfaces, 2014, 8, (4), pp. 333–343 (doi: 10.1007/s12193-014-0165-0).
15. 15)
  - 1. Bhuyan, M.K., Bora, P.K., Ghosh, D.: ‘Trajectory guided recognition of hand gestures having only global motions’, World Acad. Sci. Eng. Technol., 2008, 2, (9), pp. 753–764.
16. 16)
  - 13. Kao, C.Y., Fahn, C.S.: ‘A human-machine interaction technique: H and gesture recognition based on hidden Markov models with trajectory of hand motion’, Procedia Eng., 2011, 15, pp. 3739–3743 (doi: 10.1016/j.proeng.2011.08.700).
17. 17)
  - 11. Xu, D., Wu, X., Chen, Y.L., et al: ‘Online dynamic gesture recognition for human robot interaction’, J. Intell. Robot. Syst., 2015, 77, (3–4), pp. 583–596 (doi: 10.1007/s10846-014-0039-4).
18. 18)
  - 21. Hearst, M.A., Dumais, S.T., Osman, E., et al: ‘Support vector machines’, IEEE Intell. Syst. Appl., 1998, 13, (4), pp. 18–28 (doi: 10.1109/5254.708428).
19. 19)
  - 22. Vapnik, V.N.: ‘Statistical learning theory’ (John Wiley & Sons, New York, 1998), pp. 423–424.
20. 20)
  - 24. Hsu, C.W., Lin, C.J.: ‘A comparison of methods for multiclass support vector machines’, IEEE Trans. Neural Netw., 2002, 13, (2), pp. 415–425 (doi: 10.1109/72.991427).
21. 21)
  - 12. Lin, J., Ding, Y.: ‘A temporal hand gesture recognition system based on hog and motion trajectory’, Optik, 2013, 124, (24), pp. 6795–6798 (doi: 10.1016/j.ijleo.2013.05.097).
22. 22)
  - 17. Zaki, M.M., Shaheen, I.S.: ‘Sign language recognition using a combination of new vision- based features’, Pattern Recognit. Lett., 2011, 32, (4), pp. 572–577 (doi: 10.1016/j.patrec.2010.11.013).
23. 23)
  - 18. Bhuyan, M.K., Ghosh, D., Bora, P.K.: ‘Feature extraction from 2D gesture trajectory in dynamic hand gesture recognition’. Proc. IEEE Conf. on Cybernetics and Intelligent Systems, 2006, pp. 1–6.
24. 24)
  - 9. Yoon, H.S., Soh, J., Bae, Y.J., et al: ‘Hand gesture recognition using combined features of location, angle and velocity’, Pattern Recognit., 2001, 34, (7), pp. 1491–1501 (doi: 10.1016/S0031-3203(00)00096-0).

Self co-articulation detection and trajectory guided recognition for dynamic hand gestures

References

Related content