Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Survey on real-time facial expression recognition techniques

Cameras constantly capture and track facial images and videos on cell phones, webcams etc. In the past decade, facial expression classification and recognition has been the topic of interest as facial expression analysis has a wide range of applications such as intelligent tutoring system, systems for psychological studies etc. This study reviews the latest advances in the algorithms and techniques used in distinct phases of real-time facial expression recognition. Though there are state-of-art approaches to address facial expression identification in real-time, many issues such as subjectivity-removal, occlusion, pose, low resolution, scale, variations in illumination level and identification of baseline frame still remain unaddressed. Attempts to deal with such issues for higher accuracy lead to a trade-off in efficiency. Furthermore, the goal of this study is to elaborate on these issues and highlight the solutions provided by the current approaches. This survey has helped the authors to understand that there is a need for a better strategy to address these issues without having to trade-off performance in real-time.

References

    1. 1)
      • 43. Vyas, A., Hablani, R.: ‘Effect of different occlusion on facial expressions recognition’, Int. J. Eng. Res. Appl., 2014, 4, (10) (Part-3), pp. 4044.
    2. 2)
      • 15. Punitha, A., Kalaiselvi Geetha, M.: ‘HMM BASED REAL TIME FER’, Int. J. Emerging Technol. Adv. Eng., 2013, 3, (1), An ISO 9001:2008 Certified Journal, pp. 180185.
    3. 3)
    4. 4)
    5. 5)
      • 35. Dhall, A., Goecke, R., Lucey, S., et al: ‘Static facial expression analysis in tough conditions: data, evaluation protocol and benchmark’. IEEE Int. Conf. Computer Vision Workshops (ICCV Workshops), Barcelona, November 2011, pp. 21062112.
    6. 6)
    7. 7)
      • 31. http://www.kasrl.org/jaffe.html.
    8. 8)
      • 19. Wilson, P.I., Fernandez, J.: ‘Facial feature detection using HAAR classifier’, Comput. Sci. Colleges, 2006, 21, (4), pp. 127133.
    9. 9)
    10. 10)
      • 25. Verma, D., Saini, L.K., Joshi, K.: ‘Performance analysis of feature extraction technique for facial expression recognition’, Int. J. Adv. Comput. Technol. (IJACT), 2013, 2, (4), pp. 1620.
    11. 11)
      • 18. Wu, T., Fu, S., Yang, G.: ‘Survey of the facial expression recognition research’. Int. Conf., BICS 2012, Shenyang, China, 11–14 July 2012, pp. 392402.
    12. 12)
      • 8. Happy, S.L., George, A., Routray, A.: ‘A real time facial expression classification system using local binary patterns’. Int. Conf. Intelligent Human Computer Interaction (IHCI), Kharagpur, December 2012, pp. 15.
    13. 13)
      • 21. Hassan, I., Maqbool, O., Ahsan, Q., et al: ‘Cascading neural network with AdaBoost for face detection’. Int. Conf. Applied Sciences & Technology, Islamabad, Pakistan, January 2010.
    14. 14)
      • 20. Ibraheem, N.A., Hasan, M.M., Khan, R.Z., et al: ‘Understanding color models: a review’, ARPN J. Sci. Technol., 2012, 2, (3), pp. 265275.
    15. 15)
      • 2. Alazrai, R., George Lee, C.: ‘Real-time emotion identification for socially intelligent robot’. Proc. Int. Conf. Robotics and Automation, USA, 14–18 May 2012.
    16. 16)
      • 42. Li, Y., Wang, C., Ao, X.: ‘Illumination processing in face recognition’.
    17. 17)
    18. 18)
      • 6. Mayer, C., Wimmer, M., Stulp, F., et al: ‘A real time system for model-based interpretation of the dynamics of facial expressions’. Int. Conf. Automatic Face & Gesture Recognition, Amsterdam, September 2008, pp. 12.
    19. 19)
      • 32. Michel, P., Kaliouby, R.E.: ‘Real-time facial expression recognition in video using support vector machines’. Int. Conf. on Multimodal Interfaces, Vancouver, Canada, 5–7 November 2003, pp. 258264.
    20. 20)
      • 14. Ghandi, B.M., Nagarajan, R., Desa, H.: ‘Particle swarm optimization algorithm for facial emotion detection’. IEEE Symp. on Industrial Electronics & Applications, 2009. ISIEA 2009, Malaysia, October 2009, pp. 595599.
    21. 21)
    22. 22)
      • 48. Abdat, F., Maaoui, C., Pruski, A.: ‘Real time facial feature points tracking with pyramidal Lucas–Kanade algorithm’. IEEE Symp. on Robot and Human Interactive Communication, Munich, August 2008, pp. 7176.
    23. 23)
      • 23. Ahn, B., Han, Y., Kweon, I.S.: ‘Real-time facial landmarks tracking using active shape model and LK optical flow’. Int. Conf. Ubiquitous Robots and Ambient Intelligence (URAI), Daejeon, November 2012, pp. 541543.
    24. 24)
      • 45. Li, H., Buenaposada, J.M., Baumela, L.: ‘Real-time facial expression recognition with illumination-corrected image sequences’. Int. Conf. Automatic Face & Gesture Recognition, Amsterdam, September 2008, pp. 16.
    25. 25)
    26. 26)
      • 5. Zhao-yi, P., Yan-hui, Z., Yu, Z.: ‘Real-time facial expression recognition based on adaptive canny operator edge detection’. Int. Conf. Multimedia and Information Technology (MMIT), Kaifeng, April 2010, pp. 154157.
    27. 27)
      • 11. Sung, J., Lee, S., Kim, D.: ‘Real-Time facial expression recognition using the STAAM’. Proc. Int. Conf. Pattern Recognition, Hong Kong, 2006, pp. 275278.
    28. 28)
      • 29. Bhattacharjee, D., Basu, D., Nasipuri, M., et al: ‘Reduction of feature vectors using rough set theory for human face recognition’. Int. Conf. Computational Science, Subject: Computer Vision and Pattern Recognition, EMORY University, Atlanta, USA, May 2005.
    29. 29)
      • 30. Zhang, S., Zhao, X., Lei, B.: ‘FER based on local binary patterns and local fisher discriminant analysis’, WSEAS Trans. Signal Process., 2012, 8, (1), pp. 2131.
    30. 30)
    31. 31)
      • 37. Pinto, S.C.D., Mena-Chalco, J.P., Lopes, F.M., et al: ‘3D facial expression analysis by using 2D and 3D wavelet transforms’. IEEE Int. Conf. Image Processing, Brussels, September 2011, pp. 12811284.
    32. 32)
      • 46. Baja, N., Happy, S.L., Routray, A.: ‘Dynamic model of FER based on eigen-face approach’. Int. Conf. Green Energy and Systems, Long Beach, CA, USA, November 2013, pp. 15.
    33. 33)
    34. 34)
      • 4. Lu, X.: ‘Image analysis for face recognition’, Personal Notes, May 2003, p. 36.
    35. 35)
      • 7. Zhao-yi, P., Zhi-qiang, W., Yu, Z.: ‘Application of mean shift algorithm in real-time facial expression recognition’. Int. Symp. Computer Network and Multimedia Technology, Wuhan, January 2009, pp. 14.
    36. 36)
      • 38. Soyel, H., Demirel, H.: ‘Facial expression recognition using 3D facial feature distances’. Int. Conf. Image Analysis and Recognition, Montreal, Canada, 22–24 August 2007, vol. 4633, pp. 831838.
    37. 37)
    38. 38)
    39. 39)
      • 16. Adeshina, A.M., Lau, S.-H., Loo, C.-K.: ‘Real-time FERs: a review’. Innovative Technologies in Intelligent Systems and Industrial Applications, CITISIA 2009, Monash, 25–26 July 2009, pp. 375378.
    40. 40)
      • 34. Liu, P., Han, S., Tong, Y.: ‘Improving facial expression analysis using histograms of log-transformed nonnegative sparse representation with a spatial pyramid structure’. IEEE Int. Conf. and Workshop Automatic Face and Gesture Recognition (FG), Shanghai, April 2013, pp. 17.
    41. 41)
      • 36. Gong, B., Wang, Y., Liu, J., et al: ‘Automatic facial expression recognition on a single 3D face by exploring shape deformation’. ACM Multimedia, 2009, pp. 569572.
    42. 42)
      • 28. Abdat, F., Maaoui, C., Pruski, A.: ‘Real time facial feature points tracking with pyramidal Lucas–Kanade algorithm’. IEEE Int. Symp. on Robot and Human Interactive Communication, Munich, August 2008, pp. 7176.
    43. 43)
    44. 44)
      • 33. Jeni, L.A., Takacs, D., Lorincz, A.: ‘High quality facial expression recognition in video streams using shape related information only’. IEEE Int. Conf. Computer Vision Workshops (ICCV Workshops), Barcelona, November 2011, pp. 21682174.
    45. 45)
      • 24. Ali, K.K.B., Atef, Z.G., Aliaa, A.A.Y.: ‘Automatic facial expression recognition based on hybrid approach’, Int. J. Adv. Comput. Sci. Appl., 2012, 3, (11), pp. 102107.
    46. 46)
      • 41. Rani, J., Garg, K.: ‘Implementation of emotion detection system using facial expressions’, Int. J. Sci. Res. Dev., 2014, 2, (4), pp. 348350.
    47. 47)
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-bmt.2014.0104
Loading

Related content

content/journals/10.1049/iet-bmt.2014.0104
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address