Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Joint prominent expression feature regions in auxiliary task learning network for facial expression recognition

The key issue for facial expression recognition (FER) is to concentrate on the prominent expression feature regions where the expression changes. In this Letter, the authors propose a novel and effective FER framework jointing prominent expression feature regions in an auxiliary task learning network (ATLN). The proposed approach consists of two deep learning neural networks, one of which is the main network whose inputs are complete face images, and the other is the auxiliary learning network whose inputs are pre-processed face images containing prominent expression feature regions. The main network structure of the ATLN improves its ability to focus on regions with prominent expressions changing by sharing parameters with their auxiliary network structure. They carry out experiments on two public facial expression databases, namely, CK+ and MMI. Experimental results demonstrate the superior performance of proposed method.

References

    1. 1)
      • 3. Zheng, W., Tang, H., Lin, Z., et al: ‘Emotion recognition from arbitrary view facial images’. European Conf. on Computer Vision (ECCV 2010), Heraklion, Crete, Greece, 2010, pp. 490503.
    2. 2)
      • 7. Zhang, C., Wang, P., Chen, K., et al: ‘Identity-aware convolutional neural networks for facial expression recognition’, J. Syst. Eng. Electron., 2017, 28, (4), pp. 784792.
    3. 3)
      • 10. Jung, H., Lee, S., Yim, J., et al: ‘Joint fine-tuning in deep neural networks for facial expression recognition’, 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, December 2015, pp. 29832991.
    4. 4)
      • 4. Yolcu, G., Oztel, I., Kazan, S., et al: ‘Deep learning-based facial expression recognition for monitoring neurological disorders’. IEEE Int. Conf. on Bioinformatics and Biomedicine (BIBM), Kansas City, MO, November 2017, pp. 16521657.
    5. 5)
      • 9. Li, S., Deng, D., Du, J.: ‘Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild’. IEEE Conf. on Computer Vision and Pattern Recognition, Honolulu, HI, USA, July 2017, pp. 25842593.
    6. 6)
    7. 7)
    8. 8)
      • 8. Cai, J., Meng, Z., Khan, A., et al: ‘Island loss for learning discriminative features in facial expression recognition’, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition, Xi'an, China, May 2018, pp. 302309.
    9. 9)
      • 11. Sikka, K., Sharma, G., Bartlett, M.: ‘LOMo: latent ordinal model for facial analysis in videos’. IEEE Conf. on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, June 2016, pp. 55805589.
    10. 10)
    11. 11)
      • 5. Mollahosseini, A., Chan, D., Mahoor, M.H.: ‘Going deeper in facial expression recognition using deep neural networks’. IEEE Winter Conf. on Applications of Computer Vision (WACV), Lake Placid, NY, USA, March 2016, pp. 110.
    12. 12)
      • 6. Liu, M., Shan, S., Wang, R., et al: ‘Learning expressionlets on spatio-temporal manifold for dynamic facial expression recognition’. IEEE Conf. on Computer Vision and Pattern Recognition, Columbus, OH, USA, June 2014, pp. 17491756.
http://iet.metastore.ingenta.com/content/journals/10.1049/el.2018.7235
Loading

Related content

content/journals/10.1049/el.2018.7235
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address