Over the years, open education in online environments, such as Massive Online Open Courses, has grown rapidly. While the trend is expected to bridge the educational gap among students, the new environment has also created new challenges such as the lack of feedback and difficulties in interaction. The authors propose an automated engagement recognition system to alleviate this problem, driven by the recent developments in computer vision and artificial neural networks. The authors' proposed system extracts deep features from a facial image and employs a combination of multiple regularised shallow networks to recognise engagement. They verified the system in a public data set. The proposed system has faster learning speed and better accuracy than single deep network based approaches do.

References

1. 1)
  - 1. Rai, L., Chunrao, D.: ‘Influencing factors of success and failure in MOOC and general analysis of learner behavior’, Int. J. Inf. Educ. Technol., 2016, 6, (4), p. 262.
2. 2)
  - 2. Martin, F., Bolliger, D.U.: ‘Engagement matters: student perceptions on the importance of engagement strategies in the online learning environment’, Online Learn., 2018, 22, (1), pp. 205–222 (doi: 10.24059/olj.v22i1.1092).
3. 3)
  - 3. Rich, C., Ponsler, B., Holroyd, A., et al: ‘Recognizing engagement in human-robot interaction’. 2010 5th ACM/IEEE Int. Conf. on Human–Robot Interaction (HRI), Osaka, Japan, March 2010, pp. 375–382.
4. 4)
  - 7. Parkhi, O.M., Vedaldi, A., Zisserman, A.: ‘Deep face recognition’. BMVC, Swansea, UK, September 2015, pp. 1–12.
5. 5)
  - 6. Whitehill, J., Serpell, Z., Lin, Y.-C., et al: ‘The faces of engagement: automatic recognition of student engagement from facial expressions’, Trans. Affective Comput., 2014, 5, (1), pp. 86–98 (doi: 10.1109/TAFFC.2014.2316163).
6. 6)
  - 4. Hernandez, J., Liu, Z., Hulten, G., et al: ‘Measuring the engagement level of TV viewers’. 2013 10th IEEE Int. Conf. and Workshops on Automatic Face and Gesture Recognition (FG), Shanghai, China, April 2013, pp. 1–7.
7. 7)
  - 9. Peng, Y., Wang, S., Long, X., et al: ‘Discriminative graph regularized extreme learning machine and its application to face recognition’, Neurocomputing, 2015, 149, pp. 340–353 (doi: 10.1016/j.neucom.2013.12.065).
8. 8)
  - [20]. Zhang, K., Zhang, Z., Li, Z., et al: ‘Joint face detection and alignment using multitask cascaded convolutional networks’, IEEE Signal Process. Lett., 2016, 23, (10), pp. 1499–1503 (doi: 10.1109/LSP.2016.2603342).
9. 9)
  - 8. Rosenfeld, A., Tsotsos, J.K.: ‘Intriguing properties of randomly weighted networks: generalizing while learning next to nothing’. 2019 16th Conf. on Computer and Robot Vision (CRV), Kingston, QC, Canada, May 2019, pp. 9–16.
10. 10)
  - 34. Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: ‘Extreme learning machine: theory and applications’, Neurocomputing, 2006, 70, (1), pp. 489–501 (doi: 10.1016/j.neucom.2005.12.126).
11. 11)
  - 10. Gupta, A., D'Cunha, A., Awasthi, K., et al: ‘Daisee: towards user engagement recognition in the wild’. 2016, arXiv preprint arXiv:1609.01885, pp. 1–12.
12. 12)
  - 5. Kamath, A., Biswas, A., Balasubramanian, V.: ‘A crowdsourced approach to student engagement recognition in e-learning environments’. 2016 IEEE Winter Conf. on Applications of Computer Vision (WACV), Lake Placid, NY, USA, March 2016, pp. 1–9.

Deep feature based efficient regularised ensemble for engagement recognition

References

Related content