Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Study of automatic prediction of emotion from handwriting samples

© The Institution of Engineering and Technology
Received 17/06/2014, Accepted 22/12/2014, Published 08/04/2015

Handwriting biometrics has a long history, especially when the handwritten signature is the target, but it has also proved possible to use handwriting as a basis for the prediction of various non-unique but forensically useful characteristics of the writer, generally considered to be examples of so-called ‘soft biometrics’. Most commonly, these are characteristics such as the age or gender of the writer, but the predictive capabilities arising in handwriting offer wider opportunities for trait prediction. This study presents a preliminary investigation of the use of handwriting to predict information about the writer relating specifically to higher level characteristics such as emotional state. The authors present an initial study to demonstrate that this is possible, and explore a number of factors particularly relevant to the use of such a capability in areas of forensic investigation.

Inspec keywords: digital forensics; emotion recognition; handwriting recognition

Other keywords: soft biometrics; handwriting biometrics; forensic investigation; emotion prediction

Subjects: Computer vision and image processing techniques; Data security; Image recognition

References

    1. 1)
    2. 2)
      • 28. Fairhurst, M.C., Erbilek, M.: ‘Towards the development of user tools for knowledge acquisition in digital document analysis’, Steps Toward Digit. Agenda: Open Data Open Knowl., J. e-Learn. Knowl. Soc. (Je-LKS), 2014, 10, pp. 35–52.
    3. 3)
    4. 4)
      • 27. Furnkranz, J., Widmer, G.: ‘Incremental reduced error pruning’. Proc. 11th Int. Conf. on Machine Learning, ICML, New Brunswick NJ, 1994, pp. 70–77.
    5. 5)
      • 4. Fairhurst, M.C., Erbilek, M., Li, C.: ‘Enhancing the forensic value of handwriting using emotion prediction’. Second Int. Workshop on Biometrics and Forensics (IWBF), Valletta, Malta, 27–28 March 2014.
    6. 6)
      • 13. O'Reilly, C., Plamondon, R.: ‘Looking for the brain stroke signature’. 21st Int. Conf. on Pattern Recognition (ICPR), 2012, pp. 1811–1814.
    7. 7)
    8. 8)
      • 22. Erbilek, M., Fairhurst, M.C.: ‘Analysis of ageing effects in biometric systems: difficulties and limitations’, in Fairhurst, M.C. (Ed.): ‘Age factors in biometric processing’ (IET, 2013), pp. 279–301.
    9. 9)
      • 8. Shafran, I., Riley, M., Mohri, M.: ‘Voice signatures’. IEEE Workshop on Automatic Speech Recognition and Understanding, 2003. ASRU '03.2003, pp. 31–36.
    10. 10)
      • 12. Oliveira, L.S., Justino, E., Freitas, C., Sabourin, R.: ‘The graphology applied to signature verification’. 12th Conf. of the Int. Graphonomics Society, 2005, pp. 286–290.
    11. 11)
      • 1. Jain, A.K., Dass, S.C., Nandakumar, K.: ‘Soft biometric traits for personal recognition systems’. In ‘Biometric Authentication’, 2004 (LNCS, 3072), pp. 731–738.
    12. 12)
      • 3. Abreu, M.D.C., Fairhurst, M.C.: ‘Using age to enhance performance in biometrics’, in Fairhurst, M.C. (Ed.): ‘Age factors in biometric processing’ (IET, 2013).
    13. 13)
      • 5. Stathopoulou, I.O., Tsihrintzis, G.A.: ‘An improved neural-network-based face detection and facial expression classification system’. IEEE Int. Conf. on Systems, Man and Cybernetics, 2004, vol. 1, pp. 666–671.
    14. 14)
      • 24. Weka 3. http://www.cs.waikato.ac.nz/ml/weka/.
    15. 15)
    16. 16)
      • 2. Abreu, M., Fairhurst, M.C.: ‘Improving identity prediction in signature-based unimodal systems using soft biometrics’, in Fierrez, J., Ortega-Garcia, J., Esposito, A., Drygajlo, A., Faundez-Zanuy, M. (Eds.): ‘Biometric ID management and multimodal communication’ (Springer Berlin/Heidelberg, 2009), vol. 5707, pp. 348–356.
    17. 17)
      • 21. Erbilek, M., Fairhurst, M.C.: ‘A methodological framework for investigating age factors on the performance of biometric systems’. The 14th ACM Workshop on Multimedia and Security, Coventry, UK, 2012.
    18. 18)
      • 6. Xiaoxing, L., Mori, G., Hao, Z.: ‘Expression-invariant face recognition with expression classification’. The Third Canadian Conf. on Computer and Robot Vision, 2006, pp. 77–77.
    19. 19)
      • 14. Fairhurst, M.C., Hoque, S., Boyle, T.J.: ‘Assessing behavioural characteristics of dyspraxia through on-line drawing analaysis’. Proc. 12th Conf. Int. Graphonomics Society (IGS2005), Salerno, Italy, 2005.
    20. 20)
    21. 21)
      • 20. Lv, H.-R., Lin, Z.-L., Yin, W.-J., Dong, J.: ‘Emotion recognition based on pressure sensor keyboards’. IEEE Int. Conf. on Multimedia and Expo, 2008, pp. 1089–1092.
    22. 22)
      • 9. Kobayashi, Y.: ‘The EMOSIGN – analyzing the emotion signature in human motion’. IEEE Int. Conf. on Systems, Man and Cybernetics, ISIC.2007, pp. 1171–1176.
    23. 23)
    24. 24)
    25. 25)
    26. 26)
      • 11. Mutalib, S., Ramli, R., Rahman, S.A., Yusoff, M., Mohamed, A.: ‘Towards emotional control recognition through handwriting using fuzzy inference’. Int. Symp. on Information Technology, 2008. ITSim 2008.2008, pp. 1–5.
    27. 27)
      • 10. Kolakowska, A.: ‘A review of emotion recognition methods based on keystroke dynamics and mouse movements’. The Sixth Int. Conf. on Human System Interaction (HSI), 2013, pp. 548–555.
    28. 28)
    29. 29)
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-bmt.2014.0097
Loading

Related content

content/journals/10.1049/iet-bmt.2014.0097
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
Print this page
This is a required field
Please enter a valid email address