Study of automatic prediction of emotion from handwriting samples

Study of automatic prediction of emotion from handwriting samples

For access to this article, please select a purchase option:

Buy article PDF
(plus tax if applicable)
Buy Knowledge Pack
10 articles for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
IET Biometrics — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Handwriting biometrics has a long history, especially when the handwritten signature is the target, but it has also proved possible to use handwriting as a basis for the prediction of various non-unique but forensically useful characteristics of the writer, generally considered to be examples of so-called ‘soft biometrics’. Most commonly, these are characteristics such as the age or gender of the writer, but the predictive capabilities arising in handwriting offer wider opportunities for trait prediction. This study presents a preliminary investigation of the use of handwriting to predict information about the writer relating specifically to higher level characteristics such as emotional state. The authors present an initial study to demonstrate that this is possible, and explore a number of factors particularly relevant to the use of such a capability in areas of forensic investigation.


    1. 1)
      • 1. Jain, A.K., Dass, S.C., Nandakumar, K.: ‘Soft biometric traits for personal recognition systems’. In ‘Biometric Authentication’, 2004 (LNCS, 3072), pp. 731738.
    2. 2)
      • 2. Abreu, M., Fairhurst, M.C.: ‘Improving identity prediction in signature-based unimodal systems using soft biometrics’, in Fierrez, J., Ortega-Garcia, J., Esposito, A., Drygajlo, A., Faundez-Zanuy, M. (Eds.): ‘Biometric ID management and multimodal communication’ (Springer Berlin/Heidelberg, 2009), vol. 5707, pp. 348356.
    3. 3)
      • 3. Abreu, M.D.C., Fairhurst, M.C.: ‘Using age to enhance performance in biometrics’, in Fairhurst, M.C. (Ed.): ‘Age factors in biometric processing’ (IET, 2013).
    4. 4)
      • 4. Fairhurst, M.C., Erbilek, M., Li, C.: ‘Enhancing the forensic value of handwriting using emotion prediction’. Second Int. Workshop on Biometrics and Forensics (IWBF), Valletta, Malta, 27–28 March 2014.
    5. 5)
      • 5. Stathopoulou, I.O., Tsihrintzis, G.A.: ‘An improved neural-network-based face detection and facial expression classification system’. IEEE Int. Conf. on Systems, Man and Cybernetics, 2004, vol. 1, pp. 666671.
    6. 6)
      • 6. Xiaoxing, L., Mori, G., Hao, Z.: ‘Expression-invariant face recognition with expression classification’. The Third Canadian Conf. on Computer and Robot Vision, 2006, pp. 7777.
    7. 7)
    8. 8)
      • 8. Shafran, I., Riley, M., Mohri, M.: ‘Voice signatures’. IEEE Workshop on Automatic Speech Recognition and Understanding, 2003. ASRU '03.2003, pp. 3136.
    9. 9)
      • 9. Kobayashi, Y.: ‘The EMOSIGN – analyzing the emotion signature in human motion’. IEEE Int. Conf. on Systems, Man and Cybernetics, ISIC.2007, pp. 11711176.
    10. 10)
      • 10. Kolakowska, A.: ‘A review of emotion recognition methods based on keystroke dynamics and mouse movements’. The Sixth Int. Conf. on Human System Interaction (HSI), 2013, pp. 548555.
    11. 11)
      • 11. Mutalib, S., Ramli, R., Rahman, S.A., Yusoff, M., Mohamed, A.: ‘Towards emotional control recognition through handwriting using fuzzy inference’. Int. Symp. on Information Technology, 2008. ITSim 2008.2008, pp. 15.
    12. 12)
      • 12. Oliveira, L.S., Justino, E., Freitas, C., Sabourin, R.: ‘The graphology applied to signature verification’. 12th Conf. of the Int. Graphonomics Society, 2005, pp. 286290.
    13. 13)
      • 13. O'Reilly, C., Plamondon, R.: ‘Looking for the brain stroke signature’. 21st Int. Conf. on Pattern Recognition (ICPR), 2012, pp. 18111814.
    14. 14)
      • 14. Fairhurst, M.C., Hoque, S., Boyle, T.J.: ‘Assessing behavioural characteristics of dyspraxia through on-line drawing analaysis’. Proc. 12th Conf. Int. Graphonomics Society (IGS2005), Salerno, Italy, 2005.
    15. 15)
    16. 16)
    17. 17)
    18. 18)
    19. 19)
    20. 20)
      • 20. Lv, H.-R., Lin, Z.-L., Yin, W.-J., Dong, J.: ‘Emotion recognition based on pressure sensor keyboards’. IEEE Int. Conf. on Multimedia and Expo, 2008, pp. 10891092.
    21. 21)
      • 21. Erbilek, M., Fairhurst, M.C.: ‘A methodological framework for investigating age factors on the performance of biometric systems’. The 14th ACM Workshop on Multimedia and Security, Coventry, UK, 2012.
    22. 22)
      • 22. Erbilek, M., Fairhurst, M.C.: ‘Analysis of ageing effects in biometric systems: difficulties and limitations’, in Fairhurst, M.C. (Ed.): ‘Age factors in biometric processing’ (IET, 2013), pp. 279301.
    23. 23)
    24. 24)
      • 24. Weka 3.
    25. 25)
    26. 26)
    27. 27)
      • 27. Furnkranz, J., Widmer, G.: ‘Incremental reduced error pruning’. Proc. 11th Int. Conf. on Machine Learning, ICML, New Brunswick NJ, 1994, pp. 7077.
    28. 28)
      • 28. Fairhurst, M.C., Erbilek, M.: ‘Towards the development of user tools for knowledge acquisition in digital document analysis’, Steps Toward Digit. Agenda: Open Data Open Knowl., J. e-Learn. Knowl. Soc. (Je-LKS), 2014, 10, pp. 3552.
    29. 29)

Related content

This is a required field
Please enter a valid email address