Your browser does not support JavaScript!
http://iet.metastore.ingenta.com
1887

access icon free Thermal image processing for real-time non-contact respiration rate monitoring

A real-time thermal imaging based, non-contact respiration rate monitoring method was developed. It measured the respiration related skin surface temperature changes under the tip of the nose. Facial tracking was required as head movements caused the face to appear in different locations in the recorded images over time. The algorithm detected the tip of the nose and then, a region just under it was selected. The pixel values in this region in successive images were processed to determine respiration rate. The segmentation method, used as part of the facial tracking, was evaluated on 55,000 thermal images recorded from 14 subjects with different extent of head movements. It separated the face from image background in all images. However, in 11.7% of the images, a section of the neck was also included, but this did not cause an error in determining respiration rate. The method was further evaluated on 15 adults, against two contact respiration rate monitoring methods that tracked thoracic and abdominal movements. The three methods gave close respiration rates in 12 subjects but in 3 subjects, where there were very large head movements, the respiration rates did not match.

References

    1. 1)
    2. 2)
      • 22. Viola, P., Jones, M.: ‘Rapid object detection using a boosted cascade of simple features’. Proc. Conf. on Computer and Pattern Recognition, 2001. Available at https://www.cs.cmu.edu/~efros/courses/LBMV07/Papers/viola-cvpr-01.pdf, last accessed 26/10/2015.
    3. 3)
      • 32. Shastri, D., Pavlidis, I.: ‘Automatic initiation of the periorbital signal extraction in thermal imagery’. Advanced Video and Signal Based Surveillance, IEEE Computer Society, IEE Explore, 2009, pp. 182186. Available at http://www.ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5280058, last accessed 12/04/2016.
    4. 4)
    5. 5)
    6. 6)
      • 3. Ambrogio, C., Parthasarathy, S.: ‘Polysomnography during critical illness’, J. Clin. Sleep Med., 2007, 3, (6), pp. 649650.
    7. 7)
    8. 8)
    9. 9)
    10. 10)
    11. 11)
    12. 12)
      • 24. Hanawa, D., Morimoto, T., Shimazaki, S., et al: ‘Nasal cavity detection in facial thermal image for non-contact measurement of breathing’, Int. J. Adv. Telecommun. Electrotechnics Signals Syst., 2013, 2, (1), pp. 3338.
    13. 13)
    14. 14)
    15. 15)
      • 21. Mostafa, E., Farag, A., Shalaby, A., et al: ‘Long term facial parts tracking in thermal imaging for uncooperative emotion recognition’. IEEE Xplore, 2013. Available at http://www.ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=6712739, last accessed 26/10/2015.
    16. 16)
    17. 17)
      • 13. Aoki, H., Takemura, Y., Mimura, K., et al: ‘Development of non-restrictive sensing system for sleeping person using fiber grating vision sensor’. 2001 Int. Symp. on Micromechatronics and Human Science, 2001, pp. 155160.
    18. 18)
      • 9. Greneker, E.F.: ‘Radar sensing of heartbeat and respiration at a distance with applications of the technology’. Radar 97 (Conf. Publ. no. 449), 1997, pp. 150154.
    19. 19)
      • 30. Murthy, J.N., van Jaarsveld, J., Fei, J., et al: ‘Thermal infraed imaging: a novel method to monitor airflow during polysomnography’, Sleep, 2009, 32, (11), pp. 15211527.
    20. 20)
    21. 21)
    22. 22)
      • 27. Fei, J., Zhu, Z., Pavlidis, I.: ‘Imaging breathing rate in the CO2 absorption band’. Proc. 27th Annual Conf of the IEEE Engineering in Medicine and Biology, 2005, pp. 700705.
    23. 23)
    24. 24)
    25. 25)
      • 25. AL-Khalidi, F.Q., Saatchi, R., Burke, D., et al: ‘Tracking human face features in thermal images for respiration monitoring’. 2010 IEEE/ACS Int. Conf. on Computer Systems and Applications, 2010, pp. 16.
    26. 26)
      • 17. Alkali, A.H., Saatchi, R., Elphick, H., et al: ‘Noncontact respiration rate monitoring based on sensing exhaled air’, Malaysian J. Fundam. Appl. Sci., 2013, 9, (3), pp. 129133.
    27. 27)
      • 26. Martinez, B., Binefa, X., Pantic, M.: ‘Facial component detection in thermal imagery’. 2010 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, 2010, pp. 4854.
    28. 28)
      • 8. Bartula, M., Tigges, T., Muehlsteff, J.: ‘Camera-based system for contactless monitoring of respiration’. Conf. Proc. IEEE Engineering in Medicine and Biology Society, 2013, pp. 26722675.
    29. 29)
      • 14. Tan, K.S., Saatchi, R., Elphick, H., et al: ‘Real-time vision based respiration monitoring system’. 2010 Int. Symp. on Communication Systems Networks and Digital Signal Processing, 2010, pp. 770774.
    30. 30)
    31. 31)
      • 31. Dowdall, J., Pavlidis, I.T., Tsiamyrtzis, P.: ‘Colitional tracking, computer vision and image understanding’ (Elsevier, 2007), vol. 106, pp. 205219.
    32. 32)
      • 12. Nakai, H., Ishihara, K., Miyake, Y., et al: ‘Non-restrictive visual respiration monitoring’. IEEE Xplore, 2000, pp. 647651. Available at http://www.ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=903001, last accessed 02/11/2015.
    33. 33)
    34. 34)
      • 23. Lienhart, R., Maydt, J.: ‘An extended set of Haar-like features for rapid object detection’. 2002. Available at http://www.lienhart.de/Prof._Dr._Rainer_Lienhart/Source_Code_files/ICIP2002.pdf, last accessed 26/10/2015.
    35. 35)
      • 6. Alkali, A.H., Saatchi, R., Elphick, H., et al: ‘Facial tracking in thermal images for real-time noncontact respiration rate monitoring’. 2013 European Modelling Symp., 2013, pp. 265270.
    36. 36)
    37. 37)
      • 35. Memarian, N., Chau, T., Venetsanopoulos, A.N.: ‘Application of infrared thermal imaging in rehabilitation engineering: preliminary results’. 2009 IEEE Toronto Int. Conf. in Science and Technology for Humanity, 2009, pp. 15.
    38. 38)
      • 39. Young, J.W.: ‘Head and face anthropometry of adult U.S. citizens’ (Office of Aviation Medicine, Washington DC 20591, 1993). Available at http://www.faa.gov/data_research/research/med_humanfacs/oamtechreports/1990s/media/am93-10.pdf, last accessed 26/10/2015.
    39. 39)
    40. 40)
      • 28. Lucas, D., Kanade, T.: ‘An iterative image registration technique with an application to stereo vision’. Proc. Seventh Int. Joint Conf. on Artificial Intelligence, 1981, pp. 674679. Available at https://www.ces.clemson.edu/~stb/klt/lucas_bruce_d_1981_1.pdf, last accessed 26/10/2016.
    41. 41)
      • 41. Murthy, R., Pavlidis, I., Tsiamyrtzis, P.: ‘Touchless monitoring of breathing function’. Twenty-Sixth Annual Int. Conf. of the IEEE in Engineering in Medicine and Biology Society, 2004, vol. 2, pp. 11961199.
http://iet.metastore.ingenta.com/content/journals/10.1049/iet-cds.2016.0143
Loading

Related content

content/journals/10.1049/iet-cds.2016.0143
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading
This is a required field
Please enter a valid email address