access icon openaccess Design and evaluation of an augmented reality simulator using leap motion

Advances in virtual and augmented reality (AR) are having an impact on the medical field in areas such as surgical simulation. Improvements to surgical simulation will provide students and residents with additional training and evaluation methods. This is particularly important for procedures such as the endoscopic third ventriculostomy (ETV), which residents perform regularly. Simulators such as NeuroTouch, have been designed to aid in training associated with this procedure. The authors have designed an affordable and easily accessible ETV simulator, and compare it with the existing NeuroTouch for its usability and training effectiveness. This simulator was developed using Unity, Vuforia and the leap motion (LM) for an AR environment. The participants, 16 novices and two expert neurosurgeons, were asked to complete 40 targeting tasks. Participants used the NeuroTouch tool or a virtual hand controlled by the LM to select the position and orientation for these tasks. The length of time to complete each task was recorded and the trajectory log files were used to calculate performance. The resulting data from the novices' and experts' speed and accuracy are compared, and they discuss the objective performance of training in terms of the speed and accuracy of targeting accuracy for each system.

Inspec keywords: medical computing; augmented reality; surgery; endoscopes; biomedical optical imaging

Other keywords: Unity; augmented reality simulator design; surgical simulation; medical field; augmented reality simulator evaluation; virtual hand; AR environment; leap motion; training effectiveness; NeuroTouch; Vuforia; trajectory log hles; ETV simulator; endoscopic third ventriculostomy

Subjects: Patient care and treatment; Optical and laser radiation (medical uses); Virtual reality; Optical and laser radiation (biomedical imaging/measurement); Patient care and treatment; Patient diagnostic methods and instrumentation; Biology and medical computing

References

    1. 1)
    2. 2)
    3. 3)
      • 3. Armstrong, R., Eagleson, R., Ribaupierre, S.D.: ‘Patient-specific pipeline to create virtual endoscopic third ventriculostomy scenarios’, Studies in Health Technology and Informatics,2014, 196, p. 14, doi: 10.3233/978-1-61499-375-9-14.
    4. 4)
    5. 5)
    6. 6)
    7. 7)
    8. 8)
      • 13. Amin, D., Govilkar, S.: ‘Comparative study of augmented reality SDK's’, Int. J. Comput. Sci. Appl., 2015, 5, (1), pp. 1126.
    9. 9)
      • 1. Armstrong, R., Wright, T., de Ribaupierre, S., et al: ‘Augmented reality for neurosurgical guidance: an objective comparison of planning interface modalities’. Int. Conf. Medical Imaging and Virtual Reality, 2016, pp. 233243, doi: 10.1007/978-3-319-43775-0_21.
    10. 10)
      • 15. Coelho, J.C., Verbeek, F.J.: ‘Pointing task evaluation of leap motion controller in 3D virtual environment’. Creating the Difference, 2014, p. 78.
    11. 11)
      • 19. Abhari, K., Baxter, J., Chen, E., et al: ‘The role of augmented reality in training the planning of brain tumor resection’, in (EDs.): ‘Augmented reality environments for medical imaging and computer-assisted interventions2013, 8090, pp. 241248.
    12. 12)
    13. 13)
      • 8. Ang, W.J., Hopkins, M.E., Partridge, R., et al: ‘Validating the use of smartphone-based accelerometers for performance assessment in a simulated neurosurgical task’, Neurosurgery, 2014, 10, pp. 5765.
    14. 14)
    15. 15)
      • 10. Jie, J., Yang, K., Haihui, S.: ‘Research on the 3D game scene optimization of mobile phone based on the unity 3D engine’. 2011 Int. Conf. Computational and Information Sciences (ICCIS), 2011, pp. 875877.
    16. 16)
      • 20. Kramers, M., Armstrong, R., Bakhshmand, S., et al: ‘Evaluation of a mobile augmented reality application for image guidance of neurosurgical interventions’. Medicine Meets Virtual Reality (MMVR), 2014, pp. 204208.
    17. 17)
    18. 18)
      • 18. Abhari, K., Baxter, J., Chen, E., et al: ‘Use of a mixed-reality system to improve the planning of brain tumour resections: preliminary results’. MICCAI Workshop on Augmented Environments for Computer-Assisted Interventions, 2012, pp. 5566.
    19. 19)
      • 14. Al Delail, B., Weruaga, L., Jamal Zemerly, M.: ‘CAViAR: context aware visual indoor augmented reality for a university campus’. 2012 IEEE/WIC/ACM Int. Conf. Web Intelligence and Intelligent Agent Technology (WI-IAT, vol. 3, pp. 286290.
    20. 20)
    21. 21)
    22. 22)
      • 11. Wang, S., Mao, Z., Zeng, C., et al: ‘A new method of virtual reality based on unity3d’. 2010 18th Int. Conf. Geoinformatics, 2010, pp. 15.
    23. 23)
      • 7. Delorme, S., Laroche, D., DiRaddo, R., et al: ‘Neurotouch: a physics-based virtual simulator for cranial microneurosurgery training’, Neurosurgery, 2012, 71, pp. 3242, doi: 10.1227/NEU.0b013e318249c744.
http://iet.metastore.ingenta.com/content/journals/10.1049/htl.2017.0070
Loading

Related content

content/journals/10.1049/htl.2017.0070
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading