This is an open access article published by the IET under the Creative Commons Attribution License (http://creativecommons.org/licenses/by/3.0/)
In laparoscopic surgery, the surgeon must operate with a limited field of view and reduced depth perception. This makes spatial understanding of critical structures difficult, such as an endophytic tumour in a partial nephrectomy. Such tumours yield a high complication rate of 47%, and excising them increases the risk of cutting into the kidney's collecting system. To overcome these challenges, an augmented reality guidance system is proposed. Using intra-operative ultrasound, a single navigation aid, and surgical instrument tracking, four augmentations of guidance information are provided during tumour excision. Qualitative and quantitative system benefits are measured in simulated robot-assisted partial nephrectomies. Robot-to-camera calibration achieved a total registration error of 1.0 ± 0.4 mm while the total system error is 2.5 ± 0.5 mm. The system significantly reduced healthy tissue excised from an average (±standard deviation) of 30.6 ± 5.5 to 17.5 ± 2.4 cm3 (p < 0.05) and reduced the depth from the tumor underside to cut from an average (±standard deviation) of 10.2 ± 4.1 to 3.3 ± 2.3 mm (p < 0.05). Further evaluation is required in vivo, but the system has promising potential to reduce the amount of healthy parenchymal tissue excised.
References
-
-
1)
-
7. Schneider, C., Nguan, C., Longpre, M., et al: ‘Motion of the kidney between preoperative and intraoperative positioning’, IEEE Trans. Biomed. Eng., 2013, 60, (6), pp. 1619–1627 (doi: 10.1109/TBME.2013.2239644).
-
2)
-
4. Venkatesh, R., Weld, K., Ames, C.D., et al: ‘Laparoscopic partial nephrectomy for renal masses: effect of tumor location’, Urology, 2006, 67, (6), pp. 1169–1174 (doi: 10.1016/j.urology.2006.01.089).
-
3)
-
12. Wild, E., Teber, D., Schmid, D., et al: ‘Robust augmented reality guidance with fluorescent markers in laparoscopic surgery’, Int. J. Comput. Assist. Radiol. Surg., 2016, 11, (6), pp. 899–907 (doi: 10.1007/s11548-016-1385-4).
-
4)
-
11. Simpfendörfer, T., Gasch, C., Hatiboglu, G., et al: ‘Intraoperative computed tomography imaging for navigated laparoscopic renal surgery: first clinical experience’, J. Endourol., 2016, 30, (10), pp. 1105–1111 (doi: 10.1089/end.2016.0385).
-
5)
-
6. Thompson, R.H., Lane, B.R., Lohse, C.M., et al: ‘Renal function after partial nephrectomy: effect of warm ischemia relative to quantity and quality of preserved kidney’, Urology, 2012, 79, (2), pp. 356–360 (doi: 10.1016/j.urology.2011.10.031).
-
6)
-
24. Sauro, J.: ‘Measuring usability with the system usability scale (SUS)’, Meas. Usability, 2011, pp. 1–5.
-
7)
-
21. Grenier, N., Gennisson, J.L., Cornelis, F., et al: ‘Renal ultrasound elastography’, Diagn. Interv. Imaging, 2013, 94, (5), pp. 545–550 (doi: 10.1016/j.diii.2013.02.003).
-
8)
-
14. Cheung, C.L., Wedlake, C., Moore, J., et al: ‘Fused video and ultrasound images for minimally invasive partial nephrectomy: a phantom study’, Med. Image Comput. Comput. Assist. Interv., 2010, 6363, pp. 408–415.
-
9)
-
23. Umeyama, S.: ‘Least-squares estimation of transformation parameters between two point patterns’, IEEE Trans. Pattern Anal. Mach. Intell., 1991, 13, (4), pp. 376–380 (doi: 10.1109/34.88573).
-
10)
-
20. Yushkevich, P.A., Piven, J., Hazlett, H.C., et al: ‘User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability’, Neuroimage, 2006, 31, (3), pp. 1116–1128 (doi: 10.1016/j.neuroimage.2006.01.015).
-
11)
-
9. Ukimura, O., Gill, I.S.: ‘Imaging-assisted endoscopic surgery: Cleveland clinic experience’, J. Endourol., 2008, 22, (4), pp. 803–810 (doi: 10.1089/end.2007.9823).
-
12)
-
5. Sutherland, S.E., Resnick, M.I., Maclennan, G.T., et al: ‘Does the size of the surgical margin in partial nephrectomy for renal cell cancer really matter?’, J. Urol., 2002, 167, (1), pp. 61–64 (doi: 10.1016/S0022-5347(05)65383-9).
-
13)
-
10. Teber, D., Guven, S., Simpfendörfer, T., et al: ‘Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? preliminary in vitro and in vivo results’, Eur. Urol., 2009, 56, (2), pp. 332–338 (doi: 10.1016/j.eururo.2009.05.017).
-
14)
-
18. Bernhardt, S., Nicolau, S.A., Soler, L., et al: ‘The status of augmented reality in laparoscopic surgery as of 2016’, Med. Image Anal., 2017, 37, pp. 66–90 (doi: 10.1016/j.media.2017.01.007).
-
15)
-
3. Hughes-Hallett, A., Mayer, E.K., Marcus, H.J., et al: ‘Augmented reality partial nephrectomy: examining the current status and future perspectives’, Urology, 2014, 83, (2), pp. 266–273 (doi: 10.1016/j.urology.2013.08.049).
-
16)
-
19. Schneider, C., Nguan, C., Rohling, R., et al: ‘Tracked ‘pick-up’ ultrasound for robot-assisted minimally invasive surgery’, IEEE Trans. Biomed. Eng., 2016, 63, (2), pp. 260–268 (doi: 10.1109/TBME.2015.2453173).
-
17)
-
16. Zhang, L., Ye, M., Chan, P.L., et al: ‘Real-time surgical tool tracking and pose estimation using a hybrid cylindrical marker’, Int. J. Comput. Assist. Radiol. Surg., 2017, 12, (6), pp. 921–930 (doi: 10.1007/s11548-017-1558-9).
-
18)
-
2. Tan, H.-J., Norton, E.C., Ye, Z., et al: ‘Long-term survival following partial vs radical nephrectomy among older patients with early-stage kidney cancer’, JAMA, 2012, 307, (15), pp. 1629–1635 (doi: 10.1001/jama.2012.475).
-
19)
-
3. Kutikov, A., Uzzo, R.G.: ‘The R.E.N.A.L. nephrometry score: a comprehensive standardized system for quantitating renal tumor size, location and depth’, J. Urol., 2009, 182, (3), pp. 844–853 (doi: 10.1016/j.juro.2009.05.035).
-
20)
-
25. Zhang, Z.: ‘A flexible new technique for camera calibration’, IEEE Trans. Pattern Anal. Mach. Intell., 2000, 22, (11), pp. 1330–1334 (doi: 10.1109/34.888718).
-
21)
-
2. Su, L.-M., Vagvolgyi, B.P., Agarwal, R., et al: ‘Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration’, Urology, 2009, 73, (4), pp. 896–900 (doi: 10.1016/j.urology.2008.11.040).
-
22)
-
1. Lau, W.K.O., Blute, M.L., Weaver, A.L., et al: ‘Matched comparison of radical nephrectomy vs nephron-sparing surgery in patients with unilateral renal cell carcinoma and a normal contralateral kidney’, Mayo Clin. Proc., 2000, 75, (12), pp. 1236–1242 (doi: 10.4065/75.12.1236).
-
23)
-
15. Pratt, P., Jaeger, A., Hughes-Hallett, A., et al: ‘Robust ultrasound probe tracking: initial clinical experiences during robot-assisted partial nephrectomy’, Int. J. Comput. Assist. Radiol. Surg., 2015, 10, (12), pp. 1905–1913 (doi: 10.1007/s11548-015-1279-x).
-
24)
-
17. Edgcumbe, P., Singla, R., Pratt, P., et al: ‘Augmented reality imaging for robot-assisted partial nephrectomy surgery’. in Int. Conf. Medical Imaging and Virtual Reality, 2016, pp. 139–150.
http://iet.metastore.ingenta.com/content/journals/10.1049/htl.2017.0063
Related content
content/journals/10.1049/htl.2017.0063
pub_keyword,iet_inspecKeyword,pub_concept
6
6