Integrating Stereoscopic Video with Modular 3D Anatomic Models for Lateral Skull Base Training

Abstract

Introduction Current virtual reality (VR) technology allows the creation of instructional video formats that incorporate three-dimensional (3D) stereoscopic footage.Combined with 3D anatomic models, any surgical procedure or pathology could be represented virtually to supplement learning or surgical preoperative planning. We propose a standalone VR app that allows trainees to interact with modular 3D anatomic models corresponding to stereoscopic surgical videos.

Methods Stereoscopic video was recorded using an OPMI Pentero 900 microscope (Zeiss, Oberkochen, Germany). Digital Imaging and Communications in Medicine (DICOM) images segmented axial temporal bone computed tomography and each anatomic structure was exported separately. 3D models included semicircular canals, facial nerve, sigmoid sinus and jugular bulb, carotid artery, tegmen, canals within the temporal bone, cochlear and vestibular aqueducts, endolymphatic sac, and all branches for cranial nerves VII and VIII. Finished files were imported into the Unreal Engine. The resultant application was viewed using an Oculus Go.

Results A VR environment facilitated viewing of stereoscopic video and interactive model manipulation using the VR controller. Interactive models allowed users to toggle transparency, enable highlighted segmentation, and activate labels for each anatomic structure. Based on 20 variable components, a value of 1.1 × 10¹² combinations of structures per DICOM series was possible for representing patient-specific anatomy in 3D.

Conclusion This investigation provides proof of concept that a hybrid of stereoscopic video and VR simulation is possible, and that this tool may significantly aid lateral skull base trainees as they learn to navigate a complex 3D surgical environment. Future studies will validate methodology.

Keywords

virtual simulation - virtual reality - lateral skull base - stereoscopic - video - education

Publication History

Received: 26 September 2019

Accepted: 24 December 2019

Article published online:
13 March 2020

• References

• 1 Reznick RK, MacRae H. Teaching surgical skills--changes in the wind. N Engl J Med 2006; 355 (25) 2664-2669
• 2 Butler NN, Wiet GJ. Reliability of the Welling scale (WS1) for rating temporal bone dissection performance. Laryngoscope 2007; 117 (10) 1803-1808
• 3 Malekzadeh S. Simulation in otolaryngology. Otolaryngol Clin North Am 2017; 50 (05) xvii-xviii
• 4 Arora A, Hall A, Kotecha J. et al. Virtual reality simulation training in temporal bone surgery. Clin Otolaryngol 2015; 40 (02) 153-159
• 5 Wiet GJ, Stredney D, Kerwin T. et al. Virtual temporal bone dissection system: OSU virtual temporal bone system: development and testing. Laryngoscope 2012; 122 (Suppl. 01) S1-S12
• 6 Varshney R, Frenkiel S, Nguyen LH. et al; National Research Council Canada. Development of the McGill simulator for endoscopic sinus surgery: a new high-fidelity virtual reality simulator for endoscopic sinus surgery. Am J Rhinol Allergy 2014; 28 (04) 330-334
• 7 Fedorov A, Beichel R, Kalpathy-Cramer J. et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn Reson Imaging 2012; 30 (09) 1323-1341
• 8 Khemani S, Arora A, Singh A, Tolley N, Darzi A. Objective skills assessment and construct validation of a virtual reality temporal bone simulator. Otol Neurotol 2012; 33 (07) 1225-1231
• 9 Varoquier M, Hoffmann CP, Perrenot C, Tran N, Parietti-Winkler C. Construct, face, and content validation on Voxel-Man® simulator for otologic surgical training. Int J Otolaryngol 2017; 2017: 2707690