Virtual Reality and Augmented Reality in Plastic Surgery: A Review

Recently, virtual reality (VR) and augmented reality (AR) have received increasing attention, with the development of VR/AR devices such as head-mounted displays, haptic devices, and AR glasses. Medicine is considered to be one of the most effective applications of VR/AR. In this article, we describe a systematic literature review conducted to investigate the state-of-the-art VR/AR technology relevant to plastic surgery. The 35 studies that were ultimately selected were categorized into 3 representative topics: VR/AR-based preoperative planning, navigation, and training. In addition, future trends of VR/AR technology associated with plastic surgery and related fields are discussed.

Keywords

Virtual reality - Augmented reality - Plastic surgery - Virtual surgery - Virtual simulation

Publication History

Received: 27 February 2017

Accepted: 21 April 2017

Article published online:
20 April 2022

• REFERENCES

• 1 Zimmerman TG, Lanier J, Blanchard C. et al. A hand gesture interface device. In: Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface. 1987 Apr 5-9; Toronto, CA 1987: 189-192
• 2 Chinnock C. Virtual reality in surgery and medicine. Hosp Technol Ser 1994; 13: 1-48
• 3 Pensieri C, Pennacchini M. Overview: virtual reality in medicine. J Virtual Worlds Res 2014; 7: 1-34
• 4 Geomagic. Geomagic Haptic Devices [Internet]. Rock Hill, SC: Geomagic; 2016. cited 2017 Feb 7. Available from: http://www.geomagic.com/en/products-landing-pages/haptic
• 5 Fushima K, Kobayashi M. Mixed-reality simulation for orthognathic surgery. Maxillofac Plast Reconstr Surg 2016; 38: 13
• 6 Tsai MD, Liu CS, Liu HY. et al. Virtual reality facial contouring surgery simulator based on CT transversal slices. Proceedings of the 5th International Conference on Bioinformatics and Biomedical Engineering. 2011 May 10-12 Wuhan, China: 2011: 1-4
• 7 Wang Q, Chen H, Wu W. et al. Real-time mandibular angle reduction surgical simulation with haptic rendering. IEEE Trans Inf Technol Biomed 2012; 16: 1105-1114
• 8 Olsson P, Nysjo F, Rodriguez-Lorenzo A. et al. Haptics-assisted virtual planning of bone, soft tissue, and vessels in fibula osteocutaneous free flaps. Plast Reconstr Surg Glob Open 2015; 3: e479
• 9 Schendel S, Montgomery K, Sorokin A. et al. A surgical simulator for planning and performing repair of cleft lips. J Craniomaxillofac Surg 2005; 33: 223-228
• 10 Olsson P, Nysjo F, Hirsch JM. et al. A haptics-assisted cranio-maxillofacial surgery planning system for restoring skeletal anatomy in complex trauma cases. Int J Comput Assist Radiol Surg 2013; 8: 887-894
• 11 Zhang J, Li D, Liu Q. et al. Virtual surgical system in reduction of maxillary fracture. Proceedings of the 2015 IEEE International Conference on Digital Signal Processing (DSP). 2015 Jul 21-24 Singapore: 2015: 1102-1105
• 12 Kovler I, Joskowicz L, Weil YA. et al. Haptic computer-assisted patient-specific preoperative planning for orthopedic fractures surgery. Int J Comput Assist Radiol Surg 2015; 10: 1535-1546
• 13 Cecil J, Ramanathan P, Pirela-Cruz M. et al. A Virtual Reality Based Simulation Environment for Orthopedic Surgery. In: Meersman R, Panetto H, Mishra A. et al. On the Move to Meaningful Internet Systems: OTM 2014 Workshops. Confederated International Workshops: OTM Academy, OTM Industry Case Studies Program, C&TC, EI2N, INBAST, ISDE, META4eS, MSC and OnToContent 2014 Oct 27-31 Amantea, Italy Berlin, Heidelberg: Springer Berlin Heidelberg; 2014: 275-285
• 14 Cecil J, Ramanathan P, Rahneshin V. et al. Collaborative virtual environments for orthopedic surgery. Proceedings of the 2013 IEEE International Conference on Automation Science and Engineering (CASE). 2013 Aug 17-20 Madison, WI: 2013: 133-137
• 15 Shen F, Chen B, Guo Q. et al. Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery. Int J Comput Assist Radiol Surg 2013; 8: 169-179
• 16 Chan S, Li P, Locketz G. et al. High-fidelity haptic and visual rendering for patient-specific simulation of temporal bone surgery. Comput Assist Surg (Abingdon) 2016; 21: 85-101
• 17 Luciano CJ, Banerjee PP, Sorenson JM. et al. Percutaneous spinal fixation simulation with virtual reality and haptics. Neurosurgery 2013; 72 (Suppl. 01) 89-96
• 18 ImmersiveTouch Inc. ImmersiveTouch [Internet]. IChicago, CA: ImmersiveTouch Inc; 2017. cited 2017 Jan 12 Available from: http://www.immersivetouch.com
• 19 Badiali G, Ferrari V, Cutolo F. et al. Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. J Craniomaxillofac Surg 2014; 42: 1970-1976
• 20 Zinser MJ, Mischkowski RA, Dreiseidler T. et al. Computer-assisted orthognathic surgery: waferless maxillary positioning, versatility, and accuracy of an image-guided visualisation display. Br J Oral Maxillofac Surg 2013; 51: 827-833
• 21 Mischkowski RA, Zinser MJ, Kubler AC. et al. Application of an augmented reality tool for maxillary positioning in orthognathic surgery: a feasibility study. J Craniomaxillofac Surg 2006; 34: 478-483
• 22 Lin L, Shi Y, Tan A. et al. Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms: a feasibility study. J Craniomaxillofac Surg 2016; 44: 215-223
• 23 Wang J, Suenaga H, Yang L. et al. Video see-through augmented reality for oral and maxillofacial surgery. Int J Med Robot. 09.06.2016. [Epub]
• 24 Choi H, Park Y, Cho H. et al. An augmented reality based simple navigation system for pelvic tumor resection. Proceedings of the 11th Asian Conference on Computer Aided Surgery (ACCAS 2015). 2015 Jul 9-11 Singapore 2015
• 25 Choi H, Cho B, Masamune K. et al. An effective visualization technique for depth perception in augmented reality-based surgical navigation. Int J Med Robot 2016; 12: 62-72
• 26 Wu F, Chen X, Lin Y. et al. A virtual training system for maxillofacial surgery using advanced haptic feedback and immersive workbench. Int J Med Robot 2014; 10: 78-87
• 27 Lin Y, Wang X, Wu F. et al. Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill. J Biomed Inform 2014; 48: 122-129
• 28 Seah TE, Barrow A, Baskaradas A. et al. A virtual reality system to train image guided placement of kirschner-wires for distal radius fractures. In: Bello F, Cotin S. Biomedical Simulation. 6th International Symposium, ISBMS 2014 2014 Oct 16-17 Strasbourg, FR Cham: Springer International Publishing; 2014: 20-29
• 29 Thomas GW, Johns BD, Kho JY. et al. The validity and reliability of a hybrid reality simulator for wire navigation in orthopedic surgery. IEEE Trans Hum Mach Syst 2015; 45: 119-125
• 30 Swemac. TraumaVision-medical orthopedic simulator [Internet]. Linkoping, SE: Swemac; 2017 cited 2017 Jan 12. Available from: http://www.swemac.com/simulators/traumavision
• 31 OssoVR. OssoVR [Internet]. San Francisco, CA: OssoVR. cited 2017 Feb 6. Available from: http://ossovr.com
• 32 Vankipuram M, Kahol K, McLaren A. et al. A virtual reality simulator for orthopedic basic skills: a design and validation study. J Biomed Inform 2010; 43: 661-668
• 33 Wong D, Unger B, Kraut J. et al. Comparison of cadaveric and isomorphic virtual haptic simulation in temporal bone training. J Otolaryngol Head Neck Surg 2014; 43: 31
• 34 Qiong W, Hui C, Wen W. et al. Impulse-based rendering methods for haptic simulation of bone-burring. IEEE Trans Haptics 2012; 5: 344-355
• 35 Lemole Jr GM, Banerjee PP, Luciano C. et al. Virtual reality in neurosurgical education: part-task ventriculostomy simulation with dynamic visual and haptic feedback. Neurosurgery 2007; 61: 142-148
• 36 Alaraj A, Luciano CJ, Bailey DP. et al. Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Neurosurgery 2015; 11 (Suppl. 02) 52-58
• 37 Sutherland C, Hashtrudi-Zaad K, Sellens R. et al. An augmented reality haptic training simulator for spinal needle procedures. IEEE Trans Biomed Eng 2013; 60: 3009-3018
• 38 Tsai MD, Hsieh MS. Computer based system for simulating spine surgery. Proceedings of the 22nd IEEE International Symposium on Computer-Based Medical Systems 2009 Aug 2-5 Albuquerque, NM: 2009: 1-8
• 39 CAE Healthcare Inc. NeuroVR [Internet]. Montreal, CA: Cae Healthcare; 2017. cited 2017 Jan 12 Available from: http://caehealthcare.com/eng/interventional-simulators/neurovr
• 40 Woo T, Kraeima J, Kim YO. et al. Mandible reconstruction with 3D virtual planning. J Int Soc Simul Surg 2015; 2: 90-93
• 41 Burdea G, Coiffet P. Virtual reality technology. Hoboken, NJ: J. Wiley-Interscience; 2003
• 42 Hackett M, Proctor M. Three-dimensional display technologies for anatomical education: a literature Review. J Sci Educ Technol 2016; 25: 641-654
• 43 Makino Y, Furuyama Y, Inoue S. et al. HaptoClone (Haptic-Optical Clone) for mutual tele-environment by real-time 3D image transfer with midair force Feedback. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems 2016 Santa Clara, CA: ACM; 2016: 1980-1990