IMHOTEP - Virtual Reality Framework for Surgical Applications
Micha Pfeiffer, Hannes Kenngott, Anas Preukschas, Matthias Huber, Lisa Bettscheider, Beat Müller-Stich, Stefanie Speidel
备注：
This is a post-peer-review, pre-copyedit version of an article published in the International Journal of Computer Assisted Radiology and Surgery (IJCARS). The final authenticated version is available online at: https://doi.org/10.1007/s11548-018-1730-x
Purpose: The data which is available to surgeons before, during and after surgery is steadily increasing in quantity as well as diversity. When planning a patient's treatment, this large amount of information can be difficult to interpret. To aid in processing the information, new methods need to be found to present multi-modal patient data, ideally combining textual, imagery, temporal and 3D data in a holistic and context-aware system. Methods: We present an open-source framework which allows handling of patient data in a virtual reality (VR) environment. By using VR technology, the workspace available to the surgeon is maximized and 3D patient data is rendered in stereo, which increases depth perception. The framework organizes the data into workspaces and contains tools which allow users to control, manipulate and enhance the data. Due to the framework's modular design, it can easily be adapted and extended for various clinical applications. Results: The framework was evaluated by clinical personnel (77 participants). The majority of the group stated that a complex surgical situation is easier to comprehend by using the framework, and that it is very well suited for education. Furthermore, the application to various clinical scenarios - including the simulation of excitation-propagation in the human atrium - demonstrated the framework's adaptability. As a feasibility study, the framework was used during the planning phase of the surgical removal of a large central carcinoma from a patient's liver. Conclusion: The clinical evaluation showed a large potential and high acceptance for the VR environment in a medical context. The various applications confirmed that the framework is easily extended and can be used in real-time simulation as well as for the manipulation of complex anatomical structures.
Mixed Reality Guidance of a Surgical Scalpel Using Magic Leap: Evaluation on a 3D-Printed Liver Phantom
Department of Computer Science（计算机科学系）；Department of Hepatobiliary Surgery（肝胆外科）；Biomedical Engineering Institute, MedTech Labs（MedTech Labs 生物医学工程研究所）；University of Cincinnati（辛辛那提大学）
SLIMBRAIN: Augmented Reality Real-Time Acquisition and Processing System For Hyperspectral Classification Mapping with Depth Information for In-Vivo Surgical Procedures
Research Center on Software Technologies and Multimedia Systems, Universidad Politécnica de Madrid（马德里理工大学软件技术与多媒体系统研究中心）；Department of Neurosurgery, Hospital Universitario 12 de Octubre, Universidad Complutense de Madrid（马德里康普顿斯大学十月十二日大学医院神经外科）
Integrating Virtual Reality and Large Language Models for Team-Based Non-Technical Skills Training and Evaluation in the Operating Room
Beth Israel Deaconess Medical Center Center（贝希斯尔德医疗中心中心）；Department of Surgery, Northwell Health（外科，北well健康）；College of Engineering, Florida Agricultural and Mechanical University and Florida State University（工程学院，佛罗里达农业与机械大学和佛罗里达州立大学）
Haptic Guidance and Haptic Error Amplification in a Virtual Surgical Robotic Training Environment
Stanford University（斯坦福大学）；Hospital for Special Surgery（特种外科医院）；University of Notre Dame（圣母大学）；University of Washington（华盛顿大学）；Ben-Gurion University of the Negev（内盖夫本-古里安大学）；Intuitive Surgical Inc.（直觉外科公司）；Case Western Reserve University（凯斯西储大学）
