arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2308.04313cs.AIcs.GRcs.HC
收藏

Apple Vision Pro在医疗保健中的应用:“终极显示”?——进入精准医疗的奇妙世界

Apple Vision Pro for Healthcare: "The Ultimate Display"? -- Entering the Wonderland of Precision Medicine

Essen University Hospital (AöR)(埃森大学医院);Cancer Research Center Cologne Essen (CCCE)(科隆埃森癌症研究中心);University Medicine Essen (AöR)(埃森大学医学部);University Hospital RWTH Aachen(亚琛工业大学附属医院);Graz University of Technology(格拉茨工业大学);Shanghai Jiao Tong University(上海交通大学);State Key Laboratory of Mechanical System and Vibration(机械系统与振动国家重点实验室);College of Medicine, University of Florida(佛罗里达大学医学院);German Cancer Consortium (DKTK)(德国癌症联盟);TU Dortmund University(多特蒙德工业大学);Institute of Medical Informatics, University Hospital RWTH Aachen(亚琛工业大学附属医院医学信息学研究所)

Jan Egger, Christina Gsaxner, Xiaojun Chen, Jiang Bian, Jens Kleesiek, Behrus Puladi

AI总结:

本文探讨Apple Vision Pro作为混合现实头显在医疗领域的潜力,分析其VST功能等特性,评估其能否克服AR临床挑战并帮助医生节省时间。

摘要:

在2023年6月的全球开发者大会(WWDC)上,苹果公司推出了Vision Pro。Vision Pro是一款混合现实(MR)头戴式设备,更具体地说,它是一款具备额外视频透视(VST)功能的虚拟现实(VR)设备。VST功能也使Vision Pro成为一款增强现实(AR)设备。AR功能通过摄像头将真实世界实时传输到用户眼前的(VR)屏幕上实现。这当然并非独一无二,与其他设备如Varjo XR-3类似。尽管如此,Vision Pro具有一些有趣的功能,例如一个内向外屏幕,可以向“外部人员”展示头戴设备佩戴者的眼睛,或者顶部一个名为“数码皇冠”(Digital Crown)的按钮,通过旋转它可以无缝地将数字内容与物理空间融合。此外,除了连接电池的线缆外,它是无线的,这使得头戴设备相比Varjo XR-3更加灵活。这实际上可能更接近伊万·萨瑟兰(Ivan Sutherland)在1965年就已经构想的“终极显示”(Ultimate Display)。与终极显示一样,目前尚未向公众开放,我们想在这篇展望文章中窥探水晶球,看看它是否能克服一些临床挑战——尤其是AR在医疗领域仍然面临的挑战,同时更进一步讨论Vision Pro是否能够支持临床医生完成基本任务,从而让他们有更多时间陪伴患者。

英文摘要:

At the Worldwide Developers Conference (WWDC) in June 2023, Apple introduced the Vision Pro. The Vision Pro is a Mixed Reality (MR) headset, more specifically it is a Virtual Reality (VR) device with an additional Video See-Through (VST) capability. The VST capability turns the Vision Pro also into an Augmented Reality (AR) device. The AR feature is enabled by streaming the real world via cameras to the (VR) screens in front of the user's eyes. This is of course not unique and similar to other devices, like the Varjo XR-3. Nevertheless, the Vision Pro has some interesting features, like an inside-out screen that can show the headset wearers' eyes to "outsiders" or a button on the top, called "Digital Crown", that allows you to seamlessly blend digital content with your physical space by turning it. In addition, it is untethered, except for the cable to the battery, which makes the headset more agile, compared to the Varjo XR-3. This could actually come closer to the "Ultimate Display", which Ivan Sutherland had already sketched in 1965. Not available to the public yet, like the Ultimate Display, we want to take a look into the crystal ball in this perspective to see if it can overcome some clinical challenges that - especially - AR still faces in the medical domain, but also go beyond and discuss if the Vision Pro could support clinicians in essential tasks to spend more time with their patients.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑