Evaluation of Augmented Reality-based Intuitive Interface for Robot-Assisted Transesophageal Echocardiography: A User Study
基于增强现实的机器人辅助经食管超声心动图直观界面评估:用户研究
Xiu Zhang*, Matteo Di Mauro*, Sofia Breschi, Angela Peloso, Emiliano Votta, Arianna Menciassi, Elena De Momi
AI总结 本研究提出并评估了一种基于增强现实的直观界面,用于机器人辅助经食管超声心动图,通过3D可视化与尖端控制显著提升空间精度并降低操作误差。
详情
经食管超声心动图(TEE)对于诊断和引导结构性心脏病(SHD)介入治疗至关重要。然而,手动TEE操作需要操作者具备丰富的专业技能,体力消耗大,并且在透视下操作会使临床医生暴露于辐射中。机器人辅助TEE系统已被引入以改进探头操作并减少操作者疲劳,但直观有效的用户界面设计仍是一个开放挑战。本研究提出并评估了一种模型增强的、基于增强现实(AR)的直观界面,用于机器人辅助TEE,旨在提高空间意识和控制直观性。使用集成电磁跟踪和虚拟模拟器的机器人TEE平台,比较了三种在可视化和交互模式上不同的用户界面:2D关节级(2D-JI)、3D关节级(3D-JI)和3D尖端级(3D-TI)。36名参与者执行标准化导航任务以再现目标超声心动图视图,通过位置和方向误差、完成时间和NASA-TLX工作量评分评估性能。结果表明,3D可视化显著提高了空间精度,与2D界面相比,中位位置误差从13毫米减少到3毫米,方向误差减半。尖端级交互相比关节级控制,方向误差进一步降低50%,并减少了用户间变异性。总体而言,3D-TI配置结合了沉浸式可视化与直接尖端级控制,被证明是最有效且符合人体工程学的界面,支持将基于AR的可视化和直观控制范式集成到下一代机器人TEE系统中,以增强操作者性能和手术安全性。
TransEsophageal Echocardiography (TEE) is essential for diagnosing and guiding Structural Heart Disease (SHD) interventions. However, manual TEE manipulation demands significant operator expertise, is physically demanding, and exposes clinicians to radiation when performed alongside fluoroscopy. Robotic-assisted TEE systems have been introduced to improve probe handling and reduce operator fatigue, yet the design of intuitive and effective user interfaces remains an open challenge. This study presents and evaluates a model-enhanced, Augmented Reality (AR)-based intuitive interface for robot-assisted TEE, designed to improve spatial awareness and control intuitiveness. A robotic TEE platform integrated with electromagnetic tracking and a virtual simulator was used to compare three user interfaces differing in visualization and interaction modalities: 2D jointlevel (2D-JI), 3D joint-level (3D-JI), and 3D tip-level (3D-TI). Thirty six participants performed standardized navigation tasks to reproduce target echocardiographic views, with performance assessed via position and orientation errors, completion time, and NASA-TLX workload scores. Results show that 3D visualization significantly improved spatial accuracy, reducing median position error from 13 mm to 3 mm and halving the orientation error compared with the 2D interface. Tip-level interaction yielded a further 50% reduction in orientation error and reduced interuser variability relative to joint-level control. Overall, the 3D-TI configuration, combining immersive visualization with direct tip-level control, proved the most effective and ergonomic interface, supporting the integration of AR-based visualization and intuitive control paradigms into next-generation robotic TEE systems to enhance operator performance and procedural safety.