arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.05053cs.RO
收藏

基于人类意图估计的视线引导机器人血管超声

Gaze-Guided Robotic Vascular Ultrasound Leveraging Human Intention Estimation

Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning(慕尼黑机器学习中心)

Yuan Bi, Yang Su, Nassir Navab, Zhongliang Jiang

AI总结:

本文提出一种视线引导的机器人血管超声系统,通过视线追踪、稳定化模块和视线引导分割网络估计操作者意图,并结合超声置信度方向校正,解决血管分叉时的扫描目标选择与接触稳定性问题。

摘要:

医学超声在现代临床实践中已被广泛用于检查血管结构。然而,传统超声检查常常面临与操作者间和操作者内变异相关的挑战。机器人超声系统(RUSS)因其在稳定性和可重复性方面的优势,成为应对这些挑战的潜在解决方案。鉴于人体血管解剖结构复杂,超声图像中经常出现多条血管,或者单条血管分叉为分支,从而使检查过程复杂化。为应对这一挑战,本文提出了一种面向血管应用的视线引导RUSS。视线追踪器捕捉操作者的眼球运动,提取的视线信号引导RUSS在血管分叉时跟随正确的血管。此外,提出了一种视线引导分割网络,通过利用视线信息来增强分割的鲁棒性。然而,视线信号通常含有噪声,需要加以解释以准确辨别操作者的真实意图。为此,本研究提出了一个稳定化模块来处理原始视线数据。推断出的注意力热图被用作区域提议以辅助分割,并在操作者需要调整扫描目标时(例如出现分叉时)充当触发信号。为确保扫描过程中探头与表面之间的适当接触,开发了一种基于超声置信度的自动方向校正方法。在实验中,我们通过与其他方法进行比较,证明了所提出的视线引导分割流程的有效性。此外,所提出的视线引导RUSS的整体性能也在表面不平整的真实手臂模型上得到了验证。

英文摘要:

Medical ultrasound has been widely used to examine vascular structure in modern clinical practice. However, traditional ultrasound examination often faces challenges related to inter- and intra-operator variation. The robotic ultrasound system (RUSS) appears as a potential solution for such challenges because of its superiority in stability and reproducibility. Given the complex anatomy of human vasculature, multiple vessels often appear in ultrasound images, or a single vessel bifurcates into branches, complicating the examination process. To tackle this challenge, this work presents a gaze-guided RUSS for vascular applications. A gaze tracker captures the eye movements of the operator. The extracted gaze signal guides the RUSS to follow the correct vessel when it bifurcates. Additionally, a gaze-guided segmentation network is proposed to enhance segmentation robustness by exploiting gaze information. However, gaze signals are often noisy, requiring interpretation to accurately discern the operator's true intentions. To this end, this study proposes a stabilization module to process raw gaze data. The inferred attention heatmap is utilized as a region proposal to aid segmentation and serve as a trigger signal when the operator needs to adjust the scanning target, such as when a bifurcation appears. To ensure appropriate contact between the probe and surface during scanning, an automatic ultrasound confidence-based orientation correction method is developed. In experiments, we demonstrated the efficiency of the proposed gaze-guided segmentation pipeline by comparing it with other methods. Besides, the performance of the proposed gaze-guided RUSS was also validated as a whole on a realistic arm phantom with an uneven surface.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑