arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.18357cs.RO
收藏

使用GAN进行针分割:恢复机器人超声中细薄器械的可见性

Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound

Technical University of Munich(慕尼黑工业大学);Klinikum rechts der Isar(右侧伊萨尔医院);DZHK (German Centre for Cardiovascular Research)(德国心血管研究中心);Shanghai Tongji Hospital(上海同济医院);Tongji University School of Medicine(同济大学医学院);The Chinese University of Hong Kong(香港中文大学);Multi-scale Medical Robotics Centre(多尺度医学机器人中心)

Zhongliang Jiang, Xuesong Li, Xiangyu Chu, Angelos Karlas, Yuan Bi, Yingsheng Cheng, K. W. Samuel Au, Nassir Navab

AI总结:

本研究提出一种机器人辅助超声成像系统,利用GAN对抗结构生成精确的针分割掩码,并在探头错位时通过机器人横向搜索自主恢复穿刺针可见性,实验验证了其高精度与有效性。

摘要:

超声引导下经皮穿刺是临床活检和消融中采用的标准程序。然而,由于组织与器械之间复杂的相互作用,穿刺针可能偏离平面内视野,导致缺乏对经皮穿刺针的密切监测。为了应对这一挑战,我们引入了一种机器人辅助超声(US)成像系统,旨在无缝监测插入过程,并在发生错位时自主恢复插入器械的可见性。为此,我们提出了对抗结构,以鼓励生成在高阶空间中与真实标签一致对齐的分割掩码。本研究还系统地探讨了各种训练损失函数及其组合对分割性能的影响。当检测到探头与经皮穿刺针之间存在错位时,触发机器人执行横向搜索,以优化位置和旋转调整,从而恢复穿刺针的可见性。在离体猪样本上的实验结果表明,所提出的方法能够精确分割经皮穿刺针(尖端误差为 $0.37\pm0.29mm$,角度误差为 $1.19\pm 0.29^{\circ}$)。此外,在所有45次试验中,重新定位的探头姿态下均能成功恢复穿刺针的外观,重新定位误差为 $1.51\pm0.95mm$ 和 $1.25\pm0.79^{\circ}$。

英文摘要:

Ultrasound-guided percutaneous needle insertion is a standard procedure employed in both biopsy and ablation in clinical practices. However, due to the complex interaction between tissue and instrument, the needle may deviate from the in-plane view, resulting in a lack of close monitoring of the percutaneous needle. To address this challenge, we introduce a robot-assisted ultrasound (US) imaging system designed to seamlessly monitor the insertion process and autonomously restore the visibility of the inserted instrument when misalignment happens. To this end, the adversarial structure is presented to encourage the generation of segmentation masks that align consistently with the ground truth in high-order space. This study also systematically investigates the effects on segmentation performance by exploring various training loss functions and their combinations. When misalignment between the probe and the percutaneous needle is detected, the robot is triggered to perform transverse searching to optimize the positional and rotational adjustment to restore needle visibility. The experimental results on ex-vivo porcine samples demonstrate that the proposed method can precisely segment the percutaneous needle (with a tip error of $0.37\pm0.29mm$ and an angle error of $1.19\pm 0.29^{\circ}$). Furthermore, the needle appearance can be successfully restored under the repositioned probe pose in all 45 trials, with repositioning errors of $1.51\pm0.95mm$ and $1.25\pm0.79^{\circ}$. from latex to text with math symbols

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑