arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.03243cs.CV
收藏

RSDNet:学习从无手动注释的腹腔镜视频中预测剩余手术持续时间

RSDNet: Learning to Predict Remaining Surgery Duration from Laparoscopic Videos Without Manual Annotations

ICube(ICube实验室);University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);IHU Strasbourg(斯特拉斯堡大学医院研究所);University Hospital of Strasbourg(斯特拉斯堡大学医院);IRCAD(法国消化外科研究所)

Andru Putra Twinanda, Gaurav Yengera, Didier Mutter, Jacques Marescaux, Nicolas Padoy

摘要:

准确的手术时间估计是优化手术室规划的必要条件,对患者的舒适性和安全性以及资源优化起着重要作用。然而,术前预测手术持续时间具有挑战性,因为它取决于患者状况、外科医生技能和术中情况。在本文中,我们提出了一个深度学习管道,称为RSDNet,它只使用来自腹腔镜视频的视觉信息,在术中自动估计剩余手术时间(RSD)。先前用于RSD预测的最先进方法依赖于手动注释,其生成需要昂贵的专业知识并且耗时,特别是考虑到在医院中进行的多种类型的手术和大量可用的腹腔镜视频。RSDNet的一个关键特性是,它在训练过程中不依赖任何手动注释,因此可以轻松扩展到多种手术。通过在包含不同类型手术的两个大型数据集上测试管道,证明了我们方法的普遍性:120个胆囊切除术和170个胃旁路手术视频。实验结果还表明,所提出的网络显着优于传统的方法估计RSD不利用人工注释。此外,这项工作通过对自动学习的特征的可视化和解释,提供了对深度学习网络的更深入了解。

英文摘要:

Accurate surgery duration estimation is necessary for optimal OR planning, which plays an important role in patient comfort and safety as well as resource optimization. It is, however, challenging to preoperatively predict surgery duration since it varies significantly depending on the patient condition, surgeon skills, and intraoperative situation. In this paper, we propose a deep learning pipeline, referred to as RSDNet, which automatically estimates the remaining surgery duration (RSD) intraoperatively by using only visual information from laparoscopic videos. Previous state-of-the-art approaches for RSD prediction are dependent on manual annotation, whose generation requires expensive expert knowledge and is time-consuming, especially considering the numerous types of surgeries performed in a hospital and the large number of laparoscopic videos available. A crucial feature of RSDNet is that it does not depend on any manual annotation during training, making it easily scalable to many kinds of surgeries. The generalizability of our approach is demonstrated by testing the pipeline on two large datasets containing different types of surgeries: 120 cholecystectomy and 170 gastric bypass videos. The experimental results also show that the proposed network significantly outperforms a traditional method of estimating RSD without utilizing manual annotation. Further, this work provides a deeper insight into the deep learning network through visualization and interpretation of the features that are automatically learned.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑