arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.08115cs.CVcs.LG
收藏

RoHan: 手术室中的鲁棒手部检测

RoHan: Robust Hand Detection in Operation Room

Technion – Israel Institute of Technology(以色列理工学院);Rambam Health Care Campus(兰本医疗中心)

Roi Papo, Sapir Gershov, Tom Friedman, Itay Or, Gil Bolotin, Shlomi Laufer

AI总结:

针对手术场景手部检测标注成本高、域迁移效果差的问题,提出RoHan方法,结合人工手套数据增强和半监督域适应流水线,提升手术室手部检测性能,减少标注与训练需求。

摘要:

手部特定定位已在计算机视觉领域引发广泛关注。尽管存在大量从不同角度、不同场景下采集并带有手部标注的数据集,但域迁移技术在手术环境中往往效果不佳,这主要是因为戴手套的手部样本数量有限,且手术室(OR)存在独特的挑战。因此,适配手术室场景的手部检测模型需要大量训练工作和成本高昂的标注流程。为解决这些难题,我们提出“RoHan”——一种用于手术室鲁棒手部检测的新方法,它利用先进的半监督域适应技术,应对手术场景中常见的录制条件多变、手套颜色多样以及遮挡问题。我们的方法包含两个主要阶段:(1)数据增强策略,采用“Artificial Gloves(人工手套)”方法,通过合成戴手套的手部图像对公开手部数据集进行增强;(2)半监督域适应流水线,通过迭代预测优化和高效帧筛选提升真实手术室场景下的检测性能。我们使用两个数据集评估该方法:模拟肠切开修复数据集和大隐静脉移植采集数据集。RoHan大幅降低了对大量标注和模型训练的需求,为手部检测技术在医疗场景的实际落地铺平了道路。

英文摘要:

Hand-specific localization has garnered significant interest within the computer vision community. Although there are numerous datasets with hand annotations from various angles and settings, domain transfer techniques frequently struggle in surgical environments. This is mainly due to the limited availability of gloved hand instances and the unique challenges of operating rooms (ORs). Thus, hand-detection models tailored to OR settings require extensive training and expensive annotation processes. To overcome these challenges, we present "RoHan" - a novel approach for robust hand detection in the OR, leveraging advanced semi-supervised domain adaptation techniques to tackle the challenges of varying recording conditions, diverse glove colors, and occlusions common in surgical settings. Our methodology encompasses two main stages: (1) data augmentation strategy that utilizes "Artificial Gloves," a method for augmenting publicly available hand datasets with synthetic images of hands-wearing gloves; (2) semi-supervised domain adaptation pipeline that improves detection performance in real-world OR settings through iterative prediction refinement and efficient frame filtering. We evaluate our method using two datasets: simulated enterotomy repair and saphenous vein graft harvesting. "RoHan" substantially reduces the need for extensive labeling and model training, paving the way for the practical implementation of hand detection technologies in medical settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑