EgoSurgery-Tool：一个来自第一视角开放手术视频的手术工具与手部检测数据集
EgoSurgery-Tool: A Dataset of Surgical Tool and Hand Detection from Egocentric Open Surgery Videos
AI总结：
针对第一视角开放手术视频中手术工具检测的类别不平衡、形状纹理相似等挑战及数据集缺乏问题，提出EgoSurgery-Tool扩展数据集，含49K+工具和46K+手部边界框，用9种检测器分析其有效性，性能优于现有数据集。
摘要：
手术工具检测是理解第一视角开放手术视频的基础任务。然而，由于手术工具存在高度不平衡的类别分布、相似的形状和纹理以及严重的遮挡问题，检测手术工具面临重大挑战。缺乏全面的大规模数据集进一步加剧了这些挑战。在本文中，我们介绍EgoSurgery-Tool，它是现有EgoSurgery-Phase数据集的扩展，包含使用附着在外科医生头部的第一视角相机拍摄的真实开放手术视频以及阶段注释。EgoSurgery-Tool对手术工具进行了密集注释，涵盖15个类别，包含超过49K个手术工具边界框，构成了一个大规模手术工具检测数据集。该数据集还提供手部检测注释，包含超过46K个手部边界框，捕捉对理解第一视角开放手术活动至关重要的手-物交互。EgoSurgery-Tool凭借其更大的规模、更多样的手术工具、更多的注释和更密集的场景，优于现有数据集。我们使用九种流行的目标检测器对EgoSurgery-Tool进行了全面分析，以评估它们在手术工具和手部检测中的有效性。该数据集将在https://github.com/Fujiry0/EgoSurgery发布。
英文摘要：
Surgical tool detection is a fundamental task for understanding egocentric open surgery videos. However, detecting surgical tools presents significant challenges due to their highly imbalanced class distribution, similar shapes and similar textures, and heavy occlusion. The lack of a comprehensive large-scale dataset compounds these challenges. In this paper, we introduce EgoSurgery-Tool, an extension of the existing EgoSurgery-Phase dataset, which contains real open surgery videos captured using an egocentric camera attached to the surgeon's head, along with phase annotations. EgoSurgery-Tool has been densely annotated with surgical tools and comprises over 49K surgical tool bounding boxes across 15 categories, constituting a large-scale surgical tool detection dataset. EgoSurgery-Tool also provides annotations for hand detection with over 46K hand-bounding boxes, capturing hand-object interactions that are crucial for understanding activities in egocentric open surgery. EgoSurgery-Tool is superior to existing datasets due to its larger scale, greater variety of surgical tools, more annotations, and denser scenes. We conduct a comprehensive analysis of EgoSurgery-Tool using nine popular object detectors to assess their effectiveness in both surgical tool and hand detection. The dataset will be released at https://github.com/Fujiry0/EgoSurgery.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
