arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.00209eess.IVcs.AIcs.CVcs.RO

SurgiSR4K:一种用于机器人辅助微创手术的高分辨率内窥镜视频数据集

SurgiSR4K: A High-Resolution Endoscopic Video Dataset for Robotic-Assisted Minimally Invasive Procedures

Intuitive Surgical, Inc.(Intuitive Surgical公司);Johns Hopkins Medicine Neurosurgery(约翰霍普金斯医学神经外科);Johns Hopkins University Electrical and Computer Engineering(约翰霍普金斯大学电气与计算机工程);University of British Columbia Electrical and Computer Engineering(不列颠哥伦比亚大学电气与计算机工程);Wilford & Kate Bailey Small Animal Teaching Hospital(威尔福德与凯蒂·贝利小动物教学医院)
Fengyi Jiang, Xiaorui Zhang, Lingbo Jin, Ruixing Liang, Yuxin Chen, Adi Chola Venkatesh, Jason Culman, Tiantian Wu, Lirong Shao, Wenqing Sun, Cong Gao, Hallie M… 展开作者

Fengyi Jiang, Xiaorui Zhang, Lingbo Jin, Ruixing Liang, Yuxin Chen, Adi Chola Venkatesh, Jason Culman, Tiantian Wu, Lirong Shao, Wenqing Sun, Cong Gao, Hallie McNamara, Jingpei Lu, Omid Mohareri

AI总结:

本文提出SurgiSR4K数据集,用于提升微创手术的视觉清晰度和计算机辅助导航精度,包含4K分辨率的手术视频,涵盖镜面反射、工具遮挡等挑战性场景,支持超分辨率、烟雾去除等多任务研究。

摘要:

高分辨率成像对于提高微创手术(MIS)的视觉清晰度和实现精确的计算机辅助导航至关重要。尽管4K内窥镜系统日益普及,但公开可用的原生4K数据集在机器人辅助MIS中仍存在显著空白。我们引入SurgiSR4K,这是首个公开的手术成像和视频数据集,以原生4K分辨率捕获,代表了机器人辅助手术的真实条件。SurgiSR4K包含多样化的视觉场景,包括镜面反射、工具遮挡、出血和软组织变形,精心设计以反映腹腔镜和机器人手术中常见的挑战。该数据集为一系列可能从高分辨率数据中受益的计算机视觉任务提供了可能,如超分辨率(SR)、烟雾去除、手术工具检测、3D组织重建、单目深度估计、实例分割、新视角合成和视觉-语言模型(VLM)开发。SurgiSR4K为高分辨率手术成像的研究进步提供了坚实基础,并促进智能成像技术的发展,以提高图像引导机器人手术的性能、安全性和可用性。

英文摘要:

High-resolution imaging is crucial for enhancing visual clarity and enabling precise computer-assisted guidance in minimally invasive surgery (MIS). Despite the increasing adoption of 4K endoscopic systems, there remains a significant gap in publicly available native 4K datasets tailored specifically for robotic-assisted MIS. We introduce SurgiSR4K, the first publicly accessible surgical imaging and video dataset captured at a native 4K resolution, representing realistic conditions of robotic-assisted procedures. SurgiSR4K comprises diverse visual scenarios including specular reflections, tool occlusions, bleeding, and soft tissue deformations, meticulously designed to reflect common challenges faced during laparoscopic and robotic surgeries. This dataset opens up possibilities for a broad range of computer vision tasks that might benefit from high resolution data, such as super resolution (SR), smoke removal, surgical instrument detection, 3D tissue reconstruction, monocular depth estimation, instance segmentation, novel view synthesis, and vision-language model (VLM) development. SurgiSR4K provides a robust foundation for advancing research in high-resolution surgical imaging and fosters the development of intelligent imaging technologies aimed at enhancing performance, safety, and usability in image-guided robotic surgeries.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑