用于显微内镜拼接和3D融合的自主扫描
Autonomous Scanning for Endomicroscopic Mosaicing and 3D Fusion
摘要:
机器人辅助微创手术(RMIS)可以受益于常见的,重复的或定义明确但符合人体工程学的困难任务的自动化。一个这样的任务是在复杂的、起伏的组织表面上扫描拾取显微内镜探针,以便通过视频拼接来增强有效的视场。在本文中,达芬奇手术机器人,通过dVRK框架,用于自主扫描和2D拼接超过用户定义的感兴趣区域。为了实现高质量大面积马赛克生成所需的精度水平,其依赖于连续图像帧之间的充分重叠,使用附接到探头的跟踪标记来执行视觉伺服。探针运动的亚毫米精度允许在外科医生的最小干预下生成大的显微内镜马赛克。它还允许探头保持在垂直于局部组织表面的方向上,提供最佳的成像结果。图像从内窥镜流出并实时叠加到外科医生的视图上,同时实时生成2D马赛克,并融合到手术场景的3D立体重建中,从而提供直观的可视化和多尺度图像的融合。因此,该系统提供了显着的潜力,以加强外科手术,通过提供操作者与细胞规模的信息在一个更大的区域比通常可以实现手动扫描。
英文摘要:
Robotic-assisted Minimally Invasive Surgery (RMIS) can benefit from the automation of common, repetitive or well-defined but ergonomically difficult tasks. One such task is the scanning of a pick-up endomicroscopy probe over a complex, undulating tissue surface in order to enhance the effective field-of-view through video mosaicing. In this paper, the da Vinci surgical robot, through the dVRK framework, is used for autonomous scanning and 2D mosaicing over a user-defined region of interest. To achieve the level of precision required for high quality large-area mosaic generation, which relies on sufficient overlap between consecutive image frames, visual servoing is performed using a tracking marker attached to the probe. The resulting sub-millimetre accuracy of the probe motion allows for the generation of large endomicroscopy mo- saics with minimal intervention from the surgeon. It also allows the probe to be maintained in an orientation perpendicular to the local tissue surface, providing optimal imaging results. Images are streamed from the endomicroscope and overlaid live onto the surgeons view, while 2D mosaics are generated in real-time, and fused into a 3D stereo reconstruction of the surgical scene, thus providing intuitive visualisation and fusion of the multi-scale images. The system therefore offers significant potential to enhance surgical procedures, by providing the operator with cellular-scale information over a larger area than could typically be achieved by manual scanning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。