多摄像头无影灯下开放式手术的干扰自由视频生成
Disturbance-Free Surgical Video Generation from Multi-Camera Shadowless Lamps for Open Surgery
AI总结：
本文提出了一种自动化方法，通过识别照明系统移动并重新对齐视频帧，生成无遮挡的开放式手术视频，提升手术区域的可视化效果和观看舒适度。
摘要：
开放式手术的视频记录对于教育和研究具有重要需求。然而，由于外科医生经常阻挡摄像机的视野，捕捉无遮挡的视频极具挑战性。为了避免遮挡，摄像机的位置和角度必须频繁调整，这非常耗费人力。先前的工作通过在无影灯上安装多个摄像头并安排它们完全环绕手术区域来解决这一问题。这种设置增加了某些摄像头能够捕捉无遮挡视角的可能性。然而，由于每次外科医生移动灯以获得最佳照明时，摄像机配置都会变化，因此需要在后期处理中进行手动图像对齐。本文旨在完全自动化这一对齐任务。所提出的方法识别出照明系统移动的帧，重新对齐它们，并选择遮挡最少的摄像机以生成一个始终从固定视角呈现手术区域的视频。一项涉及外科医生的用户研究显示，由我们方法生成的视频在确认手术区域的便利性和视频观看的舒适性方面优于传统方法生成的视频。此外，我们的方法在视频质量上也优于现有技术。此外，我们为所提出的视图合成方法实现了几种合成选项，并进行了用户研究以评估外科医生对每个选项的偏好。
英文摘要：
Video recordings of open surgeries are greatly required for education and research purposes. However, capturing unobstructed videos is challenging since surgeons frequently block the camera field of view. To avoid occlusion, the positions and angles of the camera must be frequently adjusted, which is highly labor-intensive. Prior work has addressed this issue by installing multiple cameras on a shadowless lamp and arranging them to fully surround the surgical area. This setup increases the chances of some cameras capturing an unobstructed view. However, manual image alignment is needed in post-processing since camera configurations change every time surgeons move the lamp for optimal lighting. This paper aims to fully automate this alignment task. The proposed method identifies frames in which the lighting system moves, realigns them, and selects the camera with the least occlusion to generate a video that consistently presents the surgical field from a fixed perspective. A user study involving surgeons demonstrated that videos generated by our method were superior to those produced by conventional methods in terms of the ease of confirming the surgical area and the comfort during video viewing. Additionally, our approach showed improvements in video quality over existing techniques. Furthermore, we implemented several synthesis options for the proposed view-synthesis method and conducted a user study to assess surgeons' preferences for each option.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
