arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.03211cs.CVcs.LG
收藏

单视角锥束X射线成像中目标的实时的6D姿态估计

Towards real-time 6D pose estimation of objects in single-view cone-beam X-ray

Eindhoven University of Technology(埃因霍温理工大学);Philips IGT(飞利浦图像引导治疗部门)

Christiaan G. A. Viviers, Joel de Bruijn, Lena Filatova, Peter H. N. de With, Fons van der Sommen

摘要:

基于深度学习的姿态估计算法可以成功地估计图像中物体的姿态,特别是在彩色图像领域。基于X射线图像的深度学习模型的6D对象姿态估计通常使用自定义架构,该自定义架构采用广泛的CAD模型和模拟数据用于训练目的。最近的基于RGB的方法选择使用小数据集来解决姿态估计问题,使得它们对于医学数据几乎不可用的X射线领域更具吸引力。我们改进了现有的基于RGB的模型(SingleShotPose),通过创建仅在真实X射线数据上训练并针对X射线采集几何结构进行调整的通用解决方案,从灰度X射线图像中估计标记立方体的6D姿态。该模型使用Perspective-n-Point(PSPs)回归2D控制点并通过2D/3D对应关系计算姿势,允许在所有支持的基于锥束的X射线几何结构中使用单个训练模型。由于现代X射线系统在手术期间连续地调整采集参数,因此这种姿态估计网络必须考虑这些参数,以便成功部署并找到真实用例。5 cm/5度精度为93%,平均3D旋转误差为2.2度,所提出的方法的结果与最先进的替代方案相当,同时需要的真实训练样本明显较少,并且适用于实时的【形】应用。

英文摘要:

Deep learning-based pose estimation algorithms can successfully estimate the pose of objects in an image, especially in the field of color images. 6D Object pose estimation based on deep learning models for X-ray images often use custom architectures that employ extensive CAD models and simulated data for training purposes. Recent RGB-based methods opt to solve pose estimation problems using small datasets, making them more attractive for the X-ray domain where medical data is scarcely available. We refine an existing RGB-based model (SingleShotPose) to estimate the 6D pose of a marked cube from grayscale X-ray images by creating a generic solution trained on only real X-ray data and adjusted for X-ray acquisition geometry. The model regresses 2D control points and calculates the pose through 2D/3D correspondences using Perspective-n-Point(PnP), allowing a single trained model to be used across all supporting cone-beam-based X-ray geometries. Since modern X-ray systems continuously adjust acquisition parameters during a procedure, it is essential for such a pose estimation network to consider these parameters in order to be deployed successfully and find a real use case. With a 5-cm/5-degree accuracy of 93% and an average 3D rotation error of 2.2 degrees, the results of the proposed approach are comparable with state-of-the-art alternatives, while requiring significantly less real training examples and being applicable in real-time applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑