arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.02518cs.CVeess.IV

DDGS-CT: 用于真实感体绘制的方向解耦高斯溅射

DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Rendering

United Imaging Intelligence(联影智能)

Zhongpai Gao, Benjamin Planche, Meng Zheng, Xiao Chen, Terrence Chen, Ziyan Wu

AI总结:

针对传统DRR术中应用的计算瓶颈与各向异性成像缺失问题,提出方向解耦3D高斯溅射方法DDGS-CT,分离辐射度分量适配CT数据,实现高效可微的真实感DRR生成,图像精度与配准性能均优于现有方法。

摘要:

数字重建放射影像(DRR)是从3D CT体数据生成的模拟2D X射线图像,广泛应用于术前场景,但因计算瓶颈限制了术中应用,尤其是准确但计算量大的基于物理的蒙特卡洛方法。尽管解析型DRR渲染器效率更高,但它们忽略了各向异性的X射线成像现象,例如康普顿散射。我们提出一种新颖方法,将受物理启发的真实感X射线模拟与基于3D高斯溅射(3DGS)的高效可微DRR生成相结合。我们的方向解耦3DGS(DDGS)方法将辐射度贡献分离为各向同性分量和方向相关分量,无需复杂的运行时模拟即可近似复杂的各向异性相互作用。此外,我们调整了3DGS初始化以适配断层扫描数据特性,提升了准确性和效率。我们的方法在图像准确性上优于现有最优技术。此外,我们的DDGS在术中应用以及位姿配准等逆问题中展现出应用前景,与解析型DRR方法相比,提供了更优的配准准确性和运行时性能。

英文摘要:

Digitally reconstructed radiographs (DRRs) are simulated 2D X-ray images generated from 3D CT volumes, widely used in preoperative settings but limited in intraoperative applications due to computational bottlenecks, especially for accurate but heavy physics-based Monte Carlo methods. While analytical DRR renderers offer greater efficiency, they overlook anisotropic X-ray image formation phenomena, such as Compton scattering. We present a novel approach that marries realistic physics-inspired X-ray simulation with efficient, differentiable DRR generation using 3D Gaussian splatting (3DGS). Our direction-disentangled 3DGS (DDGS) method separates the radiosity contribution into isotropic and direction-dependent components, approximating complex anisotropic interactions without intricate runtime simulations. Additionally, we adapt the 3DGS initialization to account for tomography data properties, enhancing accuracy and efficiency. Our method outperforms state-of-the-art techniques in image accuracy. Furthermore, our DDGS shows promise for intraoperative applications and inverse problems such as pose registration, delivering superior registration accuracy and runtime performance compared to analytical DRR methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑