arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.20397cs.CV
收藏

高斯应置于何处?面向预算受限的CT电影渲染高斯溅射的可复用标签感知分配

Where Should the Gaussians Go? Reusable Label-Aware Allocation for Budget-Constrained Gaussian Splatting of Cinematic CT

Vanderbilt University(范德堡大学)

Bowen Xiang, Dingjie Su, Jon S. Heiselman, Michael I. Miga

AI总结:

该研究针对预算受限的CT电影渲染高斯溅射,提出可复用的标签感知分配前端,其性能接近逐患者优化分配,在血管PSNR上优于均匀分配和修剪密集模型,且作为初始化可缩短优化时间。

摘要:

解剖标签可辅助3D高斯溅射在CT的电影渲染中保留血管,但该表示仍需通过优化每位患者的场景来确定,其中致密化操作决定高斯的放置位置,而实时显示对高斯数量设有限制。我们解决该流程中的一个环节:确定固定数量B的高斯应放置的位置。我们提出一种可复用的标签感知分配前端,其将患者的CT、标签和传递函数映射到2mm单元上的密度分布,并从中精确抽取B个位置,无需进行逐患者优化;高斯的其他属性仍需逐患者拟合。该前端通过从逐患者优化场景中学习得到,实现为经群体训练的神经先验和可解释的七参数可见性感知闭式函数(VACF)。在20位保留患者上,以10K至100K个高斯进行相同属性拟合时,两种方法均使血管掩码PSNR较均匀分配提升4.5至7.1dB,较修剪密集体素对齐模型提升1.6至3.3dB。在任意预算下,神经先验与逐患者优化分配无显著差异,VACF在血管指标上与神经先验的差距在0.6dB以内;在19位外部患者上,神经先验在血管指标上仍与逐患者优化分配匹配,VACF的差距在0.7dB以内。作为位置优化的初始化,VACF分配在10K个高斯时的血管指标优于逐患者致密化,在25K个高斯时,经118秒优化后达到的血管PSNR高于致密化经248秒优化后的结果。在改变渲染预设时,VACF可迁移至新的颜色和光照,但无法迁移至无标签的传递函数,而神经先验则呈现相反的模式。

英文摘要:

Anatomical labels help 3D Gaussian splatting preserve vessels in cinematic renderings of CT, but the representation is still found by optimising each patient's scene, where densification decides where Gaussians go, while real-time displays cap their number. We address one part of this process: deciding where a fixed budget of B Gaussians should be placed. We propose a reusable, labelaware allocation front end that maps a patient's CT, labels and transfer function to a density over 2mm cells and draws exactly B positions from it without per-patient optimisation; the other Gaussian attributes are still fitted per patient. The front end is learned once from per-patient optimised scenes and implemented as a population-trained neural prior and an interpretable seven-parameter visibility-aware closed form (VACF). With identical attribute fitting on 20 held-out patients at 10K-100K Gaussians, both raise vessel-masked PSNR over uniform allocation by 4.5-7.1dB and over pruning a dense voxel-aligned model by 1.6-3.3dB. The neural prior does not differ significantly from per-patient optimised allocation at any budget, and VACF is within 0.6dB of it on vessels; on 19 external patients the neural prior again matches it on vessels and VACF is within 0.7dB. As an initialisation for position optimisation, VACF allocation beats per-patient densification on vessels at 10K Gaussians and, at 25K, reaches a higher vessel PSNR after 118s of optimisation than densification after 248s. Under altered rendering presets, VACF transfers to new colours and lighting but not to a label-free transfer function, whereas the neural prior shows the opposite pattern.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑