arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.00985cs.CV

纹理-形状困境:面向3D医学变换器的边界安全合成生成

The Texture-Shape Dilemma: Boundary-Safe Synthetic Generation for 3D Medical Transformers

Peking University(北京大学);Central South University(中南大学);Deepwise Ltd.(深域科技)

Jiaqi Tang, Weixuan Xu, Shu Zhang, Fandong Zhang, Qingchao Chen

AI总结:

本文提出一种物理启发式的空间解耦合成框架,解决3D医学变换器中纹理与形状之间的矛盾,提升模型对真实解剖边缘的识别能力。

摘要:

视觉变换器(ViTs)已彻底改变了医学图像分析,但其数据饥渴的特性与临床档案的稀缺性和隐私约束相冲突。公式驱动的监督学习(FDSL)作为一种有前途的解决方案,通过数学公式生成无限标注样本而不使用真实患者数据。然而,现有FDSL范式依赖于简单的几何形状和均匀强度,通过忽视CT和MRI等模态中固有的组织纹理和噪声模式,造成了显著的差距。在本文中,我们识别出一个关键的优化冲突,称为边界混叠:当高频合成纹理被简单地添加时,它们会破坏图像梯度信号,这对于学习结构边界至关重要,导致模型无法区分真实的解剖边缘。为了弥合这一差距,我们提出了一种新的物理启发式的空间解耦合成框架。我们的方法正交化合成过程:首先基于边界距离构建一个梯度屏蔽的缓冲区,以确保稳定的形状学习,然后将物理驱动的光谱纹理注入到物体核心。这种设计有效地协调了稳健的形状表示学习与对采集噪声的不变性。在BTCV和MSD数据集上的大量实验表明,我们的方法在BTCV任务上比之前的FDSL以及在真实世界医学数据集上训练的SSL方法高出1.43%,在MSD任务上高达1.51%,提供了一个可扩展、无标注基础的医学ViTs。代码将在接受后公开发布。

英文摘要:

Vision Transformers (ViTs) have revolutionized medical image analysis, yet their data-hungry nature clashes with the scarcity and privacy constraints of clinical archives. Formula-Driven Supervised Learning (FDSL) has emerged as a promising solution to this bottleneck, synthesizing infinite annotated samples from mathematical formulas without utilizing real patient data. However, existing FDSL paradigms rely on simple geometric shapes with homogeneous intensities, creating a substantial gap by neglecting tissue textures and noise patterns inherent in modalities like CT and MRI. In this paper, we identify a critical optimization conflict termed boundary aliasing: when high-frequency synthetic textures are naively added, they corrupt the image gradient signals necessary for learning structural boundaries, causing the model to fail in delineating real anatomical margins. To bridge this gap, we propose a novel Physics-inspired Spatially-Decoupled Synthesis framework. Our approach orthogonalizes the synthesis process: it first constructs a gradient-shielded buffer zone based on boundary distance to ensure stable shape learning, and subsequently injects physics-driven spectral textures into the object core. This design effectively reconciles robust shape representation learning with invariance to acquisition noise. Extensive experiments on the BTCV and MSD datasets demonstrate that our method significantly outperforms previous FDSL, as well as SSL methods trained on real-world medical datasets, by 1.43% on BTCV and up to 1.51% on MSD task, offering a scalable, annotation-free foundation for medical ViTs. The code will be made publicly available upon acceptance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑