SerpentFlow: 通过共享结构分解实现生成性无配对域对齐
SerpentFlow: Generative Unpaired Domain Alignment via Shared-Structure Decomposition
AI总结:
SerpentFlow通过共享结构分解实现无配对域对齐,利用生成模型生成伪配对以学习目标域的条件分布。
摘要:
域对齐广义上指的是学习不同领域数据分布之间的对应关系。在本工作中,我们关注一种设定,即尽管领域之间存在差异,但它们共享底层的结构模式。该任务在缺乏配对观测的情况下尤为具有挑战性,因为这会移除领域之间的直接监督。我们引入了一个生成框架,称为SerpentFlow(SharEd-structuRe decomPosition for gEnerative domaiN adapTation),用于无配对域对齐。SerpentFlow将潜在空间中的数据分解为一个共享组件和一个领域特定的组件。通过隔离共享结构并将领域特定组件替换为随机噪声,我们构建了共享表示与目标领域样本之间的合成训练对,从而能够利用传统上仅限于配对设置的条件生成模型。我们将这种方法应用于超分辨率任务,其中共享组件自然对应于低频内容,而高频细节捕捉领域特定的变异性。低频和高频组件之间的截止频率通过分类器基于的标准自动确定,确保了数据驱动和领域适应的分解。通过生成伪对,保留低频结构并注入随机的高频实现,我们学习了给定共享表示的目标域的条件分布。我们使用流匹配作为生成管道实现SerpentFlow,尽管该框架兼容其他条件生成方法。在合成图像、物理过程模拟和气候降尺度任务上的实验表明,该方法有效地重建了与底层低频模式一致的高频结构,支持共享结构分解作为无配对域对齐的有效策略。
英文摘要:
Domain alignment refers broadly to learning correspondences between data distributions from distinct domains. In this work, we focus on a setting where domains share underlying structural patterns despite differences in their specific realizations. The task is particularly challenging in the absence of paired observations, which removes direct supervision across domains. We introduce a generative framework, called SerpentFlow (SharEd-structuRe decomPosition for gEnerative domaiN adapTation), for unpaired domain alignment. SerpentFlow decomposes data within a latent space into a shared component common to both domains and a domain-specific one. By isolating the shared structure and replacing the domain-specific component with stochastic noise, we construct synthetic training pairs between shared representations and target-domain samples, thereby enabling the use of conditional generative models that are traditionally restricted to paired settings. We apply this approach to super-resolution tasks, where the shared component naturally corresponds to low-frequency content while high-frequency details capture domain-specific variability. The cutoff frequency separating low- and high-frequency components is determined automatically using a classifier-based criterion, ensuring a data-driven and domain-adaptive decomposition. By generating pseudo-pairs that preserve low-frequency structures while injecting stochastic high-frequency realizations, we learn the conditional distribution of the target domain given the shared representation. We implement SerpentFlow using Flow Matching as the generative pipeline, although the framework is compatible with other conditional generative approaches. Experiments on synthetic images, physical process simulations, and a climate downscaling task demonstrate that the method effectively reconstructs high-frequency structures consistent with underlying low-frequency patterns, supporting shared-structure decomposition as an effective strategy for unpaired domain alignment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。