arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.14552cs.CV
收藏

OmniVTON++: 无需训练的通用虚拟试衣系统 with 主要姿态引导

OmniVTON++: Training-Free Universal Virtual Try-On with Principal Pose Guidance

Zhaotong Yang, Yong Du, Shengfeng He, Yuhui Li, Xinzhe Li, Yangyang Xu, Junyu Dong, Jian Yang

AI总结:

OmniVTON++是一种无需训练的通用虚拟试衣系统,通过协调结构化服装变形、主要姿态引导和连续边界缝合,实现跨数据集和服装类型的高性能虚拟试衣。

摘要:

基于图像的虚拟试衣(VTON)关注通过服装重绘在人体姿态和身体约束下合成逼真的人物图像。然而,现有方法通常针对特定数据条件进行优化,使其部署依赖于重新训练,限制了其作为统一解决方案的泛化能力。我们提出了OmniVTON++,一种无需训练的VTON框架,旨在实现通用应用。它通过协调结构化服装变形用于对应驱动的服装适应、主要姿态引导用于扩散采样过程中的逐步结构调节,以及连续边界缝合用于边界感知的细化,解决服装对齐、人体结构连贯性和边界连续性交织的挑战,形成一个无需任务特定重新训练的完整流程。实验结果表明,OmniVTON++在多样化的泛化设置中实现了最先进的性能,包括跨数据集和跨服装类型的评估,同时在单一公式内可靠地运行于各种场景和扩散后端。除了单件服装、单人案例外,该框架还支持多件服装、多人和动漫角色的虚拟试衣,扩展了虚拟试衣的应用范围。代码可在https://github.com/Jerome-Young/OmniVTON-PlusPlus获取。

英文摘要:

Image-based Virtual Try-On (VTON) concerns the synthesis of realistic person imagery through garment re-rendering under human pose and body constraints. In practice, however, existing approaches are typically optimized for specific data conditions, making their deployment reliant on retraining and limiting their generalization as a unified solution. We present OmniVTON++, a training-free VTON framework designed for universal applicability. It addresses the intertwined challenges of garment alignment, human structural coherence, and boundary continuity by coordinating Structured Garment Morphing for correspondence-driven garment adaptation, Principal Pose Guidance for step-wise structural regulation during diffusion sampling, and Continuous Boundary Stitching for boundary-aware refinement, forming a cohesive pipeline without task-specific retraining. Experimental results demonstrate that OmniVTON++ achieves state-of-the-art performance across diverse generalization settings, including cross-dataset and cross-garment-type evaluations, while reliably operating across scenarios and diffusion backbones within a single formulation. In addition to single-garment, single-human cases, the framework supports multi-garment, multi-human, and anime character virtual try-on, expanding the scope of virtual try-on applications. The code is available at https://github.com/Jerome-Young/OmniVTON-PlusPlus.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑