解剖学约束在虚拟试穿中的重要性
Significance of Anatomical Constraints in Virtual Try-On
AI总结:
针对虚拟试穿中手臂弯曲交叉及姿态差异导致的服装变形不准问题,提出人体解剖感知几何变换与基于部件的变形方法,有效解决了TPS变换的弯曲限制与服装重叠建模问题。
摘要:
虚拟试穿(Virtual Try-ON, VTON)系统允许用户虚拟地试穿产品。通常,VTON系统接收服装源图像和人物图像,以预测该人物穿着指定服装的试穿输出。尽管现有方法在简单姿态下表现良好,但在手臂弯曲或交叉的姿态下,或者当源服装的对齐与目标人物的姿态之间存在显著差异时,这些方法会因生成不准确的服装变形而失败。在采用基于薄板样条(Thin Plate Spline, TPS)的服装变换的VTON方法中,这主要由于两个原因:(1)TPS的二阶平滑约束限制了物体平面的弯曲。(2)不同服装部分(例如袖子和躯干)之间的重叠无法通过单一的TPS变换来建模,因为它将服装假设为单一平面物体;因此忽略了不同服装部分运动的独立性。为此,我们做出了两项主要贡献。针对TPS的弯曲限制,我们提出了一种人体解剖感知几何(AnaTomy-Aware Geometric, ATAG)变换。针对重叠问题,我们提出了一种基于部件的变形方法,将服装划分为可独立变形的部件,分别进行变形后再将它们组合。广泛的分析证明了该方法的有效性。
英文摘要:
The system of Virtual Try-ON (VTON) allows a user to try a product virtually. In general, a VTON system takes a clothing source and a person's image to predict the try-on output of the person in the given clothing. Although existing methods perform well for simple poses, in case of bent or crossed arms posture or when there is a significant difference between the alignment of the source clothing and the pose of the target person, these methods fail by generating inaccurate clothing deformations. In the VTON methods that employ Thin Plate Spline (TPS) based clothing transformations, this mainly occurs for two reasons - (1)~the second-order smoothness constraint of TPS that restricts the bending of the object plane. (2)~Overlaps among different clothing parts (e.g., sleeves and torso) can not be modeled by a single TPS transformation, as it assumes the clothing as a single planar object; therefore, disregards the independence of movement of different clothing parts. To this end, we make two major contributions. Concerning the bending limitations of TPS, we propose a human AnaTomy-Aware Geometric (ATAG) transformation. Regarding the overlap issue, we propose a part-based warping approach that divides the clothing into independently warpable parts to warp them separately and later combine them. Extensive analysis shows the efficacy of this approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。