arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.03164cs.CV

在任意地点、以任意姿势合成任意人物

Synthesizing Anyone, Anywhere, in Any Pose

Norwegian University of Science and Technology(挪威科技大学)

Håkon Hukkelås, Frank Lindseth

AI总结:

针对野外人体合成的难点,研究提出关键点引导的TriA-GAN,结合投影GAN与精心训练策略,以更少条件信息实现更优合成效果,且潜空间支持文本引导编辑。

摘要:

我们针对野外人体合成任务展开研究,该任务的核心目标是在任意图像的任意区域生成完整人体。野外人体合成长期以来都是一项颇具挑战性且探索不足的任务,现有方法难以应对极端姿势、遮挡物体以及复杂背景的问题。我们的主要贡献是TriA-GAN,这是一种关键点引导的GAN(生成对抗网络),能够在任意位置、以任意给定姿势合成任意人物。该方法的核心是将projected GANs(投影生成对抗网络)与精心设计的训练策略相结合,凭借简洁的生成器架构成功应对野外全身合成的诸多挑战。实验表明,TriA-GAN的性能显著优于以往的野外全身合成方法,同时合成所需的条件信息更少(仅需关键点,而非DensePose)。最后我们还验证了,TriA-GAN的潜空间兼容标准的无监督编辑技术,可实现对生成人体的文本引导编辑。

英文摘要:

We address the task of in-the-wild human figure synthesis, where the primary goal is to synthesize a full body given any region in any image. In-the-wild human figure synthesis has long been a challenging and under-explored task, where current methods struggle to handle extreme poses, occluding objects, and complex backgrounds. Our main contribution is TriA-GAN, a keypoint-guided GAN that can synthesize Anyone, Anywhere, in Any given pose. Key to our method is projected GANs combined with a well-crafted training strategy, where our simple generator architecture can successfully handle the challenges of in-the-wild full-body synthesis. We show that TriA-GAN significantly improves over previous in-the-wild full-body synthesis methods, all while requiring less conditional information for synthesis (keypoints \vs DensePose). Finally, we show that the latent space of TriA-GAN is compatible with standard unconditional editing techniques, enabling text-guided editing of generated human figures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑