arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.08753cs.CV
收藏

MVAnimate: 通过多视角优化提升角色动画

MVAnimate: Enhancing Character Animation with Multi-View Optimization

College of Computing and Data Science (CCDS), Nanyang Technological University(计算与数据科学学院(CCDS),南洋理工大学);Alibaba Group(阿里巴巴集团)

Tianyu Sun, Zhoujie Fu, Bang Zhang, Guosheng Lin

AI总结:

MVAnimate通过多视角优化提升角色动画质量,结合2D和3D信息生成更逼真且高质量的动画视频。

摘要:

对逼真且多功能角色动画的需求已大幅增长,这主要是由于其在各个领域的广泛应用。然而,建模人体姿态的动画生成算法,无论是基于2D还是3D结构,都面临各种问题,包括输出内容质量低和训练数据不足,这限制了相关算法生成高质量动画视频的能力。因此,我们引入了MVAnimate,这是一种新的框架,基于多视角先验信息综合动态人物的2D和3D信息,以提升生成视频的质量。我们的方法利用多视角先验信息来产生时间一致且空间连贯的动画输出,证明了其优于现有动画方法。此外,我们的MVAnimate还优化了目标人物的多视角视频,从不同视角提升视频质量。在多样化的数据集上的实验结果突显了我们方法在处理各种运动模式和外观方面的鲁棒性。

英文摘要:

The demand for realistic and versatile character animation has surged, driven by its wide-ranging applications in various domains. However, the animation generation algorithms modeling human pose with 2D or 3D structures all face various problems, including low-quality output content and training data deficiency, preventing the related algorithms from generating high-quality animation videos. Therefore, we introduce MVAnimate, a novel framework that synthesizes both 2D and 3D information of dynamic figures based on multi-view prior information, to enhance the generated video quality. Our approach leverages multi-view prior information to produce temporally consistent and spatially coherent animation outputs, demonstrating improvements over existing animation methods. Our MVAnimate also optimizes the multi-view videos of the target character, enhancing the video quality from different views. Experimental results on diverse datasets highlight the robustness of our method in handling various motion patterns and appearances.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑