arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.18955cs.CV

真实人脸视频动画平台

Real Face Video Animation Platform

Harbin Institute of Technology(哈尔滨工业大学);Li Auto(理想汽车);Space AI(星纪元智能)

Xiaokai Chen, Xuan Liu, Donglin Di, Yongjia Ma, Wei Chen, Tonghua Su

AI总结:

针对现有模型生成夸张动漫风格人脸表现力不足的问题,提出基于Gradio的真实人脸视频动画平台,支持多模型实时将真实人脸转换为动漫风格,并利用多模型处理HDTF数据集构建了动漫人脸视频数据集。

摘要:

近年来,人脸视频生成模型日益普及。然而,由于缺乏高质量的动漫风格人脸训练集,这些模型在处理夸张的动漫风格人脸时往往缺乏表现力。我们提出了一种人脸动画平台,支持实时将真实人脸转换为卡通风格人脸,并支持多种模型。基于Gradio框架构建,我们的平台确保了出色的交互性和用户友好性。用户可以输入真实人脸视频或图像,并选择所需的卡通风格。系统随后将自动分析人脸特征,执行必要的预处理,并调用合适的模型来生成富有表现力的动漫风格人脸。我们在系统内采用了多种模型来处理HDTF数据集,从而创建了动漫人脸视频数据集。

英文摘要:

In recent years, facial video generation models have gained popularity. However, these models often lack expressive power when dealing with exaggerated anime-style faces due to the absence of high-quality anime-style face training sets. We propose a facial animation platform that enables real-time conversion from real human faces to cartoon-style faces, supporting multiple models. Built on the Gradio framework, our platform ensures excellent interactivity and user-friendliness. Users can input a real face video or image and select their desired cartoon style. The system will then automatically analyze facial features, execute necessary preprocessing, and invoke appropriate models to generate expressive anime-style faces. We employ a variety of models within our system to process the HDTF dataset, thereby creating an animated facial video dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑