arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.02468cs.CV
收藏

通过边缘计算从笔记本电脑摄像头生成高保真人类虚拟形象

High-Fidelity Human Avatars from Laptop Webcams using Edge Compute

Akash Haridas, Imran N. Junejo

AI总结:

本文提出基于3D可变形模型、关键点检测、逼真纹理GAN和可微渲染的方法,利用笔记本电脑摄像头和边缘计算生成高保真可动画虚拟形象,克服了传统高分辨率相机和服务器计算的限制。

摘要:

本文提出基于3D可变形模型、关键点检测、逼真纹理GAN和可微渲染的方法,利用笔记本电脑摄像头和边缘计算生成高保真可动画虚拟形象,克服了传统高分辨率相机和服务器计算的限制。

英文摘要:

Photo-realistic human avatars have broad applications, yet high-fidelity avatar generation has traditionally required expensive professional camera rigs and extensive artistic labor. Recent research has enabled constructing them automatically from smartphones with RGB and IR sensors, however, these new methods still rely on high-resolution cameras on modern smartphones and often require offloading the processing to powerful servers with GPUs. Modern applications such as video conferencing call for the ability to generate these avatars from consumer-grade laptop webcams using limited compute available on-device. In this work, we develop a novel method based on 3D morphable models, landmark detection, photorealistic texture GANs, and differentiable rendering to tackle the problem of low webcam image quality and edge computation. We build an automatic system to generate high-fidelity animatable avatars under these limitations, leveraging the compute capabilities of AMD mobile processors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑