Artemis：具备外观与运动合成能力的关节式神经宠物
Artemis: Articulated Neural Pets with Appearance and Motion synthesis
AI总结：
本文提出 ARTEMIS 神经建模与渲染流水线，结合八叉树表示、体渲染、着色网络及运动捕捉与神经角色控制，实现毛茸茸动物的实时交互动画与照片级真实渲染。
摘要：
我们人类正进入一个虚拟时代，并且确实也希望将动物带入虚拟世界以作陪伴。然而，计算机生成（CGI）的毛茸茸动物受到繁琐离线渲染的限制，更不用说交互式运动控制。本文提出 ARTEMIS，这是一种新颖的神经建模与渲染流水线，用于生成具备外观与运动合成能力的关节式神经宠物（ARTiculated neural pets with appEarance and Motion synthesIS）。我们的 ARTEMIS 支持对毛茸茸动物进行交互式运动控制、实时动画和照片级真实感渲染。ARTEMIS 的核心是一个神经生成（NGI）动物引擎，它采用高效的基于八叉树的表示来进行动物动画与毛发渲染。此时，动画等价于基于显式骨骼翘曲的体素级变形。我们进一步使用快速八叉树索引和高效的体渲染方案来生成外观与密度特征图。最后，我们提出一种新颖的着色网络，根据外观与密度特征图，在新姿态下生成高保真的外观细节和不透明度。对于 ARTEMIS 中的运动控制模块，我们将最先进的动物运动捕捉方法与近期的神经角色控制方案相结合。我们引入一种有效的优化方案，以重建由多视角 RGB 和 Vicon 相机阵列捕捉的真实动物的骨骼运动。我们将所有捕捉到的运动输入神经角色控制方案，以生成带有运动风格的抽象控制信号。我们还将 ARTEMIS 集成到支持 VR 头显的现有引擎中，提供前所未有的沉浸式体验：用户可以与多种具有生动动作和照片级真实外观的虚拟动物亲密互动。我们在 https://haiminluo.github.io/publication/artemis/ 公开 ARTEMIS 模型和动态毛茸茸动物数据集。
英文摘要：
We, humans, are entering into a virtual era and indeed want to bring animals to the virtual world as well for companion. Yet, computer-generated (CGI) furry animals are limited by tedious off-line rendering, let alone interactive motion control. In this paper, we present ARTEMIS, a novel neural modeling and rendering pipeline for generating ARTiculated neural pets with appEarance and Motion synthesIS. Our ARTEMIS enables interactive motion control, real-time animation, and photo-realistic rendering of furry animals. The core of our ARTEMIS is a neural-generated (NGI) animal engine, which adopts an efficient octree-based representation for animal animation and fur rendering. The animation then becomes equivalent to voxel-level deformation based on explicit skeletal warping. We further use a fast octree indexing and efficient volumetric rendering scheme to generate appearance and density features maps. Finally, we propose a novel shading network to generate high-fidelity details of appearance and opacity under novel poses from appearance and density feature maps. For the motion control module in ARTEMIS, we combine state-of-the-art animal motion capture approach with recent neural character control scheme. We introduce an effective optimization scheme to reconstruct the skeletal motion of real animals captured by a multi-view RGB and Vicon camera array. We feed all the captured motion into a neural character control scheme to generate abstract control signals with motion styles. We further integrate ARTEMIS into existing engines that support VR headsets, providing an unprecedented immersive experience where a user can intimately interact with a variety of virtual animals with vivid movements and photo-realistic appearance. We make available our ARTEMIS model and dynamic furry animal dataset at https://haiminluo.github.io/publication/artemis/.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
