虚拟弹性对象
Virtual Elastic Objects
摘要：
我们提出了虚拟弹性对象（VEOs）：虚拟对象，不仅看起来像他们的现实世界的同行，但也像他们一样，即使受到新的相互作用。实现这一目标面临着多重挑战：不仅要捕获物体，包括作用在其上的物理力，然后忠实地重建和渲染，还要找到和模拟合理的材料参数。为了创建VEO，我们构建了一个多视图捕获系统，该系统在压缩空气流的影响下捕获对象。基于无模型动态神经辐射场的最新进展，我们重建了对象和相应的变形场。我们建议使用一个可微的，基于粒子的模拟器使用这些变形场来找到代表性的材料参数，这使我们能够运行新的模拟。为了渲染模拟对象，我们设计了一种方法，将模拟结果与神经辐射场相结合。由此产生的方法适用于广泛的场景：它可以处理由不均匀材料组成的物体，具有非常不同的形状，并且可以模拟与其他虚拟物体的交互。我们使用新收集的12个物体在各种力场下的数据集来展示我们的结果，这些数据集将与社区共享。
英文摘要：
We present Virtual Elastic Objects (VEOs): virtual objects that not only look like their real-world counterparts but also behave like them, even when subject to novel interactions. Achieving this presents multiple challenges: not only do objects have to be captured including the physical forces acting on them, then faithfully reconstructed and rendered, but also plausible material parameters found and simulated. To create VEOs, we built a multi-view capture system that captures objects under the influence of a compressed air stream. Building on recent advances in model-free, dynamic Neural Radiance Fields, we reconstruct the objects and corresponding deformation fields. We propose to use a differentiable, particle-based simulator to use these deformation fields to find representative material parameters, which enable us to run new simulations. To render simulated objects, we devise a method for integrating the simulation results with Neural Radiance Fields. The resulting method is applicable to a wide range of scenarios: it can handle objects composed of inhomogeneous material, with very different shapes, and it can simulate interactions with other virtual objects. We present our results using a newly collected dataset of 12 objects under a variety of force fields, which will be shared with the community.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
