arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04820cs.GRcs.RO
收藏

面向接触丰富拟人操作的运动学运动重定向

Kinematic Motion Retargeting for Contact-Rich Anthropomorphic Manipulations

Carnegie Mellon University(卡内基梅隆大学);FAIR at Meta(元公司FAIR实验室);Boston Dynamics AI Institute(波士顿动力人工智能研究所)

Arjun S. Lakshmipathy, Jessica K. Hodgins, Nancy S. Pollard

AI总结:

提出一种基于接触区域的非等距形状匹配与逆运动学框架,将人手操作数据重定向到多样化的目标手,经三十次演示验证,支持物体替换与设计可视化。

摘要:

手部动作捕捉数据现在相对容易获取,即使是复杂的抓取动作也不例外;然而,如果不能将这些数据重定向到特定角色或机器人的手上,这些数据的用途就十分有限。目标手在几何形状、自由度(DOF)数量或手指数量上可能与源手差异巨大。我们提出了一种简单但有效的框架,能够通过利用接触区域,将公开数据集中的多个人手-物体操作动作运动学地重定向到各种运动学和形态学上多样化的目标手上。为此,我们将重定向操作表述为一个非等距形状匹配问题,并结合表面接触和标记数据,使用逆运动学(IK)逐步估计、细化和拟合最终的目标手轨迹。我们框架的基础是引入一种新颖的形状匹配过程,我们证明该过程能够在完整操作过程中实现接触数据的可预测且稳健的迁移,同时为艺术家提供了一种直观的方法,只需相对较少的输入即可指定对应关系。我们通过五个不同手形和六个不同物体运动的三十次演示来验证我们的框架。此外,我们将我们的方法与现有的手部重定向方法进行了比较。最后,我们展示了我们的方法能够实现新颖的功能,例如物体替换以及在整个轨迹上可视化设计选择影响的能力。

英文摘要:

Hand motion capture data is now relatively easy to obtain, even for complicated grasps; however this data is of limited use without the ability to retarget it onto the hands of a specific character or robot. The target hand may differ dramatically in geometry, number of degrees of freedom (DOFs), or number of fingers. We present a simple, but effective framework capable of kinematically retargeting multiple human hand-object manipulations from a publicly available dataset to a wide assortment of kinematically and morphologically diverse target hands through the exploitation of contact areas. We do so by formulating the retarget operation as a non-isometric shape matching problem and use a combination of both surface contact and marker data to progressively estimate, refine, and fit the final target hand trajectory using inverse kinematics (IK). Foundational to our framework is the introduction of a novel shape matching process, which we show enables predictable and robust transfer of contact data over full manipulations while providing an intuitive means for artists to specify correspondences with relatively few inputs. We validate our framework through thirty demonstrations across five different hand shapes and six motions of different objects. We additionally compare our method against existing hand retargeting approaches. Finally, we demonstrate our method enabling novel capabilities such as object substitution and the ability to visualize the impact of design choices over full trajectories.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑