arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2009.10337cs.LGcs.ROcs.SYeess.SYstat.ML
收藏

学习任务无关动作空间的运动优化

Learning Task-Agnostic Action Spaces for Movement Optimization

Aalto University(阿尔托大学);University of British Columbia(不列颠哥伦比亚大学);Stanford University(斯坦福大学)

Amin Babadi, Michiel van de Panne, C. Karen Liu, Perttu Hämäläinen

摘要:

我们提出了一种新的方法来探索基于物理的动画角色的动态,并学习一个任务不可知的动作空间,使运动优化更容易。与之前的几篇论文一样,我们将动作参数化为目标状态,并学习短期目标条件的低级控制策略,该策略将智能体的状态推向目标。我们的新贡献是,通过我们的探索数据,我们能够以通用的方式学习低级策略,而无需任何参考运动数据。该策略针对每个代理或模拟环境进行一次训练,提高了跨多个任务和优化算法优化轨迹和高级策略的效率。我们还贡献了新颖的可视化,展示了如何使用目标状态作为动作使优化的轨迹对干扰更加鲁棒;这表现为更广泛的最优值,很容易找到。由于其简单性和通用性,我们提出的方法应该提供一个积木,可以改善各种各样的运动优化方法和应用程序。

英文摘要:

We propose a novel method for exploring the dynamics of physically based animated characters, and learning a task-agnostic action space that makes movement optimization easier. Like several previous papers, we parameterize actions as target states, and learn a short-horizon goal-conditioned low-level control policy that drives the agent's state towards the targets. Our novel contribution is that with our exploration data, we are able to learn the low-level policy in a generic manner and without any reference movement data. Trained once for each agent or simulation environment, the policy improves the efficiency of optimizing both trajectories and high-level policies across multiple tasks and optimization algorithms. We also contribute novel visualizations that show how using target states as actions makes optimized trajectories more robust to disturbances; this manifests as wider optima that are easy to find. Due to its simplicity and generality, our proposed approach should provide a building block that can improve a large variety of movement optimization methods and applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑