arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.02040cs.ROcs.AIstat.ML
收藏

谈钢琴灵巧手与灵巧触的学习

Towards Learning to Play Piano with Dexterous Hands and Touch

Tsinghua University(清华大学);Princeton University(普林斯顿大学);MIT(麻省理工学院);UC Berkeley(加州大学伯克利分校);Meta AI

Huazhe Xu, Yuping Luo, Shaoxiong Wang, Trevor Darrell, Roberto Calandra

摘要:

这位钢琴大师以激情、诗意和非凡的技巧演奏钢琴。正如李斯特所说,(一个演奏家)必须召唤香味和花朵,呼吸生命的气息。能够弹钢琴的最强机器人是基于专门的机器人手/钢琴和硬编码规划算法的组合。与此相反,在本文中,我们演示了如何使用强化学习(RL)从头开始,智能体可以直接从机器可读的乐谱中学习,用灵巧的手在模拟钢琴上弹钢琴。我们证明RL代理不仅可以找到正确的关键位置,但也处理各种节奏,音量和指法,要求。我们通过使用触摸增强奖励和新的任务课程来实现这一目标。最后,我们仔细研究的重要方面,使这样的学习算法,可以潜在地揭示在这个方向上的未来研究。

英文摘要:

The virtuoso plays the piano with passion, poetry and extraordinary technical ability. As Liszt said (a virtuoso)must call up scent and blossom, and breathe the breath of life. The strongest robots that can play a piano are based on a combination of specialized robot hands/piano and hardcoded planning algorithms. In contrast to that, in this paper, we demonstrate how an agent can learn directly from machine-readable music score to play the piano with dexterous hands on a simulated piano using reinforcement learning (RL) from scratch. We demonstrate the RL agents can not only find the correct key position but also deal with various rhythmic, volume and fingering, requirements. We achieve this by using a touch-augmented reward and a novel curriculum of tasks. We conclude by carefully studying the important aspects to enable such learning algorithms and that can potentially shed light on future research in this direction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑