听起来不错:动态机器人操作的听觉自我监督
That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulation
摘要:
学习从原始感官数据中产生接触丰富的动态行为一直是机器人技术的一个长期挑战。突出的方法主要集中于使用视觉或触觉感知,其中不幸的是,一种方法无法捕获高频交互,而另一种方法对于大规模数据汇集来说可能过于精细。在这项工作中,我们提出了一种以数据为中心的方法来动态操纵,使用一个经常被忽视的信息源:声音。我们首先使用商品接触式麦克风在五个动态任务中收集了25k个交互声音对的数据集。然后,给定这些数据,我们利用自监督学习来加速声音的行为预测。我们的实验表明,这种自我监督的“预训练”对于实现高性能至关重要,MSE比普通监督学习低34.5%,比视觉训练低54.3%。重要的是,我们发现,当被要求生成所需的声音配置文件时,我们的模型在UR10机器人上的在线推出可以产生动态行为,在音频相似性指标上比监督学习平均提高11.5%。
英文摘要:
Learning to produce contact-rich, dynamic behaviors from raw sensory data has been a longstanding challenge in robotics. Prominent approaches primarily focus on using visual or tactile sensing, where unfortunately one fails to capture high-frequency interaction, while the other can be too delicate for large-scale data collection. In this work, we propose a data-centric approach to dynamic manipulation that uses an often ignored source of information: sound. We first collect a dataset of 25k interaction-sound pairs across five dynamic tasks using commodity contact microphones. Then, given this data, we leverage self-supervised learning to accelerate behavior prediction from sound. Our experiments indicate that this self-supervised 'pretraining' is crucial to achieving high performance, with a 34.5% lower MSE than plain supervised learning and a 54.3% lower MSE over visual training. Importantly, we find that when asked to generate desired sound profiles, online rollouts of our models on a UR10 robot can produce dynamic behavior that achieves an average of 11.5% improvement over supervised learning on audio similarity metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。