通过视觉学习的潜在表示实现软连续机器人的准确开环控制
Accurate Open-Loop Control of a Soft Continuum Robot Using Visually Learned Latent Dynamics
AI总结:
本文提出通过视觉学习的潜在动态实现软连续机器人的开环控制,利用视觉振荡网络和注意力广播解码器,减少图像空间跟踪误差,验证了可解释的视频学习潜在动态在长时间尺度开环控制中的可靠性。
摘要:
本文针对软连续机器人(SCR)的开环控制问题,从视频学习的潜在动态出发。利用先前工作的视觉振荡网络(VONs),通过注意力广播解码器(ABCD)提供可解释的2D振荡潜在表示。在潜在空间中进行开环单次最优控制,以跟踪图像指定的路径点,而无需摄像头反馈。交互式SCR实时模拟器可设计静态、动态和外推目标,并将其映射到模型特定的潜在路径点。在双段气动SCR上,评估了Koopman、MLP和振荡动力学(带和不带ABCD)在设定点和动态轨迹上的性能。基于ABCD的模型一致地减少了图像空间的跟踪误差。VON和基于ABCD的Koopman模型实现了最低的均方误差。通过消融研究,我们证明了若干架构选择和训练设置对开环控制性能有贡献。模拟压力测试进一步证实了静态保持、稳定的外推平衡点和合理的放松到休息状态。据我们所知,这是首次展示可解释的视频学习潜在动态能够实现软连续机器人可靠长时间尺度开环控制的演示。
英文摘要:
This work addresses open-loop control of a soft continuum robot (SCR) from video-learned latent dynamics. Visual Oscillator Networks (VONs) from previous work are used, which provide mechanically interpretable 2D oscillator latents through an attention broadcast decoder (ABCD). Open-loop, single-shooting optimal control is performed in latent space to track image-specified waypoints without camera feedback. An interactive SCR live simulator enables design of static, dynamic, and extrapolated targets and maps them to model-specific latent waypoints. On a two-segment pneumatic SCR, Koopman, MLP, and oscillator dynamics, each with and without ABCD, are evaluated on setpoint and dynamic trajectories. ABCD-based models consistently reduce image-space tracking error. The VON and ABCD-based Koopman models attain the lowest mean squared errors (MSEs). Ablation and simulation stress tests confirm that training and architecture choices support open-loop performance, including static holding, stable extrapolated equilibria, and relaxation to rest. To the best of our knowledge, this is the first demonstration of reliable long-horizon open-loop control of a physical soft robot using interpretable latent dynamics models learned solely from video.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。