Achieving both high speed and precision in robot operations is a significant challenge for social implementation. While factory robots excel at predefined tasks, they struggle with environment-specific actions like cleaning and cooking. Deep learning research aims to address this by enabling robots to autonomously execute behaviors through end-to-end learning with sensor data. RT-1 and ACT are notable examples that have expanded robots' capabilities. However, issues with model inference speed and hand position accuracy persist. High-quality training data and fast, stable inference mechanisms are essential to overcome these challenges. This paper proposes a motion generation model for high-speed, high-precision tasks, exemplified by the sports stacking task. By teaching motions slowly and inferring at high speeds, the model achieved a 94% success rate in stacking cups with a real robot.
Robust Convex Model Predictive Control with collision avoidance guarantees for robot manipulators
ABB robotics(ABB机器人公司);Department of Mechanical Engineering, Imperial College London(帝国理工学院机械工程系);Department of Information Technology, Uppsala University(乌普萨拉大学信息科技系)
A Faster, Lighter and Stronger Deep Learning-Based Approach for Place Recognition
Xiamen University(厦门大学)
视觉位置识别是摄像机定位和环路闭合检测系统的重要组成部分,在计算机视觉、机器人和AR/VR等多个领域引起了广泛的兴趣。在这项工作中,我们提出了一种更快,更轻,更强大的方法,可以生成具有更少参数的模型,并且可以在推理阶段花费更少的时间。我们设计了RepVGG-lite作为我们的架构中的骨干网络,它比其他一般网络在地点识别任务中更具鉴别力。RepVGG-lite在实现更高性能的同时具有更多的速度优势。在特征提取阶段,我们只从全局描述符中提取一个尺度的块级描述符。然后,我们设计了一个可训练的特征匹配器,利用的空间关系的功能和他们的视觉外观,这是基于注意力机制。在具有挑战性的基准数据集上进行的综合实验表明,所提出的方法优于最近其他最先进的学习方法,并实现了更高的推理速度。我们的系统比Patch-NetVLAD少14倍的参数,低6.8倍的理论FLOPs,并且在特征提取和特征匹配中运行速度快21和33倍。此外,我们的方法的性能是0.5\%,比补丁NetVLAD在Recall@1。我们使用Mapillary Street Level Sequences数据集的子集对所有其他具有挑战性的条件进行实验。