arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.07727cs.CV
收藏

基于图像和深度学习的机器人视觉伺服方法

An Image Based Visual Servo Approach with Deep Learning for Robotic Manipulation

Beijing Institute of Technology(北京理工大学);University of Electronic Science and Technology of China (UESTC)(电子科技大学)

Jingshu Liu, Yuan Li

摘要:

针对基于图像的视觉伺服中图像特征提取和雅可比矩阵估计困难的问题,提出了一种基于深度学习的图像视觉伺服方法。利用卷积神经网络(CNN)强大的学习能力,实现了从图像中提取特征的自主学习,以及从图像空间到任务空间的非线性拟合,极大地方便了基于图像的视觉伺服过程。基于上述思想,设计了一种基于卷积神经网络的双流网络,并提出了相应的控制方案,实现了机器人操作臂的四自由度视觉伺服。采集不同位姿参数下的观测目标图像作为CNN的训练样本,训练好的网络可用于估计从二维图像空间到三维笛卡尔空间的非线性关系。双流网络将当前图像和期望图像作为输入,并使它们相等,以引导机械手到期望的姿势。实验结果验证了该方法的有效性。

英文摘要:

Aiming at the difficulty of extracting image features and estimating the Jacobian matrix in image based visual servo, this paper proposes an image based visual servo approach with deep learning. With the powerful learning capabilities of convolutional neural networks(CNN), autonomous learning to extract features from images and fitting the nonlinear relationships from image space to task space is achieved, which can greatly facilitate the image based visual servo procedure. Based on the above ideas a two-stream network based on convolutional neural network is designed and the corresponding control scheme is proposed to realize the four degrees of freedom visual servo of the robot manipulator. Collecting images of observed target under different pose parameters of the manipulator as training samples for CNN, the trained network can be used to estimate the nonlinear relationship from 2D image space to 3D Cartesian space. The two-stream network takes the current image and the desirable image as inputs and makes them equal to guide the manipulator to the desirable pose. The effectiveness of the approach is verified with experimental results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑