arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.14501cs.RO
收藏

基于闭环规划的多笔鲁棒机器人3D绘图

Multi-Pen Robust Robotic 3D Drawing Using Closed-Loop Planning

Osaka University(大阪大学);National Inst. of AIST(国立先进工业科学技术研究所)

Ruishuang Liu, Weiwei Wan, Keisuke Koyama, Kensuke Harada

摘要:

本文开发了一个灵活的和强大的机器人系统自主绘制三维表面。该系统将2D绘图笔划和3D目标表面(网格或点云)作为输入。它将2D笔划映射到3D表面上,并使用视觉识别、抓取姿势推理和运动规划来生成机器人运动以绘制映射的笔划。与传统的机器人绘图系统相比,该系统是灵活的,因为我们没有将绘图工具固定到机器人手臂的末端。相反,机器人使用视觉系统选择绘图工具,并用手握住绘图工具进行绘画。同时,由于具有灵活性,系统具有很高的鲁棒性,由于以下工艺:首先,高质量的映射方法,以尽量减少在笔划的变形。第二,视觉检测用于在执行每个绘制动作之前重新估计绘制工具的姿态。第三,采用力控制来避免噪声视觉检测和校准,并确保笔尖和目标表面之间的牢固接触。第四,实现错误检测和恢复以处理意外问题。以闭环方式执行规划和执行,直到成功绘制笔划。我们评估了系统,并分析了使用不同的真实世界任务的各种工艺的必要性。结果表明,该系统是灵活的和强大的机器人运动,从拾取和放置笔,成功地绘制三维笔划在给定的表面上。

英文摘要:

This paper develops a flexible and robust robotic system for autonomous drawing on 3D surfaces. The system takes 2D drawing strokes and a 3D target surface (mesh or point clouds) as input. It maps the 2D strokes onto the 3D surface and generates a robot motion to draw the mapped strokes using visual recognition, grasp pose reasoning, and motion planning. The system is flexible compared to conventional robotic drawing systems as we do not fix drawing tools to the end of a robot arm. Instead, a robot selects drawing tools using a vision system and holds drawing tools for painting using its hand. Meanwhile, with the flexibility, the system has high robustness thanks to the following crafts: First, a high-quality mapping method is developed to minimize deformation in the strokes. Second, visual detection is used to re-estimate the drawing tool's pose before executing each drawing motion. Third, force control is employed to avoid noisy visual detection and calibration, and ensure a firm touch between the pen tip and a target surface. Fourth, error detection and recovery are implemented to deal with unexpected problems. The planning and executions are performed in a closed-loop manner until the strokes are successfully drawn. We evaluate the system and analyze the necessity of the various crafts using different real-word tasks. The results show that the proposed system is flexible and robust to generate a robot motion from picking and placing the pens to successfully drawing 3D strokes on given surfaces.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑