arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.01441cs.CVcs.RO
收藏

使用机器人手持观察和合成自动准备YOLO的训练数据

Automatically Prepare Training Data for YOLO Using Robotic In-Hand Observation and Synthesis

Osaka University(大阪大学);H.U. Group Research Inst. G. K.(H.U.集团研究所有限责任公司);National Inst. of AIST(日本产业技术综合研究所)

Hao Chen, Weiwei Wan, Masaki Matsushita, Takeyuki Kotaka, Kensuke Harada

摘要:

深度学习方法最近在目标检测方面表现出令人印象深刻的性能。然而,这些方法需要大量的训练数据来实现高的识别精度,这是耗时的,并且需要大量的人工工作,如标记图像。在本文中,我们使用机器人自动准备训练数据。针对机器人运动效率低、能耗高的问题,提出了将机器人手持观测与数据合成相结合的方法,以扩大机器人采集的有限数据集。我们首先使用一个机器人与深度传感器来收集图像的物体在机器人的手中,并分割的对象图片。然后,我们使用复制粘贴的方法来合成与机架背景的分割对象。所收集的和合成的图像被组合以训练深度检测神经网络。我们进行了实验,比较YOLOv5x检测器与使用所提出的方法和其他几种方法收集的图像。结果表明,综合观测和合成图像的性能与手动数据准备相当。它们为优化训练检测器的数据配置和参数设置提供了很好的指导。所提出的方法只需要一个过程,是产生综合数据的低成本方法。感兴趣的读者可以从以下GitHub存储库中找到数据集和训练模型:github.com/wrslab/tubedet

英文摘要:

Deep learning methods have recently exhibited impressive performance in object detection. However, such methods needed much training data to achieve high recognition accuracy, which was time-consuming and required considerable manual work like labeling images. In this paper, we automatically prepare training data using robots. Considering the low efficiency and high energy consumption in robot motion, we proposed combining robotic in-hand observation and data synthesis to enlarge the limited data set collected by the robot. We first used a robot with a depth sensor to collect images of objects held in the robot's hands and segment the object pictures. Then, we used a copy-paste method to synthesize the segmented objects with rack backgrounds. The collected and synthetic images are combined to train a deep detection neural network. We conducted experiments to compare YOLOv5x detectors trained with images collected using the proposed method and several other methods. The results showed that combined observation and synthetic images led to comparable performance to manual data preparation. They provided a good guide on optimizing data configurations and parameter settings for training detectors. The proposed method required only a single process and was a low-cost way to produce the combined data. Interested readers may find the data sets and trained models from the following GitHub repository: github.com/wrslab/tubedet

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑