arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.05033cs.CV
收藏

Sim2real迁移学习在点云分割中的应用--基于工业自动化的实例

Sim2real Transfer Learning for Point Cloud Segmentation: An Industrial Application Case on Autonomous Disassembly

Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);Fraunhofer Institute of Optronics, System Technologies and Image Exploitation IOSB(弗劳恩霍夫光电、系统技术与图像利用研究所IOSB);Fraunhofer Center for Machine Learning(弗劳恩霍夫机器学习中心)

Chengzhi Wu, Xuelei Bi, Julius Pfrommer, Alexander Cebulla, Simon Mangold, Jürgen Beyerer

摘要:

在机器人计算机视觉任务中,使用基于深度学习的方法从现实世界生成和注释大量数据通常是困难的,甚至是不可能的。解决这个问题的一个常见策略是在模拟场景的帮助下应用模拟到现实(sim 2 real)方法。虽然目前大多数机器人视觉sim 2 real的工作集中在图像数据,我们提出了一个工业应用案例,使用sim 2 real迁移学习的点云数据。我们提供了有关如何生成和处理合成点云数据的见解,以便在将学习的模型转换为真实数据时实现更好的性能。使用多种策略研究了不平衡学习的问题。此外,提出了一种新的基于补丁的注意力网络来解决这个问题。

英文摘要:

On robotics computer vision tasks, generating and annotating large amounts of data from real-world for the use of deep learning-based approaches is often difficult or even impossible. A common strategy for solving this problem is to apply simulation-to-reality (sim2real) approaches with the help of simulated scenes. While the majority of current robotics vision sim2real work focuses on image data, we present an industrial application case that uses sim2real transfer learning for point cloud data. We provide insights on how to generate and process synthetic point cloud data in order to achieve better performance when the learned model is transferred to real-world data. The issue of imbalanced learning is investigated using multiple strategies. A novel patch-based attention network is proposed additionally to tackle this problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑