arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.06558cs.CV
收藏

AutoGPart:通用3D零件分割的中间监督搜索

AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation

Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);Shanghai Qi Zhi Institute(上海期智研究院)

Xueyi Liu, Xiaomeng Xu, Anyi Rao, Chuang Gan, Li Yi

摘要:

训练一个可推广的3D零件分割网络是相当具有挑战性的,但在现实世界的应用中非常重要。为了解决这个问题,一些作品通过将人类对任务的理解转化为机器的学习过程来设计特定于任务的解决方案,这面临着错过最佳策略的风险,因为机器不一定以精确的人类方式理解。其他人试图使用传统的任务无关的方法,设计领域泛化问题,没有任务先验知识的考虑。为了解决上述问题,我们提出了AutoGPart,一种通用的方法,使训练可推广的三维零件分割网络的任务优先考虑。AutoGPart建立了一个监督空间,几何先验知识编码,并让机器自动搜索空间中的最佳监督为特定的分割任务。对三个可推广的三维零件分割任务进行了广泛的实验,以证明AutoGPart的有效性和通用性。我们证明了使用简单骨干的分割网络的性能可以显着提高时,训练与监督搜索我们的方法。

英文摘要:

Training a generalizable 3D part segmentation network is quite challenging but of great importance in real-world applications. To tackle this problem, some works design task-specific solutions by translating human understanding of the task to machine's learning process, which faces the risk of missing the optimal strategy since machines do not necessarily understand in the exact human way. Others try to use conventional task-agnostic approaches designed for domain generalization problems with no task prior knowledge considered. To solve the above issues, we propose AutoGPart, a generic method enabling training generalizable 3D part segmentation networks with the task prior considered. AutoGPart builds a supervision space with geometric prior knowledge encoded, and lets the machine to search for the optimal supervisions from the space for a specific segmentation task automatically. Extensive experiments on three generalizable 3D part segmentation tasks are conducted to demonstrate the effectiveness and versatility of AutoGPart. We demonstrate that the performance of segmentation networks using simple backbones can be significantly improved when trained with supervisions searched by our method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑