QueryCAD:面向CAD模型的 grounded 问答
QueryCAD: Grounded Question Answering for CAD Models
AI总结:
本文提出首个CAD问答系统QueryCAD,结合开放词汇分割模型SegCAD和专用基准,使机器人自动程序合成能够通过自然语言从CAD模型中提取信息。
摘要:
CAD模型在工业中被广泛使用,并且对于机器人自动化流程至关重要。然而,这些模型在基于人工智能的新方法(例如机器人程序的自动合成)中很少被考虑,因为目前缺乏现成的方法能够将CAD模型纳入分析、解释或信息提取。为了解决这些局限性,我们提出了QueryCAD,这是第一个为CAD问答设计的系统,能够利用自然语言查询从CAD模型中提取精确信息。QueryCAD集成了SegCAD,这是我们开发的一个开放词汇实例分割模型,用于根据部件描述识别和选择CAD模型中的特定部件。我们进一步提出了一个CAD问答基准,用于评估QueryCAD,并为未来研究奠定基础。最后,我们将QueryCAD集成到一个自动机器人程序合成框架中,验证了其通过使深度学习解决方案能够处理CAD模型来增强机器人技术的能力(https://claudius-kienle.github.com/querycad)。
英文摘要:
CAD models are widely used in industry and are essential for robotic automation processes. However, these models are rarely considered in novel AI-based approaches, such as the automatic synthesis of robot programs, as there are no readily available methods that would allow CAD models to be incorporated for the analysis, interpretation, or extraction of information. To address these limitations, we propose QueryCAD, the first system designed for CAD question answering, enabling the extraction of precise information from CAD models using natural language queries. QueryCAD incorporates SegCAD, an open-vocabulary instance segmentation model we developed to identify and select specific parts of the CAD model based on part descriptions. We further propose a CAD question answering benchmark to evaluate QueryCAD and establish a foundation for future research. Lastly, we integrate QueryCAD within an automatic robot program synthesis framework, validating its ability to enhance deep-learning solutions for robotics by enabling them to process CAD models (https://claudius-kienle.github.com/querycad).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。