arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.08704cs.RO
收藏

QueryCAD:面向CAD模型的 grounded 问答

QueryCAD: Grounded Question Answering for CAD Models

ArtiMinds Robotics;IAS Lab, Computer Science Department, TU Darmstadt(IAS实验室,计算机科学系,图腾斯泰特大学);AICOR Institute for Artificial Intelligence, University of Bremen(AICOR人工智能研究所,不莱梅大学);Stuttgart University of Applied Sciences(斯图加特应用科学大学)

Claudius Kienle, Benjamin Alt, Darko Katic, Rainer Jäkel, Jan Peters

AI总结:

本文提出首个CAD问答系统QueryCAD,结合开放词汇分割模型SegCAD和专用基准,使机器人自动程序合成能够通过自然语言从CAD模型中提取信息。

摘要:

CAD模型在工业中被广泛使用,并且对于机器人自动化流程至关重要。然而,这些模型在基于人工智能的新方法(例如机器人程序的自动合成)中很少被考虑,因为目前缺乏现成的方法能够将CAD模型纳入分析、解释或信息提取。为了解决这些局限性,我们提出了QueryCAD,这是第一个为CAD问答设计的系统,能够利用自然语言查询从CAD模型中提取精确信息。QueryCAD集成了SegCAD,这是我们开发的一个开放词汇实例分割模型,用于根据部件描述识别和选择CAD模型中的特定部件。我们进一步提出了一个CAD问答基准,用于评估QueryCAD,并为未来研究奠定基础。最后,我们将QueryCAD集成到一个自动机器人程序合成框架中,验证了其通过使深度学习解决方案能够处理CAD模型来增强机器人技术的能力(https://claudius-kienle.github.com/querycad)。

英文摘要:

CAD models are widely used in industry and are essential for robotic automation processes. However, these models are rarely considered in novel AI-based approaches, such as the automatic synthesis of robot programs, as there are no readily available methods that would allow CAD models to be incorporated for the analysis, interpretation, or extraction of information. To address these limitations, we propose QueryCAD, the first system designed for CAD question answering, enabling the extraction of precise information from CAD models using natural language queries. QueryCAD incorporates SegCAD, an open-vocabulary instance segmentation model we developed to identify and select specific parts of the CAD model based on part descriptions. We further propose a CAD question answering benchmark to evaluate QueryCAD and establish a foundation for future research. Lastly, we integrate QueryCAD within an automatic robot program synthesis framework, validating its ability to enhance deep-learning solutions for robotics by enabling them to process CAD models (https://claudius-kienle.github.com/querycad).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑