arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.03417cs.CV

Img2CAD:基于单幅图像的带条件3D CAD模型生成与结构化视觉几何

Img2CAD: Conditioned 3D CAD Model Generation from Single Image with Structured Visual Geometry

College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);KOKONI3D, Moxin (Huzhou) Technology Co., LTD(墨芯(湖州)科技有限公司);School of Software Technology, Zhejiang University(浙江大学软件学院);School of Information Engineering, Huzhou University(湖州师范学院信息工程学院)

Tianrun Chen, Chunan Yu, Yuanqi Hu, Jing Li, Tao Xu, Runlong Cao, Lanyun Zhu, Ying Zang, Yong Zhang, Zejian Li, Linyun Sun

AI总结:

针对现有3D生成方法的网格表示与CAD工具不兼容、不可编辑的问题,研究提出Img2CAD方法,通过结构化视觉几何中间表示实现单图生成可编辑CAD模型,并发布两个新数据集推动相关研究。

摘要:

本文提出了Img2CAD,据我们所知,这是首个利用2D图像输入生成带可编辑参数的CAD模型的方法。现有的基于文本或图像输入的3D模型生成AI方法通常依赖基于网格的表示,这类表示与CAD工具不兼容,且缺乏可编辑性与精细控制能力,而Img2CAD实现了基于AI的3D重建与CAD软件之间的无缝集成。我们提出了一种名为Structured Visual Geometry(SVG,结构化视觉几何)的创新中间表示,其特征是从物体中提取的矢量化线框,该表示显著提升了带条件CAD模型的生成性能。此外,我们引入了两个新数据集以支持该领域的进一步研究:ABC-mono是目前已知最大的数据集,包含超过20万个带渲染图像的3D CAD模型;KOCAD是首个包含真实世界捕获物体及其对应真值CAD模型的数据集,可为带条件CAD模型生成的后续研究提供支持。

英文摘要:

In this paper, we propose Img2CAD, the first approach to our knowledge that uses 2D image inputs to generate CAD models with editable parameters. Unlike existing AI methods for 3D model generation using text or image inputs often rely on mesh-based representations, which are incompatible with CAD tools and lack editability and fine control, Img2CAD enables seamless integration between AI-based 3D reconstruction and CAD software. We have identified an innovative intermediate representation called Structured Visual Geometry (SVG), characterized by vectorized wireframes extracted from objects. This representation significantly enhances the performance of generating conditioned CAD models. Additionally, we introduce two new datasets to further support research in this area: ABC-mono, the largest known dataset comprising over 200,000 3D CAD models with rendered images, and KOCAD, the first dataset featuring real-world captured objects alongside their ground truth CAD models, supporting further research in conditioned CAD model generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑