arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.03472cs.CV

Measure Anything:利用 Segment Anything 进行实时、多阶段的基于视觉的尺寸测量

Measure Anything: Real-time, Multi-stage Vision-based Dimensional Measurement using Segment Anything

University of California, Los Angeles (UCLA)(加利福尼亚大学洛杉矶分校)

Yongkyu Lee, Shivam Kumar Panda, Wei Wang, Mohammad Khalid Jawed

AI总结:

本文提出基于 SAM 的视觉尺寸测量框架 Measure Anything,通过分割、掩膜处理、骨架构建与 2D-3D 转换估计圆形截面物体的直径、长度和体积,并在油菜茎秆测量和机器人抓取中验证其实用性。

摘要:

我们提出了 Measure Anything,这是一个综合性的基于视觉的框架,用于测量具有圆形横截面的物体的尺寸,并利用了 Segment Anything Model(SAM)。我们的方法可估计关键几何特征——包括直径、长度和体积——适用于曲率各异的杆状几何体以及骨架斜率恒定的一般物体。该框架集成了分割、掩膜处理、骨架构建和 2D-3D 转换,并封装在一个用户友好的界面中。我们通过估算油菜茎秆的直径来验证该框架,这些茎秆采集自北达科他州的农田,纤细且不均匀,对现有方法构成了挑战。测量其直径至关重要,因为它是一种与油菜作物的健康状况和产量相关的表型性状。该应用还例证了 Measure Anything 的潜力,即集成关键点检测等智能模型可扩展其可扩展性,从而为高通量应用实现测量过程的完全自动化。此外,我们展示了它在机器人抓取中的多功能性,利用提取的几何特征来识别最佳抓取点。

英文摘要:

We present Measure Anything, a comprehensive vision-based framework for dimensional measurement of objects with circular cross-sections, leveraging the Segment Anything Model (SAM). Our approach estimates key geometric features -- including diameter, length, and volume -- for rod-like geometries with varying curvature and general objects with constant skeleton slope. The framework integrates segmentation, mask processing, skeleton construction, and 2D-3D transformation, packaged in a user-friendly interface. We validate our framework by estimating the diameters of Canola stems -- collected from agricultural fields in North Dakota -- which are thin and non-uniform, posing challenges for existing methods. Measuring its diameters is critical, as it is a phenotypic traits that correlates with the health and yield of Canola crops. This application also exemplifies the potential of Measure Anything, where integrating intelligent models -- such as keypoint detection -- extends its scalability to fully automate the measurement process for high-throughput applications. Furthermore, we showcase its versatility in robotic grasping, leveraging extracted geometric features to identify optimal grasp points.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑