arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.21990cs.CV

AgRowStitch:面向地面农业图像的高保真图像拼接流水线

AgRowStitch: A High-fidelity Image Stitching Pipeline for Ground-based Agricultural Images

University of California, Davis(加州大学戴维斯分校)

Isaac Kazuo Uyehara, Heesup Yun, Earl Ranario, Mason Earles

AI总结:

提出AgRowStitch开源流水线,利用SuperPoint和LightGlue特征匹配及运动约束,拼接地面作物行图像,无需额外数据,实现20厘米平均误差的高质量马赛克。

摘要:

农业成像通常需要将单张图像拼接成最终的马赛克图像以进行分析。然而,农业图像的拼接尤为困难,因为重复纹理导致跨图像的特征匹配困难,植物是非平面的,且由多张图像构建的马赛克会累积误差导致漂移。尽管这些问题可以通过使用地理参考图像或在高空拍摄图像来缓解,但对于在作物近处拍摄的图像,尚无通用解决方案。为解决这一问题,我们创建了一个用户友好且开源的流水线,用于拼接线性作物行的地面图像,该流水线不依赖额外数据。首先,我们使用SuperPoint和LightGlue在小批量图像中提取和匹配特征。然后,我们在对相机运动施加约束的同时,按序列拼接每个批次中的图像。在拉直和重新缩放每个批次马赛克后,所有批次马赛克按序列拼接,然后拉直成最终马赛克。我们使用两台不同的农业机器人和一个手动携带的相机,在沿72米长的作物行收集的图像上测试了该流水线。在三种情况下,该流水线都生成了高质量的马赛克,可用于地理参考真实世界位置,平均绝对误差为20厘米。该方法为需要在行内粗略地理参考位置但无法获得精确位置数据或复杂成像系统的用户提供了可访问的叶片尺度拼接。

英文摘要:

Agricultural imaging often requires individual images to be stitched together into a final mosaic for analysis. However, agricultural images can be particularly challenging to stitch because feature matching across images is difficult due to repeated textures, plants are non-planar, and mosaics built from many images can accumulate errors that cause drift. Although these issues can be mitigated by using georeferenced images or taking images at high altitude, there is no general solution for images taken close to the crop. To address this, we created a user-friendly and open source pipeline for stitching ground-based images of a linear row of crops that does not rely on additional data. First, we use SuperPoint and LightGlue to extract and match features within small batches of images. Then we stitch the images in each batch in series while imposing constraints on the camera movement. After straightening and rescaling each batch mosaic, all batch mosaics are stitched together in series and then straightened into a final mosaic. We tested the pipeline on images collected along 72 m long rows of crops using two different agricultural robots and a camera manually carried over the row. In all three cases, the pipeline produced high-quality mosaics that could be used to georeference real world positions with a mean absolute error of 20 cm. This approach provides accessible leaf-scale stitching to users who need to coarsely georeference positions within a row, but do not have access to accurate positional data or sophisticated imaging systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑