基于机器视觉的 YOLOv8 作物负载估算
Machine Vision-Based Crop-Load Estimation Using YOLOv8
AI总结:
提出融合 RGB-D 与 YOLOv8 实例分割、PCA 及 LCSA 的机器视觉方法,用于估计苹果枝条参数和目标留果量,误差较低。
摘要:
水果作物生产中的劳动力短缺,推动了机械化和自动化设备的发展,以替代收获、修剪和疏果等劳动密集型果园作业。能够识别树冠部分并估计枝条直径、长度和角度等几何与拓扑参数的农业机器人,可通过自动化修剪和疏果平台优化作物产量。本研究提出了一种机器视觉系统,用于估计苹果园的树冠参数并确定单个枝条的最佳果实数量,从而为机器人修剪、疏花和疏果以实现预期产量与品质奠定基础。该系统利用 RGB-D 传感器(Microsoft Azure Kinect DK)获取的颜色和深度信息,开发了一种基于 YOLOv8 的实例分割技术,用于在休眠期识别苹果树的主干和枝条。研究采用主成分分析估计枝条直径(用于计算枝干横截面积,即 LCSA)和方向。估计的枝条直径用于计算 LCSA,并将其作为作物负载估算的输入;LCSA 值越大,表示潜在结果能力越高。枝条直径估计的 RMSE 为 2.08 mm,作物负载估计的 RMSE 为 3.95。根据商业化苹果园管理实践,对每个分割枝条的目标作物负载(果实数量)进行估计,其平均绝对误差(MAE)为 2.99(真实作物负载为每个 LCSA 对应 6 个苹果)。本研究展示了一种具有良好前景的工作流程,可在动态商业果园环境中高性能识别苹果树主干和枝条,并将农场管理实践整合到自动化决策中。
英文摘要:
Labor shortages in fruit crop production have prompted the development of mechanized and automated machines as alternatives to labor-intensive orchard operations such as harvesting, pruning, and thinning. Agricultural robots capable of identifying tree canopy parts and estimating geometric and topological parameters, such as branch diameter, length, and angles, can optimize crop yields through automated pruning and thinning platforms. In this study, we proposed a machine vision system to estimate canopy parameters in apple orchards and determine an optimal number of fruit for individual branches, providing a foundation for robotic pruning, flower thinning, and fruitlet thinning to achieve desired yield and quality.Using color and depth information from an RGB-D sensor (Microsoft Azure Kinect DK), a YOLOv8-based instance segmentation technique was developed to identify trunks and branches of apple trees during the dormant season. Principal Component Analysis was applied to estimate branch diameter (used to calculate limb cross-sectional area, or LCSA) and orientation. The estimated branch diameter was utilized to calculate LCSA, which served as an input for crop-load estimation, with larger LCSA values indicating a higher potential fruit-bearing capacity.RMSE for branch diameter estimation was 2.08 mm, and for crop-load estimation, 3.95. Based on commercial apple orchard management practices, the target crop-load (number of fruit) for each segmented branch was estimated with a mean absolute error (MAE) of 2.99 (ground truth crop-load was 6 apples per LCSA). This study demonstrated a promising workflow with high performance in identifying trunks and branches of apple trees in dynamic commercial orchard environments and integrating farm management practices into automated decision-making.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。