arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.26151cs.ROcs.AI
收藏

无监督记忆增强视频变换器:自主农业机器人的障碍物检测

Unsupervised Memory-Enhanced Video Transformers: Obstacle Detection for Autonomous Agricultural Rover

Théo Biardeau, Anne-Sophie Capelle-Laizé, Salwan Alwan, David Helbert

AI总结:

提出VMTAD,一种无监督方法,利用记忆增强的变换器处理动态场景,实现农业机器人实时障碍物检测,在油菜数据集上达到SOTA性能。

摘要:

虽然自主机器人已成为精准农业不可或缺的工具,但实现一致的操作安全仍然是一个关键挑战。传统的安全传感器,如LiDAR,无法检测位于植物冠层下方的障碍物,构成重大风险。基于相机的监督学习方法可以检测常见物体,但在面对训练数据中未出现的障碍物时表现不佳。实际的无监督异常检测通过学习环境的正常视觉模式提供解决方案,但通常无法处理移动机器人捕获的动态场景。本文介绍了用于异常检测的视频记忆变换器(VMTAD),这是一种完全无监督的方法,专为动态农业场景中的实时障碍物检测而设计。VMTAD利用变换器驱动的架构,并辅以专用记忆模块。该记忆模块通过处理先前帧的编码表示来利用时间上下文。这种方法使系统能够有效应对机器人运动引起的动态上下文。该模型仅使用代表正常操作的图像进行训练,无需数据标签。VMTAD在'Grillion'农业机器人上进行了严格评估。在具有挑战性的油菜数据集上,VMTAD达到了最先进的性能,检测和分割的受试者工作特征曲线下面积分别达到0.973和0.997。轻量级变体提供了高精度和实时推理(14毫秒)的最佳平衡,这对安全性至关重要,正如我们对机器人总制动距离的分析所证实的那样。

英文摘要:

While autonomous rovers have become indispensable to precision farming, achieving consistent operational safety remains a critical challenge. Conventional safety sensors, such as LiDAR, fail to detect obstacles positioned below the plant canopy, posing a significant risk. While camera-based supervised learning methods can detect common objects, they perform poorly when faced with obstacles that were not present in their training data. Actual unsupervised anomaly detection offers a solution by learning the normal visual patterns of an environment, but often fails for the dynamic scenes captured by a moving rover.\\ This paper introduces Video Memory Transformers for Anomaly Detection (VMTAD), a fully unsupervised method designed for real-time obstacle detection in dynamic agricultural scenes. VMTAD utilizes a transformer-driven architecture augmented with a dedicated memory module. This memory module leverages temporal context by processing encoded representations of preceding frames. This approach enables the system to effectively address the dynamic context caused by the robot's movement. The model is trained using only images that represent normal operation, requiring no data labels.\\ VMTAD was rigorously evaluated on the 'Grillion' agricultural rover. On a challenging rapeseed dataset, VMTAD achieved state-of-the-art performance, reaching a 0.973 detection and 0.997 segmentation Area Under the Receiver Operating Characteristic curve. A lightweight variant provides an optimal balance of high accuracy and real-time inference (14 ms), which is critical for safety, as confirmed by our analysis of the rover's total stopping distance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑