arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1908.04387cs.CVcs.LGstat.ML
收藏

使用深度神经网络和稀疏真值的图像质量估计

Mass Estimation from Images using Deep Neural Network and Sparse Ground Truth

Iowa State University(爱荷华州立大学)

Muhammad K A Hamdan, Daine T. Rover, Matthew J. Darr, John Just

摘要:

监督学习是回归和分类任务的主力,但标准方法假定每个测量都有真值。在现实世界的应用中,由于特定应用而导致的费用或一般不可行性的限制是常见的。在农业应用的背景下,产量监测是一个这样的例子,其中基于简单物理学的测量,如体积或力冲击,已被用来量化质量流,这会引起由于传感器校准的误差。通过利用具有梯度聚合和图像序列的半监督深度学习,在这项工作中,我们可以准确地估计具有复杂数据结构和稀疏真值的物理量(质量)。使用视觉系统捕获甘蔗升降机的图像,并在受控测试下运行竹子作为替代材料来收获甘蔗,通过仅使用最终负载重量训练DNN,从图像中准确预测质量。DNN成功地捕获了内部细长棒随机堆叠的复杂密度物理,作为质量预测模型的一部分,并超越了旧的基于体积的质量预测方法。此外,通过DNN架构和惩罚项结合有关系统物理的知识,可以提高预测精度和稳定性,并加快学习速度。它表明,经典的非线性回归优化可以重新与聚合项与一些独立的假设,以实现这一壮举。由于任何给定运行的图像数量太大,无法容纳在典型的GPU vRAM上,因此示出了补偿有限的内存但仍实现快速训练时间的实现。本文提出的相同方法可以应用于其他应用,如使用视觉或其他仪器的谷物联合收割机或其他收割机上的产量监测。

英文摘要:

Supervised learning is the workhorse for regression and classification tasks, but the standard approach presumes ground truth for every measurement. In real world applications, limitations due to expense or general in-feasibility due to the specific application are common. In the context of agriculture applications, yield monitoring is one such example where simple-physics based measurements such as volume or force-impact have been used to quantify mass flow, which incur error due to sensor calibration. By utilizing semi-supervised deep learning with gradient aggregation and a sequence of images, in this work we can accurately estimate a physical quantity (mass) with complex data structures and sparse ground truth. Using a vision system capturing images of a sugarcane elevator and running bamboo under controlled testing as a surrogate material to harvesting sugarcane, mass is accurately predicted from images by training a DNN using only final load weights. The DNN succeeds in capturing the complex density physics of random stacking of slender rods internally as part of the mass prediction model, and surpasses older volumetric-based methods for mass prediction. Furthermore, by incorporating knowledge about the system physics through the DNN architecture and penalty terms, improvements in prediction accuracy and stability, as well as faster learning are obtained. It is shown that the classic nonlinear regression optimization can be reformulated with an aggregation term with some independence assumptions to achieve this feat. Since the number of images for any given run are too large to fit on typical GPU vRAM, an implementation is shown that compensates for the limited memory but still achieve fast training times. The same approach presented herein could be applied to other applications like yield monitoring on grain combines or other harvesters using vision or other instrumentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑