arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.08820cs.CV
收藏

图像时间序列的裁剪映射:具有多尺度标签层次的深度学习

Crop mapping from image time series: deep learning with multi-scale label hierarchies

ETH Zurich(苏黎世联邦理工学院);Agroscope(瑞士农业研究中心);Federal Office for Agriculture, Switzerland(瑞士联邦农业办公室);University of Zurich(苏黎世大学)

Mehmet Ozgur Turkoglu, Stefano D'Aronco, Gregor Perich, Frank Liebisch, Constantin Streit, Konrad Schindler, Jan Dirk Wegner

摘要:

本文的目的是通过对卫星图像时间序列进行分类来绘制农业作物图。农业领域的专家使用以分层树结构组织的作物类型标签,其中粗类(如果园)被细分为细类(如苹果,梨,葡萄藤等)。我们开发了一种作物分类方法,利用这种专家知识,并显着提高稀有作物类型的映射。三级标签层次结构被编码在卷积递归神经网络(convRNN)中,使得对于每个像素,模型以不同的粒度级别预测三个标签。这种端到端可训练的分层网络架构允许模型学习稀有类的联合特征表示(例如,苹果,梨)在较粗糙的水平(例如,果园),从而提高细粒度级别的分类性能。此外,以不同粒度进行标记还可以根据分类分数调整输出;因为具有高置信度的粗标签有时比细粒度但非常不确定的标签更适用于农业实践。我们在一个新的,我们公开的大型数据集上验证了所提出的方法。ZueriCrop覆盖了瑞士苏黎世州和图尔高州50 km x 48 km的区域,共有116,000个独立的田地,跨越48个作物类别,以及来自Sentinel-2的28,000个(多时相)图像块。我们将我们提出的分层convRNN模型与几个基线进行了比较,包括为不平衡类分布设计的方法。分层方法在F1评分中至少优于9.9个百分点。

英文摘要:

The aim of this paper is to map agricultural crops by classifying satellite image time series. Domain experts in agriculture work with crop type labels that are organised in a hierarchical tree structure, where coarse classes (like orchards) are subdivided into finer ones (like apples, pears, vines, etc.). We develop a crop classification method that exploits this expert knowledge and significantly improves the mapping of rare crop types. The three-level label hierarchy is encoded in a convolutional, recurrent neural network (convRNN), such that for each pixel the model predicts three labels at different level of granularity. This end-to-end trainable, hierarchical network architecture allows the model to learn joint feature representations of rare classes (e.g., apples, pears) at a coarser level (e.g., orchard), thereby boosting classification performance at the fine-grained level. Additionally, labelling at different granularity also makes it possible to adjust the output according to the classification scores; as coarser labels with high confidence are sometimes more useful for agricultural practice than fine-grained but very uncertain labels. We validate the proposed method on a new, large dataset that we make public. ZueriCrop covers an area of 50 km x 48 km in the Swiss cantons of Zurich and Thurgau with a total of 116'000 individual fields spanning 48 crop classes, and 28,000 (multi-temporal) image patches from Sentinel-2. We compare our proposed hierarchical convRNN model with several baselines, including methods designed for imbalanced class distributions. The hierarchical approach performs superior by at least 9.9 percentage points in F1-score.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑