响应设计和类比例如何影响验证数据的准确性
How response designs and class proportions affect the accuracy of validation data
摘要:
为验证土地覆盖图而收集的参考数据一般被认为没有错误。然而,在实践中,它们包含错误,尽管尽一切努力将其最小化。然后,这些误差传播到准确度评估阶段,并影响验证结果。对于照片判读的参考数据,研究最广泛的三个误差来源是系统性错误标签、警惕性下降和人口统计学因素。内部估计误差,响应设计固有的错误,影响参考数据的准确性,是远远不够理解。我们分析了估计误差对两种类型的图例以及具有一系列子样本量的基于点和基于分区的响应设计的影响。我们发现,响应设计的准确性取决于类比例内的抽样单元,与复杂的景观更容易出错。因此,子样本数量固定的响应设计效率低下,并且参考数据集的标签具有不一致的置信水平。为了控制估计误差,保证验证数据的高准确度标准,并尽量减少数据收集工作,我们建议依赖于照片解释数据的置信区间来定义应标记多少个子样本。在实践中,子样本被迭代地选择和标记,直到估计的类比例达到期望的置信水平。因此,在标记明显的案件上花费的精力较少,可以将多余的精力分配给更复杂的案件。这种方法可以减少50%至75%的标签工作,在我们的研究地点,在同质景观更大的收益。我们认为,采用这种优化方法不仅可以提高参考数据收集的效率,还有助于向用户社区提供可靠的准确性估计。
英文摘要:
Reference data collected to validate land cover maps are generally considered free of errors. In practice, however, they contain errors despite all efforts to minimise them. These errors then propagate up to the accuracy assessment stage and impact the validation results. For photo-interpreted reference data, the three most widely studied sources of error are systematic incorrect labelling, vigilance drops, and demographic factors. How internal estimation errors, i.e., errors intrinsic to the response design, affect the accuracy of reference data is far less understood. We analysed the impact of estimation errors for two types of legends as well as for point-based and partition-based response designs with a range of sub-sample sizes. We showed that the accuracy of response designs depends on the class proportions within the sampling units, with complex landscapes being more prone to errors. As a result, response designs where the number of sub-samples are fixed are inefficient, and the labels of reference data sets have inconsistent confidence levels. To control estimation errors, to guarantee high accuracy standards of validation data, and to minimise data collection efforts, we proposed to rely on confidence intervals of the photo-interpreted data to define how many sub-samples should be labelled. In practice, sub-samples are iteratively selected and labelled until the estimated class proportions reach the desired level of confidence. As a result, less effort is spent on labelling obvious cases and the spared effort can be allocated to more complex cases. This approach could reduce the labelling effort by 50% to 75% in our study site, with greater gains in homogeneous landscapes. We contend that adopting this optimisation approach will not only increase the efficiency of reference data collection but will also help deliver reliable accuracy estimates to the user community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。