挑战黑盒:农业和林业中CNN应用的归因图综合评估
Challenging the Black Box: A Comprehensive Evaluation of Attribution Maps of CNN Applications in Agriculture and Forestry
AI总结:
本研究通过定性和定量分析评估了农业和林业中神经网络最先进的归因图(AMs),揭示了其无法一致突出关键特征且与专家认知不符的局限性,为该领域AMs的可靠性和实用性提供了关键见解。
摘要:
本研究探讨了神经网络在农业和林业中的可解释性,特别是在肥料处理分类和木材识别方面。这些模型通常被视为“黑盒”,其不透明性通过对最先进的归因图(Attribution Maps, AMs,也称为类激活图(CAMs)或显著性图)的广泛评估得到了解决。我们对这些AMs的全面定性和定量分析揭示了关键的实际局限性。研究结果表明,AMs经常无法一致地突出关键特征,并且通常与领域专家认为重要的特征不一致。这些差异对AMs在理解神经网络决策过程中的实用性提出了重大质疑。我们的研究为农业和林业领域AMs的可靠性和实用性提供了关键见解,从而有助于更好地理解这些应用领域中的神经网络。
英文摘要:
In this study, we explore the explainability of neural networks in agriculture and forestry, specifically in fertilizer treatment classification and wood identification. The opaque nature of these models, often considered 'black boxes', is addressed through an extensive evaluation of state-of-the-art Attribution Maps (AMs), also known as class activation maps (CAMs) or saliency maps. Our comprehensive qualitative and quantitative analysis of these AMs uncovers critical practical limitations. Findings reveal that AMs frequently fail to consistently highlight crucial features and often misalign with the features considered important by domain experts. These discrepancies raise substantial questions about the utility of AMs in understanding the decision-making process of neural networks. Our study provides critical insights into the trustworthiness and practicality of AMs within the agriculture and forestry sectors, thus facilitating a better understanding of neural networks in these application areas.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。