基于基础模型的可解释框架用于鱼类性别识别
An interpretable framework using foundation models for fish sex identification
AI总结:
基于基础模型的可解释框架用于濒危鱼类三角洲虾虎鱼的性别识别,通过原型网络提升鲁棒性与可解释性,实现高准确率识别。
摘要:
准确识别鱼类性别对于优化水产养殖中的繁殖和管理策略至关重要,特别是对于濒危物种。然而,大多数现有方法具有侵入性或压力大,可能导致额外的死亡,对濒危或受威胁的鱼类种群构成严重风险。为了解决这些挑战,我们提出了FishProtoNet,一个稳健、非侵入性的基于计算机视觉的框架,用于识别加州原生的濒危鱼类——三角洲虾虎鱼(Hypomesus transpacificus)在其整个生命周期中的性别。与传统深度学习方法不同,FishProtoNet通过学习的原型表示提供可解释性,同时通过利用基础模型来减少背景噪声的影响以提高鲁棒性。具体而言,FishProtoNet框架由三个关键组件组成:使用视觉基础模型提取鱼类感兴趣区域(ROIs),从鱼类ROIs中提取特征,并基于可解释的原型网络进行鱼类性别识别。FishProtoNet在早期产卵和产卵后阶段的三角洲虾虎鱼性别识别中表现出色,分别达到74.40%和81.16%的准确率,对应的F1分数分别为74.27%和79.43%。相比之下,当前计算机视觉方法在亚成年阶段的三角洲虾虎鱼性别识别仍然具有挑战性,这可能是由于未成熟鱼类形态差异不明显的缘故。FishProtoNet的源代码可在https://github.com/zhengmiao1/Fish_sex_identification上公开获取。
英文摘要:
Accurate sex identification in fish is vital for optimizing breeding and management strategies in aquaculture, particularly for species at the risk of extinction. However, most existing methods are invasive or stressful and may cause additional mortality, posing severe risks to threatened or endangered fish populations. To address these challenges, we propose FishProtoNet, a robust, non-invasive computer vision-based framework for sex identification of delta smelt (Hypomesus transpacificus), an endangered fish species native to California, across its full life cycle. Unlike the traditional deep learning methods, FishProtoNet provides interpretability through learned prototype representations while improving robustness by leveraging foundation models to reduce the influence of background noise. Specifically, the FishProtoNet framework consists of three key components: fish regions of interest (ROIs) extraction using visual foundation model, feature extraction from fish ROIs and fish sex identification based on an interpretable prototype network. FishProtoNet demonstrates strong performance in delta smelt sex identification during early spawning and post-spawning stages, achieving the accuracies of 74.40% and 81.16% and corresponding F1 scores of 74.27% and 79.43% respectively. In contrast, delta smelt sex identification at the subadult stage remains challenging for current computer vision methods, likely due to less pronounced morphological differences in immature fish. The source code of FishProtoNet is publicly available at: https://github.com/zhengmiao1/Fish_sex_identification
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。