arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.00873cs.CVcs.AI
收藏

利用迁移学习与领域自适应的公平皮肤疾病预测

Equitable Skin Disease Prediction Using Transfer Learning and Domain Adaptation

Virginia Tech(弗吉尼亚理工学院暨州立大学);Dhaka University(达卡大学)

Sajib Acharjee Dip, Kazi Hasan Ibn Arif, Uddip Acharjee Shuvo, Ishtiaque Ahmed Khan, Na Meng

AI总结:

本文针对不同肤色皮肤疾病诊断不公平问题,提出融合多源预训练模型的迁移学习方法,并以Med-ViT结合HAM10000领域自适应,在DDI数据集上显著提升跨肤色皮肤疾病预测的鲁棒性与包容性。

摘要:

在皮肤病学领域,手动诊断皮肤状况的复杂性要求皮肤科医生的专业知识。准确识别从癌症到炎症性疾病的各种皮肤疾病至关重要。然而,皮肤病学中现有的人工智能(AI)模型面临挑战,尤其是在跨不同肤色的疾病准确诊断方面,在较深肤色上存在明显的性能差距。此外,公开可用且无偏的数据集的稀缺阻碍了包容性AI诊断工具的发展。为了解决跨不同肤色准确预测皮肤状况的挑战,我们采用了一种迁移学习方法,该方法利用来自各种图像领域的丰富、可迁移的知识。我们的方法整合了来自广泛来源的多个预训练模型,包括通用图像和特定医学图像,以提高皮肤状况预测的鲁棒性和包容性。我们使用Diverse Dermatology Images(DDI)数据集严格评估了这些模型的有效性,该数据集独特地包含了代表性不足和常见的肤色,使其成为评估我们方法的理想基准。在所有方法中,Med-ViT因其从多样化图像来源学习到的全面特征表示而成为表现最佳的模型。为了进一步提高性能,我们使用额外的皮肤图像数据集(如HAM10000)进行了领域自适应。这种自适应显著提高了所有模型的性能。

英文摘要:

In the realm of dermatology, the complexity of diagnosing skin conditions manually necessitates the expertise of dermatologists. Accurate identification of various skin ailments, ranging from cancer to inflammatory diseases, is paramount. However, existing artificial intelligence (AI) models in dermatology face challenges, particularly in accurately diagnosing diseases across diverse skin tones, with a notable performance gap in darker skin. Additionally, the scarcity of publicly available, unbiased datasets hampers the development of inclusive AI diagnostic tools. To tackle the challenges in accurately predicting skin conditions across diverse skin tones, we employ a transfer-learning approach that capitalizes on the rich, transferable knowledge from various image domains. Our method integrates multiple pre-trained models from a wide range of sources, including general and specific medical images, to improve the robustness and inclusiveness of the skin condition predictions. We rigorously evaluated the effectiveness of these models using the Diverse Dermatology Images (DDI) dataset, which uniquely encompasses both underrepresented and common skin tones, making it an ideal benchmark for assessing our approach. Among all methods, Med-ViT emerged as the top performer due to its comprehensive feature representation learned from diverse image sources. To further enhance performance, we conducted domain adaptation using additional skin image datasets such as HAM10000. This adaptation significantly improved model performance across all models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑