皮肤镜图像中黑色素瘤自动检测的计算机系统和排序标准的比较
Comparison of computer systems and ranking criteria for automatic melanoma detection in dermoscopic images
摘要:
黑色素瘤是最致命的皮肤癌。计算机系统可以辅助黑色素瘤检测,但在临床实践中并不普遍。2016年,宣布了皮肤病变皮肤镜图像分类的公开挑战。为挑战发布了900张带有相应类别标签和半自动/手动分割掩码的图像的训练集。一个包含379张图片的独立测试集被用来对参与者进行排名。本文展示了排序标准、分割方法和分类器的影响,并突出了临床视角。我们通过分析计算机系统在挑战中的排名,比较了五种不同的诊断准确性措施。绩效指标的选择对排名有很大的影响。在一项指标中排名前三的系统,在改变性能指标时下降到下半部分。Nevus Doctor是作者以前开发的计算机系统,用于研究分割和分类器的影响。自动与半自动/手动分割的意外小影响表明,自动分割方法的改进w.r.t.类似于半自动/手动分割将不会显著提高诊断准确性。一个小的相似的分类算法的集合被用来调查分类器的诊断准确性的影响。不同分类器算法的诊断准确性的变异性大于分割方法的变异性,这表明了未来研究的重点。从临床的角度来看,将黑色素瘤错误分类为良性的成本远远高于良性病变。对于具有临床影响的计算机系统,其性能应通过高灵敏度测量进行排名。
英文摘要:
Melanoma is the deadliest form of skin cancer. Computer systems can assist in melanoma detection, but are not widespread in clinical practice. In 2016, an open challenge in classification of dermoscopic images of skin lesions was announced. A training set of 900 images with corresponding class labels and semi-automatic/manual segmentation masks was released for the challenge. An independent test set of 379 images was used to rank the participants. This article demonstrates the impact of ranking criteria, segmentation method and classifier, and highlights the clinical perspective. We compare five different measures for diagnostic accuracy by analysing the resulting ranking of the computer systems in the challenge. Choice of performance measure had great impact on the ranking. Systems that were ranked among the top three for one measure, dropped to the bottom half when changing performance measure. Nevus Doctor, a computer system previously developed by the authors, was used to investigate the impact of segmentation and classifier. The unexpected small impact of automatic versus semi-automatic/manual segmentation suggests that improvements of the automatic segmentation method w.r.t. resemblance to semi-automatic/manual segmentation will not improve diagnostic accuracy substantially. A small set of similar classification algorithms are used to investigate the impact of classifier on the diagnostic accuracy. The variability in diagnostic accuracy for different classifier algorithms was larger than the variability for segmentation methods, and suggests a focus for future investigations. From a clinical perspective, the misclassification of a melanoma as benign has far greater cost than the misclassification of a benign lesion. For computer systems to have clinical impact, their performance should be ranked by a high-sensitivity measure.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。