arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.15331cs.LGcs.CV
收藏

我需要多少数据?基于医疗数据的案例研究

How much data do I need? A case study on medical data

Newcastle University(纽卡斯尔大学)

Ayse Betul Cengiz, A. Stephen McGough

AI总结:

本研究评估了六个医疗和六个通用数据集,发现“数据越多结果越好”和“迁移学习普遍有益”的简单经验法则并不总是成立,实际情况更为复杂。

摘要:

收集数据来训练深度学习网络在精力和资源方面代价高昂。在许多情况下,尤其是在医疗背景下,它可能会产生不利影响。例如需要可能本身就会造成医疗伤害的侵入性医疗程序或过程。然而,深度学习被视为一种对数据需求量大的方法。在这里,我们考察了两个普遍认同的格言:i) 更多的数据带来更好的结果,以及 ii) 当没有足够的数据时,迁移学习会对你有所帮助。这些被广泛认为是正确的,并被用作在涉及深度学习时选择如何解决问题的证据。我们评估了六个医疗数据集和六个通用数据集。在这些数据集的不同子集上训练 ResNet18 网络,以评估“更多的数据带来更好的结果”。我们将其中十一个数据集作为在第十二个数据集——Chest——的子集上进行迁移学习的源,以确定迁移学习是否普遍有益。我们进一步探究多阶段迁移学习是否提供一致的益处。我们的分析表明,实际情况比这些简单的格言更为复杂——更多的数据可能导致收益递减的情况,而为迁移学习选择不正确的数据集可能导致更差的性能,我们认为与 Chest 数据集高度相似的数据集比更不相似的数据集给出的结果更差。多阶段迁移学习同样揭示了数据集之间的复杂关系。

英文摘要:

The collection of data to train a Deep Learning network is costly in terms of effort and resources. In many cases, especially in a medical context, it may have detrimental impacts. Such as requiring invasive medical procedures or processes which could in themselves cause medical harm. However, Deep Learning is seen as a data hungry method. Here, we look at two commonly held adages i) more data gives better results and ii) transfer learning will aid you when you don't have enough data. These are widely assumed to be true and used as evidence for choosing how to solve a problem when Deep Learning is involved. We evaluate six medical datasets and six general datasets. Training a ResNet18 network on varying subsets of these datasets to evaluate `more data gives better results'. We take eleven of these datasets as the sources for Transfer Learning on subsets of the twelfth dataset -- Chest -- in order to determine whether Transfer Learning is universally beneficial. We go further to see whether multi-stage Transfer Learning provides a consistent benefit. Our analysis shows that the real situation is more complex than these simple adages -- more data could lead to a case of diminishing returns and an incorrect choice of dataset for transfer learning can lead to worse performance, with datasets which we would consider highly similar to the Chest dataset giving worse results than datasets which are more dissimilar. Multi-stage transfer learning likewise reveals complex relationships between datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑