arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.10325cs.CVcs.AI
收藏

动态学习图像标签以训练鲁棒分类模型

Learning Image Labels On-the-fly for Training Robust Classification Models

Nvidia Corporation(英伟达公司)

Xiaosong Wang, Ziyue Xu, Dong Yang, Leo Tam, Holger Roth, Daguang Xu

摘要:

当前的深度学习范式在很大程度上受益于大量的注释数据。然而,标注的质量往往因标注者而异。已经进行了多观察者研究来研究这些注释差异(通过多次标记相同的数据)及其对医学图像分析等关键应用的影响。这个过程确实给已经繁琐的注释工作增加了额外的负担,这些注释工作通常需要特定领域的专业培训和专业知识。另一方面,基于NLP算法的自动注释方法最近显示出作为合理替代方案的前景,依赖于临床系统中广泛可用的那些图像的现有诊断报告。与人类标签相比,不同的算法提供的标签具有不同的质量,甚至更嘈杂。在本文中,我们展示了噪声注释(例如,来自不同的基于算法的标记器)可以一起使用,并且相互有益于分类任务的学习。具体地,引入标签上的注意力的概念,以在运行中采样更好的标签集作为训练数据。一个基于元训练的标签采样模块被设计为通过额外的反向传播过程来关注最有利于模型学习的标签。我们将注意力标签方案应用于合成噪声CIFAR-10数据集的分类任务以证明这一概念,然后与常规训练范例相比,在来自医院规模数据集(MIMIC-CXR)和手动标记数据集(OpenI)的胸部X射线图像上展示了优异的结果(多个疾病分类AUC平均增加3-5%)。

英文摘要:

Current deep learning paradigms largely benefit from the tremendous amount of annotated data. However, the quality of the annotations often varies among labelers. Multi-observer studies have been conducted to study these annotation variances (by labeling the same data for multiple times) and its effects on critical applications like medical image analysis. This process indeed adds an extra burden to the already tedious annotation work that usually requires professional training and expertise in the specific domains. On the other hand, automated annotation methods based on NLP algorithms have recently shown promise as a reasonable alternative, relying on the existing diagnostic reports of those images that are widely available in the clinical system. Compared to human labelers, different algorithms provide labels with varying qualities that are even noisier. In this paper, we show how noisy annotations (e.g., from different algorithm-based labelers) can be utilized together and mutually benefit the learning of classification tasks. Specifically, the concept of attention-on-label is introduced to sample better label sets on-the-fly as the training data. A meta-training based label-sampling module is designed to attend the labels that benefit the model learning the most through additional back-propagation processes. We apply the attention-on-label scheme on the classification task of a synthetic noisy CIFAR-10 dataset to prove the concept, and then demonstrate superior results (3-5% increase on average in multiple disease classification AUCs) on the chest x-ray images from a hospital-scale dataset (MIMIC-CXR) and hand-labeled dataset (OpenI) in comparison to regular training paradigms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑