arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1911.04432cs.CV
收藏

流传输卷积神经网络,用于使用多百万像素图像进行端到端学习

Streaming convolutional neural networks for end-to-end learning with multi-megapixel images

Radboud University Medical Center(拉德堡德大学医学中心)

Hans Pinckaers, Bram van Ginneken, Geert Litjens

摘要:

由于当前硬件的内存限制,大多数卷积神经网络(CNN)都是在亚百万像素图像上训练的。例如,计算机视觉中最流行的数据集包含的图像大小远小于100万像素(ImageNet为0.09MP,CIFAR-10为0.001MP)。在某些领域,如医学成像,需要多兆像素的图像,以准确地识别疾病的存在。我们提出了一种新的方法,直接训练卷积神经网络使用任何输入图像大小的端到端。该方法通过对图像的较小块执行向前和向后传递,利用了现代卷积神经网络中大多数操作的局部性。在这项工作中,我们展示了一个使用高达6600万像素(8192 x8192)的图像的概念证明,每个图像节省了大约50 GB的内存。使用两个公共挑战数据集,我们证明CNN可以学会从这些大型图像中提取相关信息,并从提高分辨率中受益。我们将乳腺癌转移检测的受试者工作特征曲线下面积从0.580(4 MP)提高到0.706(66 MP)(CAMELYON 17)。我们还在TUPAC 16数据集上获得了接近最先进性能的斯皮尔曼相关性度量,从0.485(1 MP)到0.570(16 MP)。复制实验子集的代码可在https://github.com/DIAGNijmegen/StreamingCNN上获得。

英文摘要:

Due to memory constraints on current hardware, most convolution neural networks (CNN) are trained on sub-megapixel images. For example, most popular datasets in computer vision contain images much less than a megapixel in size (0.09MP for ImageNet and 0.001MP for CIFAR-10). In some domains such as medical imaging, multi-megapixel images are needed to identify the presence of disease accurately. We propose a novel method to directly train convolutional neural networks using any input image size end-to-end. This method exploits the locality of most operations in modern convolutional neural networks by performing the forward and backward pass on smaller tiles of the image. In this work, we show a proof of concept using images of up to 66-megapixels (8192x8192), saving approximately 50GB of memory per image. Using two public challenge datasets, we demonstrate that CNNs can learn to extract relevant information from these large images and benefit from increasing resolution. We improved the area under the receiver-operating characteristic curve from 0.580 (4MP) to 0.706 (66MP) for metastasis detection in breast cancer (CAMELYON17). We also obtained a Spearman correlation metric approaching state-of-the-art performance on the TUPAC16 dataset, from 0.485 (1MP) to 0.570 (16MP). Code to reproduce a subset of the experiments is available at https://github.com/DIAGNijmegen/StreamingCNN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑