arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2007.13003cs.CVcs.LG
收藏

基于随机卷积的鲁棒可推广视觉表示学习

Robust and Generalizable Visual Representation Learning via Random Convolutions

University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Yale University(耶鲁大学)

Zhenlin Xu, Deyi Liu, Junlin Yang, Colin Raffel, Marc Niethammer

摘要:

虽然在各种计算机视觉任务中取得了成功,但深度神经网络已被证明容易受到纹理风格变化和人类鲁棒的小扰动的影响。在这项工作中,我们表明,神经网络的鲁棒性可以大大提高通过使用随机卷积作为数据增强。随机卷积近似保持形状,并且可能使局部纹理失真。直觉上,随机卷积创建了无限多的新域,它们具有相似的全局形状,但具有随机的局部纹理。因此,我们探索使用多尺度随机卷积的输出作为新图像或在训练期间将其与原始图像混合。当将用我们的方法训练的网络应用于看不见的领域时,我们的方法始终提高了领域泛化基准的性能,并且可扩展到ImageNet。特别是,在具有挑战性的情况下,推广到PACS中的草图域和ImageNet-Sketch,我们的方法大大优于最先进的方法。更有趣的是,我们的方法可以通过提供更强大的预训练视觉表示来使下游任务受益。

英文摘要:

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks can be greatly improved through the use of random convolutions as data augmentation. Random convolutions are approximately shape-preserving and may distort local textures. Intuitively, randomized convolutions create an infinite number of new domains with similar global shapes but random local textures. Therefore, we explore using outputs of multi-scale random convolutions as new images or mixing them with the original images during training. When applying a network trained with our approach to unseen domains, our method consistently improves the performance on domain generalization benchmarks and is scalable to ImageNet. In particular, in the challenging scenario of generalizing to the sketch domain in PACS and to ImageNet-Sketch, our method outperforms state-of-art methods by a large margin. More interestingly, our method can benefit downstream tasks by providing a more robust pretrained visual representation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑