图像的内在维度及其对学习的影响
The Intrinsic Dimension of Images and Its Impact on Learning
摘要:
人们普遍认为,自然图像数据表现出低维结构,尽管传统的像素表示的高维。这个想法是深度学习在计算机视觉中取得巨大成功的共同直觉的基础。在这项工作中,我们将维度估计工具应用于流行的数据集,并研究低维结构在深度学习中的作用。我们发现,常见的自然图像数据集确实有非常低的内在维数相对于图像中的高像素数。此外,我们发现低维数据集更容易让神经网络学习,并且解决这些任务的模型可以更好地从训练数据推广到测试数据。在此过程中,我们开发了一种技术,用于在GANs生成的合成数据上验证我们的维度估计工具,使我们能够通过控制图像生成过程来主动操纵固有维度。我们的实验代码可以在这里找到https://github.com/ppope/dimensions。
英文摘要:
It is widely believed that natural image data exhibits low-dimensional structure despite the high dimensionality of conventional pixel representations. This idea underlies a common intuition for the remarkable success of deep learning in computer vision. In this work, we apply dimension estimation tools to popular datasets and investigate the role of low-dimensional structure in deep learning. We find that common natural image datasets indeed have very low intrinsic dimension relative to the high number of pixels in the images. Additionally, we find that low dimensional datasets are easier for neural networks to learn, and models solving these tasks generalize better from training to test data. Along the way, we develop a technique for validating our dimension estimation tools on synthetic data generated by GANs allowing us to actively manipulate the intrinsic dimension by controlling the image generation process. Code for our experiments may be found here https://github.com/ppope/dimensions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。