arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.13003physics.geo-phcs.AIcs.DCcs.LG
收藏

深度神经网络的分布式训练介绍,用于大型地震数据集的分割任务

An introduction to distributed training of deep neural networks for segmentation tasks with large seismic datasets

KAUST(阿卜杜拉国王科技大学);Equinor ASA(Equinor公司);Jarraya Consultancy Ltd.(贾拉雅咨询有限公司)

Claire Birnie, Haithem Jarraya, Fredrik Hansteen

摘要:

深度学习应用在地震处理和解释任务中取得了巨大进展。然而,大多数方法对数据量进行二次采样并限制模型大小以最小化计算需求。对数据进行二次采样可能会丢失重要的时空信息,这些信息可以帮助训练,同时限制模型大小会影响模型性能,或者在某些极端情况下,会导致更复杂的任务(如分割)无法完成。本文阐述了如何解决大型神经网络训练的两个主要问题:内存限制和不切实际的大训练时间。通常,训练数据在训练之前被预加载到存储器中,这对于地震应用来说是一个特殊的挑战,在地震应用中,数据通常是用于标准图像处理任务的数据的四倍(float32与uint8)。使用一个微震用例,我们说明了如何使用超过750 GB的数据来训练一个模型,通过使用数据生成器的方法,只存储在内存中的数据所需的训练批次。此外,通过训练一个7层UNet,输入数据维度为4096X4096,说明了在大型模型上的有效训练。通过分批分布式训练方法,训练时间减少了四分之一。数据生成器和分布式训练的结合消除了数据1子采样或神经网络大小限制的任何必要性,提供了利用更大网络,更高分辨率输入数据或从2D到3D问题空间的机会。

英文摘要:

Deep learning applications are drastically progressing in seismic processing and interpretation tasks. However, the majority of approaches subsample data volumes and restrict model sizes to minimise computational requirements. Subsampling the data risks losing vital spatio-temporal information which could aid training whilst restricting model sizes can impact model performance, or in some extreme cases, renders more complicated tasks such as segmentation impossible. This paper illustrates how to tackle the two main issues of training of large neural networks: memory limitations and impracticably large training times. Typically, training data is preloaded into memory prior to training, a particular challenge for seismic applications where data is typically four times larger than that used for standard image processing tasks (float32 vs. uint8). Using a microseismic use case, we illustrate how over 750GB of data can be used to train a model by using a data generator approach which only stores in memory the data required for that training batch. Furthermore, efficient training over large models is illustrated through the training of a 7-layer UNet with input data dimensions of 4096X4096. Through a batch-splitting distributed training approach, training times are reduced by a factor of four. The combination of data generators and distributed training removes any necessity of data 1 subsampling or restriction of neural network sizes, offering the opportunity of utilisation of larger networks, higher-resolution input data or moving from 2D to 3D problem spaces.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑