Deep learning applications are drastically progressing in seismic processing and interpretation tasks. However, the majority of approaches subsample data volumes and restrict model sizes to minimise computational requirements. Subsampling the data risks losing vital spatio-temporal information which could aid training whilst restricting model sizes can impact model performance, or in some extreme cases, renders more complicated tasks such as segmentation impossible. This paper illustrates how to tackle the two main issues of training of large neural networks: memory limitations and impracticably large training times. Typically, training data is preloaded into memory prior to training, a particular challenge for seismic applications where data is typically four times larger than that used for standard image processing tasks (float32 vs. uint8). Using a microseismic use case, we illustrate how over 750GB of data can be used to train a model by using a data generator approach which only stores in memory the data required for that training batch. Furthermore, efficient training over large models is illustrated through the training of a 7-layer UNet with input data dimensions of 4096X4096. Through a batch-splitting distributed training approach, training times are reduced by a factor of four. The combination of data generators and distributed training removes any necessity of data 1 subsampling or restriction of neural network sizes, offering the opportunity of utilisation of larger networks, higher-resolution input data or moving from 2D to 3D problem spaces.
Geological Everything Model 3D: A Promptable Foundation Model for Unified and Zero-Shot Subsurface Understanding
University of Science and Technology of China, School of Earth and Space Sciences(中国科学技术大学地球和空间科学学院);University of Texas at Austin, UT Institute for Geophysics(德克萨斯大学奥斯汀分校UT地球物理研究所);NVIDIA(NVIDIA公司)
MD Loss: Efficient Training of 3D Seismic Fault Segmentation Network under Sparse Labels by Weakening Anomaly Annotation
College of computer science and technology, China University of Petroleum (East China)(中国石油大学(华东)计算机科学与技术学院);College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);Shengli Oilfield Company, SINOPEC(中国石化胜利油田分公司)
Long-term marine acoustic and seismic monitoring using distributed acoustic sensing and deep learning
University of California, Berkeley(加州大学伯克利分校);Berkeley Seismology Laboratory, University of California, Berkeley(加州大学伯克利分校伯克利地震实验室);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室)
Near real-time channel selection for Distributed Acoustic Sensing technology
University of Pisa(比萨大学);Ruhr University Bochum(波鸿鲁尔大学);Institut de Ciències del Mar, CSIC(海洋科学研究所,西班牙国家科学研究委员会);Istituto Nazionale di Geofisica e Vulcanologia(意大利国家地球物理与火山学研究所)
Seismic First Break Picking in a Higher Dimension Using Deep Graph Learning
School of Mathematics and Statistics, Xi’an Jiaotong University(西安交通大学数学与统计学院);China National Petroleum Corp Bureau of Geophysical Prospecting Inc, Geophysical Technology Research Center(中国石油集团地球物理勘探局有限公司地球物理技术研究中心)
GeoFWI3D: Large-scale 3D Velocity Model Dataset for Deep Learning-assisted Seismic Imaging
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Uppsala University(乌普萨拉大学);The University of Texas at Permian Basin(德克萨斯大学佩米安盆地分校);King Fahd University of Petroleum and Minerals(法赫德国王石油与矿产大学)
Parameter-Efficient Adaptation of Pre-Trained Vision Foundation Models for Active and Passive Seismic Data Denoising
Computation-based Science and Technology Research Center, The Cyprus Institute(计算科学与技术研究中心,塞浦路斯研究所);Department of Geosciences, College of Petroleum Engineering and Geosciences, King Fahd University of Petroleum & Minerals(地质学系,石油工程与地质学院,国王法赫德石油与矿物大学);Department of Intelligent Systems, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology(智能系统系,电气工程、数学与计算机科学学院,代尔夫特理工大学);Department of Mathematics and Statistics, Faculty of Pure and Applied Sciences, University of Cyprus(数学与统计学系,纯应用科学学院,塞浦路斯大学);Department of Geoscience and Engineering, Faculty of Civil Engineering and Geosciences, Delft University of Technology(地质科学与工程系,土木工程与地质科学学院,代尔夫特理工大学)