arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.11787cs.LGcs.DCcs.PF
收藏

通过分布式训练加速领域感知深度学习模型

Accelerating Domain-aware Deep Learning Models with Distributed Training

Iowa State University(爱荷华州立大学)

Aishwarya Sarkar, Chaoqun Lu, Ali Jannesari

摘要:

数据生成技术的最新进展导致地理时空数据的爆炸性增长。在水文、生态和交通等领域,借助深度学习技术解释时空相互作用的复杂潜在模式因此成为时代的需要。然而,在没有特定领域知识的情况下应用深度学习技术往往会提供次优的预测性能。其次,在大规模数据上训练这样的模型需要大量的计算资源。为了消除这些挑战,我们提出了一种新的分布式域感知时空网络,利用特定领域的知识,提高模型性能。我们的网络由像素贡献块、分布式多头多通道卷积(CNN)空间块和递归时间块组成。我们选择水文学中的洪水预测作为用例来测试我们提出的方法。根据我们的分析,该网络有效地预测了流域出口流量测量的高峰,加速高达4.1倍,预测性能提高了93%。我们的方法实现了12.6倍的整体加速,平均预测性能提高了16%。我们在美国北部一个州的23个流域的数据集上进行了广泛的实验,并提出了我们的研究结果。

英文摘要:

Recent advances in data-generating techniques led to an explosive growth of geo-spatiotemporal data. In domains such as hydrology, ecology, and transportation, interpreting the complex underlying patterns of spatiotemporal interactions with the help of deep learning techniques hence becomes the need of the hour. However, applying deep learning techniques without domain-specific knowledge tends to provide sub-optimal prediction performance. Secondly, training such models on large-scale data requires extensive computational resources. To eliminate these challenges, we present a novel distributed domain-aware spatiotemporal network that utilizes domain-specific knowledge with improved model performance. Our network consists of a pixel-contribution block, a distributed multiheaded multichannel convolutional (CNN) spatial block, and a recurrent temporal block. We choose flood prediction in hydrology as a use case to test our proposed method. From our analysis, the network effectively predicts high peaks in discharge measurements at watershed outlets with up to 4.1x speedup and increased prediction performance of up to 93\%. Our approach achieved a 12.6x overall speedup and increased the mean prediction performance by 16\%. We perform extensive experiments on a dataset of 23 watersheds in a northern state of the U.S. and present our findings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑