arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.01876cs.LGstat.ML
收藏

水文学中时间序列深度学习模型的数据协同效应

The data synergy effects of time-series deep learning models in hydrology

Stanford University(斯坦福大学);Pennsylvania State University(宾夕法尼亚州立大学)

Kuai Fang, Daniel Kifer, Kathryn Lawson, Dapeng Feng, Chaopeng Shen

摘要:

在水文学等地球科学学科中,当将统计模型拟合到变量时,通常的做法是区域化-将一个大的空间域划分为多个区域并分别研究每个区域-而不是在整个数据上拟合单个模型(也称为统一)。这些领域的传统智慧表明,为每个区域单独建立的模型将具有更高的性能,因为每个区域内的同质性。然而,通过划分训练数据,每个模型可以访问更少的数据点,并且不能从区域之间的共性中学习。在这里,通过两个水文例子(土壤湿度和径流),我们认为,在大数据和深度学习(DL)时代,统一往往可以显着优于区域化。即使没有定制,通用DL架构也可以自动构建受益于区域共性的模型,同时准确地了解特定区域的差异。我们强调了一种我们称之为数据协同的效应,当数据从不同地区汇集在一起时,DL模型的结果得到了改善。事实上,DL模型的性能得益于更多样化而不是更同质的训练数据。我们假设,DL模型自动调整其内部表示,以确定共性,同时也提供了足够的歧视性信息的模型。这里的结果主张汇集更大的数据集,并建议学术界应该更加重视数据共享和汇编。

英文摘要:

When fitting statistical models to variables in geoscientific disciplines such as hydrology, it is a customary practice to regionalize - to divide a large spatial domain into multiple regions and study each region separately - instead of fitting a single model on the entire data (also known as unification). Traditional wisdom in these fields suggests that models built for each region separately will have higher performance because of homogeneity within each region. However, by partitioning the training data, each model has access to fewer data points and cannot learn from commonalities between regions. Here, through two hydrologic examples (soil moisture and streamflow), we argue that unification can often significantly outperform regionalization in the era of big data and deep learning (DL). Common DL architectures, even without bespoke customization, can automatically build models that benefit from regional commonality while accurately learning region-specific differences. We highlight an effect we call data synergy, where the results of the DL models improved when data were pooled together from characteristically different regions. In fact, the performance of the DL models benefited from more diverse rather than more homogeneous training data. We hypothesize that DL models automatically adjust their internal representations to identify commonalities while also providing sufficient discriminatory information to the model. The results here advocate for pooling together larger datasets, and suggest the academic community should place greater emphasis on data sharing and compilation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑