arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.11755cs.LGstat.ML
收藏

面向科学发现的深度学习综述

A Survey of Deep Learning for Scientific Discovery

Google(谷歌);Cornell University(康奈尔大学);Schmidt Futures(施密特未来)

Maithra Raghu, Eric Schmidt

摘要:

在过去的几年里,我们看到机器学习的核心问题取得了根本性的突破,这在很大程度上是由深度神经网络的进步推动的。与此同时,在广泛的科学领域收集的数据量在规模和复杂性方面都在急剧增加。总之,这表明深度学习在科学环境中的应用有许多令人兴奋的机会。但这方面的一个重大挑战就是知道从哪里开始。不同深度学习技术的广度和多样性使得很难确定哪些科学问题最适合这些方法,或者哪种方法的特定组合可能提供最有前途的第一种方法。在本次调查中,我们重点讨论了这一核心问题,概述了许多广泛使用的深度学习模型,涵盖了视觉、顺序和图形结构数据、相关任务和不同的训练方法,以及使用更少数据的深度学习和更好地解释这些复杂模型的技术--这是许多科学用例的两个核心考虑因素。我们还包括完整设计过程的概述,实施提示,以及社区开发的大量教程,研究摘要和开源深度学习管道和预训练模型的链接。我们希望这项调查将有助于加快深度学习在不同科学领域的应用。

英文摘要:

Over the past few years, we have seen fundamental breakthroughs in core problems in machine learning, largely driven by advances in deep neural networks. At the same time, the amount of data collected in a wide array of scientific domains is dramatically increasing in both size and complexity. Taken together, this suggests many exciting opportunities for deep learning applications in scientific settings. But a significant challenge to this is simply knowing where to start. The sheer breadth and diversity of different deep learning techniques makes it difficult to determine what scientific problems might be most amenable to these methods, or which specific combination of methods might offer the most promising first approach. In this survey, we focus on addressing this central issue, providing an overview of many widely used deep learning models, spanning visual, sequential and graph structured data, associated tasks and different training methods, along with techniques to use deep learning with less data and better interpret these complex models --- two central considerations for many scientific use cases. We also include overviews of the full design process, implementation tips, and links to a plethora of tutorials, research summaries and open-sourced deep learning pipelines and pretrained models, developed by the community. We hope that this survey will help accelerate the use of deep learning across different scientific domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑