Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden properties of the observations. System identification learns mathematical descriptions of dynamic systems from input-output data and can thus benefit from the advances of deep neural networks to enrich the possible range of models to choose from. For this reason, we provide a survey of deep learning from a system identification perspective. We cover a wide spectrum of topics to enable researchers to understand the methods, providing rigorous practical and theoretical insights into the benefits and challenges of using them. The main aim of the identified model is to predict new data from previous observations. This can be achieved with different deep learning based modelling techniques and we discuss architectures commonly adopted in the literature, like feedforward, convolutional, and recurrent networks. Their parameters have to be estimated from past data trying to optimize the prediction performance. For this purpose, we discuss a specific set of first-order optimization tools that is emerged as efficient. The survey then draws connections to the well-studied area of kernel-based methods. They control the data fit by regularization terms that penalize models not in line with prior assumptions. We illustrate how to cast them in deep architectures to obtain deep kernel-based methods. The success of deep learning also resulted in surprising empirical observations, like the counter-intuitive behaviour of models with many parameters. We discuss the role of overparameterized models, including their connection to kernels, as well as implicit regularization mechanisms which affect generalization, specifically the interesting phenomena of benign overfitting ...
Deep Residual Shrinkage Networks for EMG-based Gesture Identification
School of Physical Science and Technology, Lanzhou University(兰州大学物理科学与技术学院);School of Advanced Technology, Xi'an Jiaotong-Liverpool University(西交利物浦大学先进技术学院);Chongqing Jiangbei Bachuan Quantum Middle School(重庆江北巴川量子中学);School of Chengdu Shishi Cambridge A-Level Centre(成都石室剑桥高级课程中心)
Automated identification of transiting exoplanet candidates in NASA Transiting Exoplanets Survey Satellite (TESS) data with machine learning methods
Catholic University of America(美国天主教大学);Tel Aviv University(特拉维夫大学);ThetaRay(ThetaRay公司)
一种使用机器学习(ML)方法的新型人工智能(AI)技术结合了由ThetaRay,Inc.应用于NASA的凌日系外行星勘测卫星(TESS)数据集,以识别系外行星候选者。AI/ML ThetaRay系统最初使用开普勒系外行星数据进行训练,并在应用于TESS数据之前使用确认的系外行星进行验证。数据的现有和新特征基于各种观测参数,通过采用半监督和无监督机器学习技术构建并用于AI/ML分析。通过将ThetaRay系统应用于TESS任务产生的10,803个阈值交叉事件(TCEs)的光变曲线,该算法从Mikulski Archive for Space Telescopes获得,该算法产生了约50个目标以供进一步分析,我们通过进一步的人工审查发现了三个新的系外行星候选者。这项研究首次展示了将特定的基于AI/ML的方法成功应用于大型天体物理数据集,以快速自动分类TCE。
dynoGP: Deep Gaussian Processes for dynamic system identification
School of Computer Science and Statistic, Trinity College Dublin(都柏林三一学院计算机科学与统计学院);SUPSI(瑞士南部应用科学大学);IDSIA - Dalle Molle Institute for Artificial Intelligence(IDSIA - 达勒·莫勒人工智能研究所)
Protein identification with deep learning: from abc to xyz
David R. Cheriton School of Computer Science, University of Waterloo(滑铁卢大学 David R. Cheriton 计算机科学学院);Bioinformatics Solutions Inc.(Bioinformatics Solutions 公司)