In this work, we consider the general problem of constructing a neural network surrogate model using multi-fidelity information. Motivated by error-complexity estimates for ReLU neural networks, we formulate the correlation between an inexpensive low-fidelity model and an expensive high-fidelity model as a possibly non-linear residual function. This function defines a mapping between 1) the shared input space of the models along with the low-fidelity model output, and 2) the discrepancy between the outputs of the two models. The computational framework proceeds by training two neural networks to work in concert. The first network learns the residual function on a small set of high- and low-fidelity data. Once trained, this network is used to generate additional synthetic high-fidelity data, which is used in the training of the second network. The trained second network then acts as our surrogate for the high-fidelity quantity of interest. We present four numerical examples to demonstrate the power of the proposed framework, showing that significant savings in computational cost may be achieved when the output predictions are desired to be accurate within small tolerances.
An Intelligent Fault Diagnosis Method for General Aviation Aircraft Based on Multi-Fidelity Digital Twin and FMEA Knowledge Enhancement
Hangzhou International Innovation Institute, Beihang University(北京航空航天大学杭州国际创新研究院);School of Mechanical Engineering, Zhejiang University(浙江大学机械工程学院);School of Reliability and Systems Engineering, Beihang University(北京航空航天大学可靠性与系统工程学院);Department of Mechanical Engineering, City University of Hong Kong(香港城市大学机械工程系)
Multi-Fidelity Flow Matching: Cascaded Refinement of PDE Solutions
Department of Computer Science, Florida State University(佛罗里达州立大学计算机科学系);Department of Materials Science and Engineering, Florida State University(佛罗里达州立大学材料科学与工程系);Hildebrand Department of Petroleum and Geosystems Engineering, The University of Texas at Austin(德克萨斯大学奥斯汀分校石油与地质系统工程系)
BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregression
State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, China(浙江大学工业控制技术状态重点实验室);Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy(米兰理工学院电子、信息与生物工程系);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China(中国科学院深圳先进技术研究所)
Enhancing Time-Series Anomaly Detection by Integrating Spectral-Residual Bottom-Up Attention with Reservoir Computing
Graduate School of Information and Computer Science(信息与计算机科学研究生学校);Chiba Institute of Technology(千叶技术大学);Department of Computer Science(计算机科学系);National Center of Neurology and Psychiatry(国立神经精神医学研究中心);Research Center for Mathematical Engineering(数学工程研究中心);International Research Center for Neurointelligence(神经智能国际研究中心);Institute for AI and Beyond(人工智能与超越研究所)
Residual Attention Physics-Informed Neural Networks for Robust Multiphysics Simulation of Steady-State Electrothermal Energy Systems
Nanophotonics and Biophotonics Key Laboratory of Jilin Province, School of Physics, Changchun University of Science and Technology(吉林省纳米光子与生物光子重点实验室,物理学院,长春理工大学)