This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the quality and accuracy of the inputs data can be guaranteed. However, in realistic applications of deep learning for solving optimization problems, the accuracy of inputs, which are the problem parameters in this case, plays a large role. This is because, in many situations, it is often costly or sometime impossible to obtain the problem parameters accurately, and correspondingly, it is highly desirable to develop learning algorithms that can account for the uncertainties in the input and produce solutions that are robust against these uncertainties. This paper presents a novel uncertainty injection scheme for training machine learning models that are capable of implicitly accounting for the uncertainties and producing statistically robust solutions. We further identify the wireless communications as an application field where uncertainties are prevalent in problem parameters such as the channel coefficients. We show the effectiveness of the proposed training scheme in two applications: the robust power loading for multiuser multiple-input-multiple-output (MIMO) downlink transmissions; and the robust power control for device-to-device (D2D) networks.
Enhancing Neural Network Robustness Against Fault Injection Through Non-linear Weight Transformations
Kyushu Institute of Technology(九州工业大学);Graduate School of Life Science and Systems(生命科学与系统研究生院);Research Center for Neuromorphic AI Hardware(神经形态AI硬件研究中心)
Interpretable Human-Label-Free Deep Learning for Real-Bogus Classification with Uncertainty Quantification
Università degli Studi di Milano, Department of Computer Science(米兰大学计算机科学系);Aix Marseille Univ, CNRS/IN2P3, CPPM(阿ix马赛大学,CNRS/IN2P3,CPPM);Université Côte d’Azur, INRIA, CNRS, Laboratoire J.A.Dieudonné, Maasai team(滨海大学,INRIA,CNRS,J.A.Dieudonné实验室,Maasai团队);Université Côte d’Azur, Observatoire de la Côte d’Azur, CNRS, Laboratoire Lagrange(滨海大学,滨海天文台,CNRS,Lagrange实验室);Université de Liège, STAR Institute(列日大学,STAR研究所)
Training More Robust Classification Model via Discriminative Loss and Gaussian Noise Injection
Ampere Software Technology(Ampere软件技术公司);Institut de mathématiques de Toulouse(图卢兹数学研究所);Institut de Recherche en Informatique de Toulouse(图卢兹计算机研究所);Laboratoire Jean Alexandre Dieudonné, Université Côte d’Azur(坎特伯雷大学Dieudonné实验室)
Noise Injection Node Regularization for Robust Learning
Raymond and Beverly Sackler School of Physics and Astronomy(雷蒙德与贝弗利·萨克勒物理与天文学院);Tel-Aviv University(特拉维夫大学);Berkeley Center for Theoretical Physics(伯克利理论物理中心);University of California, Berkeley(加州大学伯克利分校);NHETC, Department of Physics and Astronomy(物理与天文系新泽西高能理论中心(NHETC));Rutgers University(罗格斯大学)
RAISED: Self-Distillation for Robustness to Prompt Injection in LLM Agents
École polytechnique(巴黎综合理工学院);Institut Polytechnique de Paris(巴黎理工学院);CNRS(法国国家科学研究中心);Google DeepMind(谷歌DeepMind);Agence Ministérielle pour l’IA de Défense(法国国防部人工智能局);IRT SystemX(法国系统X技术研究所)
Active Bayesian Inference for Robust Control under Sensor False Data Injection Attacks
Department of Network and Systems Engineering, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology(瑞典皇家理工学院电气工程与计算机科学学院网络与系统工程系)