In this paper we propose a framework for assessing the risk associated with deploying a machine learning model in a specified environment. For that we carry over the risk definition from decision theory to machine learning. We develop and implement a method that allows to define deployment scenarios, test the machine learning model under the conditions specified in each scenario, and estimate the damage associated with the output of the machine learning model under test. Using the likelihood of each scenario together with the estimated damage we define \emph{key risk indicators} of a machine learning model.
The definition of scenarios and weighting by their likelihood allows for standardized risk assessment in machine learning throughout multiple domains of application. In particular, in our framework, the robustness of a machine learning model to random input corruptions, distributional shifts caused by a changing environment, and adversarial perturbations can be assessed.
Company-as-Tribe: Company Financial Risk Assessment on Tribe-Style Graph with Hierarchical Graph Neural Networks
Institute of Computing Technology, University of Chinese Academy of Sciences(中国科学院大学计算技术研究所);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
公司财务风险是普遍存在的,对上市公司进行早期的风险评估可以避免公司遭受重大损失。传统的方法主要关注企业的财务报表,缺乏对企业财务报表之间复杂关系的研究。然而,财务报表往往存在偏差和滞后,难以准确及时地识别风险。为了应对这些挑战,我们将问题重新定义为\textbf{company financial risk assessment on tribe-style graph},将每家上市公司及其股东视为一个部落,利用金融新闻建立部落间的联系。这种部落式的图表呈现出不同的模式,以区分风险公司和正常公司。然而,部落风格图中的大多数节点缺乏属性,使得难以直接采用现有的图学习方法(例如,图神经网络(GNN))。本文提出了一种新的分层图神经网络(TH-GNN),该网络分为两层,第一层通过对比学习对部落的结构模式进行编码,第二层根据部落间的关系进行信息扩散,实现了有效的风险评估.在真实公司数据集上的大量实验表明,该方法在财务风险评估方面取得了显著的改进。此外,广泛的消融研究和可视化全面显示了我们的方法的有效性。
Comparison-Based Ordinal Learning for Proactive Driving Risk Assessment
College of Automotive and Energy Engineering, Tongji University(同济大学汽车与能源工程学院);James Watt School of Engineering, University of Glasgow(格拉斯哥大学詹姆斯·瓦特工程学院)
An evaluation of randomized machine learning methods for redundant data: Predicting short and medium-term suicide risk from administrative records and risk assessments
Dynamic Risk Assessment for Autonomous Vehicles from Spatio-Temporal Probabilistic Occupancy Heatmaps
Department of Civil and Environmental Engineering, University of California, Berkeley, CA, USA(加州大学伯克利分校土木与环境工程系);D3 Analytics Innovation, Allstate Insurance Company, Northbrook, IL, USA(Allstate保险公司D3 Analytics创新部门);Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA, USA(加州大学伯克利分校电气工程与计算机科学系)