arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2211.04693cs.AIcs.LG
收藏

基于图的数据评估和规则推理的深度可解释学习

Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning

Aliyun(阿里云);Alibaba Group(阿里巴巴集团);Xichang Steel and Vanadium Co., Ltd.(西昌钢钒有限公司);Pangang Group(攀钢集团)

Yuanlong Li, Gaopan Huang, Min Zhou, Chuan Fu, Honglin Qiao, Yan He

摘要:

学习一个可解释的分类器通常会导致模型的准确度较低,或者最终会得到一个庞大的规则集,而学习一个深度模型通常更能够处理大规模的噪声数据,但代价是难以解释结果,泛化能力较弱。为了弥补这一差距,我们提出了一种端到端的深度可解释学习方法,该方法结合了深度模型在噪声处理和基于专家规则的可解释性方面的优势。具体来说,我们建议学习一个深度数据评估模型,该模型将数据建模为一个图,以表示不同观测之间的相关性,其输出将用于提取关键数据特征。然后将关键特征输入到规则网络中,该规则网络根据具有可训练参数的预定义噪声专家规则构建。由于这些模型是相互关联的,我们提出了一个端到端的训练框架,利用规则分类损失,同时优化规则学习模型和数据评估模型。由于基于规则的计算是不可微的,我们提出了一个梯度连接搜索模块来携带梯度信息从规则学习模型到数据评估模型。该方法在工业生产系统中进行了测试,显示出相当的预测精度,更高的泛化稳定性和更好的可解释性相比,体面的深集成基线,并显示出更好的拟合能力比纯粹的基于规则的方法。

英文摘要:

Learning an explainable classifier often results in low accuracy model or ends up with a huge rule set, while learning a deep model is usually more capable of handling noisy data at scale, but with the cost of hard to explain the result and weak at generalization. To mitigate this gap, we propose an end-to-end deep explainable learning approach that combines the advantage of deep model in noise handling and expert rule-based interpretability. Specifically, we propose to learn a deep data assessing model which models the data as a graph to represent the correlations among different observations, whose output will be used to extract key data features. The key features are then fed into a rule network constructed following predefined noisy expert rules with trainable parameters. As these models are correlated, we propose an end-to-end training framework, utilizing the rule classification loss to optimize the rule learning model and data assessing model at the same time. As the rule-based computation is none-differentiable, we propose a gradient linking search module to carry the gradient information from the rule learning model to the data assessing model. The proposed method is tested in an industry production system, showing comparable prediction accuracy, much higher generalization stability and better interpretability when compared with a decent deep ensemble baseline, and shows much better fitting power than pure rule-based approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑