arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.01233cs.LGstat.ML
收藏

通过学习偏好分析人类决策的混合机器学习框架

A hybrid machine learning framework for analyzing human decision making through learning preferences

Xi’an Jiaotong University(西安交通大学);City University of Hong Kong(香港城市大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Arizona(亚利桑那大学)

Mengzhuo Guo, Qingpeng Zhang, Xiuwu Liao, Frank Youhua Chen, Daniel Dajun Zeng

摘要:

机器学习近年来已被广泛用于解决管理决策问题,其中决策者需要能够以显式形式解释个体属性的贡献。然而,在性能和可解释性之间存在权衡。完全复杂性模型是不可追踪的黑盒,而经典的可解释模型通常被简化,准确性较低。这种权衡限制了最先进的机器学习模型在管理问题中的应用,这需要高预测性能,以及对单个属性对模型结果的贡献的理解。多准则决策辅助(MCDA)是描述人类决策原理的一系列分析方法。它也受到强有力的假设的限制。为了满足决策者对更可解释的机器学习模型的需求,我们提出了一种新的混合方法,即基于神经网络的多准则决策辅助,它结合了一个加性值模型和一个完全连接的多层感知器(MLP),以实现良好的性能,同时捕捉单个属性和预测之间的显式关系。NN-MCDA的线性部分通过提供显式的边缘价值函数来描述这种关系,而非线性部分则用于捕获属性之间的隐式高阶相互作用及其复杂的非线性变换。我们证明了NN-MCDA的有效性与广泛的模拟研究和三个真实世界的数据集。据我们所知,这项研究是第一个提高解释性的机器学习模型与MCDA技术。所提出的框架还阐明了如何使用机器学习技术来将MCDA从强假设中解放出来。

英文摘要:

Machine learning has recently been widely adopted to address the managerial decision making problems, in which the decision maker needs to be able to interpret the contributions of individual attributes in an explicit form. However, there is a trade-off between performance and interpretability. Full complexity models are non-traceable black-box, whereas classic interpretable models are usually simplified with lower accuracy. This trade-off limits the application of state-of-the-art machine learning models in management problems, which requires high prediction performance, as well as the understanding of individual attributes' contributions to the model outcome. Multiple criteria decision aiding (MCDA) is a family of analytic approaches to depicting the rationale of human decision. It is also limited by strong assumptions. To meet the decision maker's demand for more interpretable machine learning models, we propose a novel hybrid method, namely Neural Network-based Multiple Criteria Decision Aiding, which combines an additive value model and a fully-connected multilayer perceptron (MLP) to achieve good performance while capturing the explicit relationships between individual attributes and the prediction. NN-MCDA has a linear component to characterize such relationships through providing explicit marginal value functions, and a nonlinear component to capture the implicit high-order interactions between attributes and their complex nonlinear transformations. We demonstrate the effectiveness of NN-MCDA with extensive simulation studies and three real-world datasets. To the best of our knowledge, this research is the first to enhance the interpretability of machine learning models with MCDA techniques. The proposed framework also sheds light on how to use machine learning techniques to free MCDA from strong assumptions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑