arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.12723cs.LGcs.AIcs.DMmath.COstat.ML
收藏

基于概念的机器学习中的可解释性和相似性研究

On Interpretability and Similarity in Concept-Based Machine Learning

Bern University of Applied Sciences(伯尔尼应用科学大学);National Research University Higher School of Economics(国立研究型大学高等经济学院);St. Petersburg Department of Steklov Mathematical Institute of Russian Academy of Sciences(俄罗斯科学院斯捷克洛夫数学研究所圣彼得堡分所)

Léonard Kwuida, Dmitry I. Ignatov

摘要:

机器学习(ML)为分类和预测提供了重要的技术。其中大多数是用户的黑箱模型,不向决策者提供解释。为了决策的透明度或更有效性,开发可解释/可解释的ML方法的必要性越来越重要。需要解决的一些问题:ML过程如何为特定实体派生类?为什么一个特定的聚类会出现在一个特定的无监督ML过程中?如果属性的数量非常大,我们该怎么办?具体案例和模型出现错误的可能原因是什么?对于二元属性,形式概念分析(FCA)提供了形式概念意图方面的技术,从而为模型预测提供了合理的理由。然而,从可解释的机器学习的角度来看,我们仍然需要为决策者提供各个属性对特定对象分类的重要性,这可能有助于医学或金融等各个领域的专家解释高成本错误。我们讨论了如何从合作博弈论的概念可以用来评估个人属性的贡献,在基于概念的机器学习的分类和聚类过程。为了解决第三个问题,我们提出了一些关于如何在大上下文中使用相似性来减少属性数量的想法。

英文摘要:

Machine Learning (ML) provides important techniques for classification and predictions. Most of these are black-box models for users and do not provide decision-makers with an explanation. For the sake of transparency or more validity of decisions, the need to develop explainable/interpretable ML-methods is gaining more and more importance. Certain questions need to be addressed: How does an ML procedure derive the class for a particular entity? Why does a particular clustering emerge from a particular unsupervised ML procedure? What can we do if the number of attributes is very large? What are the possible reasons for the mistakes for concrete cases and models? For binary attributes, Formal Concept Analysis (FCA) offers techniques in terms of intents of formal concepts, and thus provides plausible reasons for model prediction. However, from the interpretable machine learning viewpoint, we still need to provide decision-makers with the importance of individual attributes to the classification of a particular object, which may facilitate explanations by experts in various domains with high-cost errors like medicine or finance. We discuss how notions from cooperative game theory can be used to assess the contribution of individual attributes in classification and clustering processes in concept-based machine learning. To address the 3rd question, we present some ideas on how to reduce the number of attributes using similarities in large contexts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑