arXiv 2002.052712020-02-12cs.HCcs.CVcs.LG

HypoML：基于假设的机器学习模型评估的可视化分析

HypoML: Visual Analysis for Hypothesis-based Evaluation of Machine Learning Models

Hong Kong University of Science and Technology（香港科技大学）；University of Oxford（牛津大学）

Qianwen Wang, William Alexander, Jack Pegg, Huamin Qu, Min Chen

备注：: This article was submitted to EuroVis 2020 on 5 December 2020. It was not accepted. Because the reviews have not identified any technical problems that would undermine the novelty and validity of this work, we think that the article is ready to be released as an arXiv report. The EuroVis 2020 reviews and authors' short feedback can be found in the anc folder
发表信息：: IEEE Transactions on Visualization and Computer Graphics, Feb. 2021

摘要：

在本文中，我们提出了一个可视化的分析工具，使基于假设的评估机器学习（ML）模型。我们描述了一种新的ML测试框架，它结合了传统的统计假设检验（通常用于实证研究）与逻辑推理的结论，多个假设。该框架定义了一个受控的配置，用于测试一些假设，即关于“概念”或“特征”的一些额外信息是否以及如何有益于或阻碍ML模型。由于多个假设的推理并不总是简单的，我们提供了HypoML作为一个可视化的分析工具，使用它，多线程的测试数据被转换为一个可视化的表示，快速观察的结论和测试数据和假设之间的逻辑流程。我们已经应用HypoML的一些假设的概念，展示了直观和可解释的可视化分析的性质。

英文摘要：

In this paper, we present a visual analytics tool for enabling hypothesis-based evaluation of machine learning (ML) models. We describe a novel ML-testing framework that combines the traditional statistical hypothesis testing (commonly used in empirical research) with logical reasoning about the conclusions of multiple hypotheses. The framework defines a controlled configuration for testing a number of hypotheses as to whether and how some extra information about a "concept" or "feature" may benefit or hinder a ML model. Because reasoning multiple hypotheses is not always straightforward, we provide HypoML as a visual analysis tool, with which, the multi-thread testing data is transformed to a visual representation for rapid observation of the conclusions and the logical flow between the testing data and hypotheses.We have applied HypoML to a number of hypothesized concepts, demonstrating the intuitive and explainable nature of the visual analysis.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

摘要：

英文摘要：

相关论文