使用重构的测试成本和误分类成本权衡
Test cost and misclassification cost trade-off using reframing
摘要:
成本敏感分类(和回归)的许多解决方案依赖于以下部分或全部假设:我们在训练时对成本上下文有完整的了解,我们可以在成本上下文发生变化时轻松地重新训练,并且我们有特定于技术的方法(例如成本敏感决策树)可以利用这些信息。在本文中,我们解决的问题,选择模型和联合成本最小化(整合错误分类成本和测试成本),没有任何上述假设。我们引入了可以与任何现成的预测技术(包括集成)一起工作的方法和图(例如所谓的JROC图),以便我们重新构建模型,以便在部署时使用适当的属性子集(功能配置)。换句话说,模型使用可用属性进行训练(一劳永逸),然后通过在被认为对降低联合成本无效的属性上设置缺失值来部署。由于特征配置组合的数量随特征数量呈指数级增长,我们引入了二次方法,该方法能够近似最优配置和模型选择,如实验结果所示。
英文摘要:
Many solutions to cost-sensitive classification (and regression) rely on some or all of the following assumptions: we have complete knowledge about the cost context at training time, we can easily re-train whenever the cost context changes, and we have technique-specific methods (such as cost-sensitive decision trees) that can take advantage of that information. In this paper we address the problem of selecting models and minimising joint cost (integrating both misclassification cost and test costs) without any of the above assumptions. We introduce methods and plots (such as the so-called JROC plots) that can work with any off-the-shelf predictive technique, including ensembles, such that we reframe the model to use the appropriate subset of attributes (the feature configuration) during deployment time. In other words, models are trained with the available attributes (once and for all) and then deployed by setting missing values on the attributes that are deemed ineffective for reducing the joint cost. As the number of feature configuration combinations grows exponentially with the number of features we introduce quadratic methods that are able to approximate the optimal configuration and model choices, as shown by the experimental results.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。