arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv cs/0504042cs.AIcs.LG
收藏

具有扫描策略的贝叶斯决策树技术

The Bayesian Decision Tree Technique with a Sweeping Strategy

V. Schetinin, J. E. Fieldsend, D. Partridge, W. J. Krzanowski, R. M. Everson, T. C. Bailey, A. Hernandez

摘要:

分类结果的不确定性对于许多安全关键应用(包括例如医疗诊断)是至关重要的。在这样的应用中,分类的不确定性可以在贝叶斯模型平均技术内可靠地估计,该技术允许使用先验信息。在这种技术中使用的决策树(DT)分类模型通过使该分类方案可观察而向专家提供附加信息。随机抽样的马尔可夫链蒙特卡罗(MCMC)方法的使用使得贝叶斯DT技术可行。然而,在实践中,MCMC技术可能会卡在远离具有最大后验的区域的特定DT中。对此类DT进行采样会导致后验估计值出现偏差,因此分类不确定性的评估可能不正确。在特定情况下,可以通过给出关于DT形状的附加先验信息来减少这种采样的负面影响。在本文中,我们描述了一种新的方法的基础上,扫描的DT没有额外的先验的DT的最喜欢的形状。在合成数据和真实数据集上比较了贝叶斯DT技术与标准策略和扫描策略的性能。定量评估类后验概率熵的不确定性,我们发现,清扫策略优于标准策略。

英文摘要:

The uncertainty of classification outcomes is of crucial importance for many safety critical applications including, for example, medical diagnostics. In such applications the uncertainty of classification can be reliably estimated within a Bayesian model averaging technique that allows the use of prior information. Decision Tree (DT) classification models used within such a technique gives experts additional information by making this classification scheme observable. The use of the Markov Chain Monte Carlo (MCMC) methodology of stochastic sampling makes the Bayesian DT technique feasible to perform. However, in practice, the MCMC technique may become stuck in a particular DT which is far away from a region with a maximal posterior. Sampling such DTs causes bias in the posterior estimates, and as a result the evaluation of classification uncertainty may be incorrect. In a particular case, the negative effect of such sampling may be reduced by giving additional prior information on the shape of DTs. In this paper we describe a new approach based on sweeping the DTs without additional priors on the favorite shape of DTs. The performances of Bayesian DT techniques with the standard and sweeping strategies are compared on a synthetic data as well as on real datasets. Quantitatively evaluating the uncertainty in terms of entropy of class posterior probabilities, we found that the sweeping strategy is superior to the standard strategy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑