arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1807.05694eess.SPcs.ITmath.IT
收藏

大数据中的小概率事件检测:贝叶斯测试和MIM的集成方法

Minor probability events detection in big data: An integrated approach with Bayesian testing and MIM

Shuo Wan, Jiaxun Lu, Pingyi Fan, Khaled B. Letaief

摘要:

小概率事件检测是大数据中的一个关键问题。这些事件往往包括很少发生的现象,应仔细检测和监测。在给定事件的先验概率和观测值的条件分布的情况下,贝叶斯检测可以应用于估计观测值后面的事件。证明了贝叶斯检测在平均意义下具有最小的总体测试误差。然而,当检测事件的先验概率很小,条件贝叶斯检测会导致高的漏测率。针对这一问题,提出了一种基于贝叶斯检测和消息重要性度量的改进检测方法,该方法能够在检测概率较小的事件的情况下降低误测率。该结果有助于挖掘大数据中的小概率事件。

英文摘要:

The minor probability events detection is a crucial problem in Big data. Such events tend to include rarely occurring phenomenons which should be detected and monitored carefully. Given the prior probabilities of separate events and the conditional distributions of observations on the events, the Bayesian detection can be applied to estimate events behind the observations. It has been proved that Bayesian detection has the smallest overall testing error in average sense. However, when detecting an event with very small prior probability, the conditional Bayesian detection would result in high miss testing rate. To overcome such a problem, a modified detection approach is proposed based on Bayesian detection and message importance measure, which can reduce miss testing rate in conditions of detecting events with minor probability. The result can help to dig minor probability events in big data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑