arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.02112cs.LGcs.DSstat.ML
收藏

蒙特卡罗相关估计

Monte Carlo Dependency Estimation

Karlsruhe Institute of Technology (KIT)(卡尔斯鲁厄理工学院)

Edouard Fouché, Klemens Böhm

摘要:

估计变量的相关性是数据分析中的一项基本任务。识别数据库中的相关属性可以更好地理解数据,并在运行时间和质量方面提高学习算法的性能。在数据流中,依赖性监控提供了对底层流程的关键洞察,但具有挑战性。在本文中,我们提出了蒙特卡罗依赖估计(MCDE),一个理论框架,以估计静态和动态数据中的多变量依赖。MCDE通过蒙特卡罗模拟将依赖性量化为边际分布和条件分布之间的平均差异。在此基础上,我们提出了一种新的依赖估计方法--Mann-Whitney P(MWP)。我们表明,MWP满足一些理想的属性,可以容纳任何类型的数值数据。我们证明了我们的估计的优越性,通过比较它的国家的最先进的多元依赖措施。

英文摘要:

Estimating the dependency of variables is a fundamental task in data analysis. Identifying the relevant attributes in databases leads to better data understanding and also improves the performance of learning algorithms, both in terms of runtime and quality. In data streams, dependency monitoring provides key insights into the underlying process, but is challenging. In this paper, we propose Monte Carlo Dependency Estimation (MCDE), a theoretical framework to estimate multivariate dependency in static and dynamic data. MCDE quantifies dependency as the average discrepancy between marginal and conditional distributions via Monte Carlo simulations. Based on this framework, we present Mann-Whitney P (MWP), a novel dependency estimator. We show that MWP satisfies a number of desirable properties and can accommodate any kind of numerical data. We demonstrate the superiority of our estimator by comparing it to the state-of-the-art multivariate dependency measures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑