arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1703.09807cs.DB
收藏

基于网格的分布式数据采掘应用

Grid-based Approaches for Distributed Data Mining Applications

Lamine M. Aouad, Nhien-An Le-Khac, Tahar Kechadi

摘要:

数据采掘领域是大规模应用和数据集的重要来源,其应用越来越普遍。在本文中,我们提出了基于网格的方法,两个基本的数据采掘应用程序,和一个性能评估的实验网格环境,提供有趣的监控功能和配置工具。我们提出了一个新的分布式聚类方法和分布式频繁项集生成很好地适应网格环境。性能评估使用Condor系统及其工作流管理器DAGMan完成。我们还比较了这个性能分析一个简单的分析模型,以评估与工作流引擎和底层网格系统的开销。这将明确表明,现实的性能预期目前很难在网格上实现。

英文摘要:

The data mining field is an important source of large-scale applications and datasets which are getting more and more common. In this paper, we present grid-based approaches for two basic data mining applications, and a performance evaluation on an experimental grid environment that provides interesting monitoring capabilities and configuration tools. We propose a new distributed clustering approach and a distributed frequent itemsets generation well-adapted for grid environments. Performance evaluation is done using the Condor system and its workflow manager DAGMan. We also compare this performance analysis to a simple analytical model to evaluate the overheads related to the workflow engine and the underlying grid system. This will specifically show that realistic performance expectations are currently difficult to achieve on the grid.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑