使用高性能数据云的数据采掘:使用扇形和球形的实验研究
Data Mining Using High Performance Data Clouds: Experimental Studies Using Sector and Sphere
摘要:
我们描述了一个高性能云的设计和实现,我们已经用来归档,分析和挖掘大型分布式数据集。云是指通过互联网提供资源和/或服务的基础设施。存储云提供存储服务,而计算云提供计算服务。我们描述了Sector存储云的设计,以及它如何提供Sphere计算云所需的存储服务。我们还描述了由Sphere计算云支持的编程范式。Sector和Sphere设计用于使用与广域高性能网络(例如,10+ Gb/s)连接的计算机集群分析大型数据集。我们描述了一个分布式的数据采掘应用程序,我们已经开发了使用部门和球体。最后,我们描述了一些比较Sector/Sphere和Hadoop的实验研究。
英文摘要:
We describe the design and implementation of a high performance cloud that we have used to archive, analyze and mine large distributed data sets. By a cloud, we mean an infrastructure that provides resources and/or services over the Internet. A storage cloud provides storage services, while a compute cloud provides compute services. We describe the design of the Sector storage cloud and how it provides the storage services required by the Sphere compute cloud. We also describe the programming paradigm supported by the Sphere compute cloud. Sector and Sphere are designed for analyzing large data sets using computer clusters connected with wide area high performance networks (for example, 10+ Gb/s). We describe a distributed data mining application that we have developed using Sector and Sphere. Finally, we describe some experimental studies comparing Sector/Sphere to Hadoop.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。