arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0701167cs.DBcs.CE
收藏

大规模查询和XMatch,进入并行区

Large-Scale Query and XMatch, Entering the Parallel Zone

Maria A. Nieto-Santisteban, Aniruddha R. Thakar, Alexander S. Szalay, Jim Gray

摘要:

当前和未来的天文调查正在产生数百万和数十亿物体的目录。为了数据采掘和互相关而在线访问这样的大数据集通常是高度期望的,因为不可行。提供这些能力对于虚拟天文台框架正变得至关重要。在本文中,我们提出了各种性能测试,显示如何使用关系数据库管理系统(RDBMS)和分区算法的分区和并行计算,我们可以方便大规模的查询和交叉匹配。

英文摘要:

Current and future astronomical surveys are producing catalogs with millions and billions of objects. On-line access to such big datasets for data mining and cross-correlation is usually as highly desired as unfeasible. Providing these capabilities is becoming critical for the Virtual Observatory framework. In this paper we present various performance tests that show how using Relational Database Management Systems (RDBMS) and a Zoning algorithm to partition and parallelize the computation, we can facilitate large-scale query and cross-match.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑