arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv cs/0403020cs.DB
收藏

斯隆数字巡天科学档案:将多TB天文档案从对象迁移到关系DBMS

The Sloan Digital Sky Survey Science Archive: Migrating a Multi-Terabyte Astronomical Archive from Object to Relational DBMS

Aniruddha R. Thakar, Alexander S. Szalay, Peter Z. Kunszt, Jim Gray

摘要:

斯隆数字巡天科学档案馆是天文学和其他数据密集型科学的一系列多TB数字档案中的第一个。为了便于SDSS存档中的数据采掘,我们采用了一个商业数据库引擎,并在其上构建了专门的工具。最初,我们选择了一个面向对象的数据库管理系统,由于其数据组织能力,平台独立性,查询性能和概念上适合的数据。然而,在项目的前几年使用对象数据库之后,它很快就开始在查询支持和数据采掘性能方面出现不足。这是由于数据库供应商无法响应我们对功能和错误修复的需求,因为他们未能跟上硬件性能的快速改进,特别是更快的RAID磁盘系统。最后,我们被迫放弃对象数据库,将我们的数据迁移到关系数据库。我们在下面描述了我们在对象数据库方面所面临的技术问题,以及我们如何以及为什么迁移到关系技术。

英文摘要:

The Sloan Digital Sky Survey Science Archive is the first in a series of multi-Terabyte digital archives in Astronomy and other data-intensive sciences. To facilitate data mining in the SDSS archive, we adapted a commercial database engine and built specialized tools on top of it. Originally we chose an object-oriented database management system due to its data organization capabilities, platform independence, query performance and conceptual fit to the data. However, after using the object database for the first couple of years of the project, it soon began to fall short in terms of its query support and data mining performance. This was as much due to the inability of the database vendor to respond our demands for features and bug fixes as it was due to their failure to keep up with the rapid improvements in hardware performance, particularly faster RAID disk systems. In the end, we were forced to abandon the object database and migrate our data to a relational database. We describe below the technical issues that we faced with the object database and how and why we migrated to relational technology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑