使用Tunable-LSH聚类RDF数据库
Clustering RDF Databases Using Tunable-LSH
摘要:
资源描述框架(RDF)是表示图结构数据的W3C标准,SPARQL是RDF的标准查询语言。信息抽取、链接数据管理和语义网的最新进展导致了可公开获得的RDF数据的数量和种类的快速增长。随着企业开始利用RDF数据,RDF数据管理系统面临的工作负载比它们设计处理的要多样化和动态得多。因此,越来越需要开发工作负载自适应和自调优的RDF数据管理系统。为了实现这一愿景,我们介绍了一种快速,有效的方法动态聚类RDF数据管理系统中的记录。具体来说,我们预先不假设工作负载,但是当执行SPARQL查询时,我们跟踪工作负载中的查询共同访问的记录,并对它们进行物理集群。为了动态地(因此,在恒定的时间)决定一个记录需要放置在存储系统中,我们开发了一个新的位置敏感的哈希(LSH)计划,可调LSH。使用Tunable-LSH,可以将跨类似查询集共同访问的记录散列到存储系统中的相同或附近的物理页面。Tunable-LSH与现有LSH方案的区别在于,它可以自动调整,即使在工作负载发生变化时也能高精度地实现上述集群目标。Tunable-LSH在我们的原型RDF数据管理系统,变色龙数据库,以及在一个独立的哈希表中的实验评估显示显着的端到端的改进现有的解决方案。
英文摘要:
The Resource Description Framework (RDF) is a W3C standard for representing graph-structured data, and SPARQL is the standard query language for RDF. Recent advances in Information Extraction, Linked Data Management and the Semantic Web have led to a rapid increase in both the volume and the variety of RDF data that are publicly available. As businesses start to capitalize on RDF data, RDF data management systems are being exposed to workloads that are far more diverse and dynamic than what they were designed to handle. Consequently, there is a growing need for developing workload-adaptive and self-tuning RDF data management systems. To realize this vision, we introduce a fast and efficient method for dynamically clustering records in an RDF data management system. Specifically, we assume nothing about the workload upfront, but as SPARQL queries are executed, we keep track of records that are co-accessed by the queries in the workload and physically cluster them. To decide dynamically (hence, in constant-time) where a record needs to be placed in the storage system, we develop a new locality-sensitive hashing (LSH) scheme, Tunable-LSH. Using Tunable-LSH, records that are co-accessed across similar sets of queries can be hashed to the same or nearby physical pages in the storage system. What sets Tunable-LSH apart from existing LSH schemes is that it can auto-tune to achieve the aforementioned clustering objective with high accuracy even when the workloads change. Experimental evaluation of Tunable-LSH in our prototype RDF data management system, chameleon-db, as well as in a standalone hashtable shows significant end-to-end improvements over existing solutions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。