Massive RDF data sets are becoming commonplace. RDF data is typically generated in social semantic domains (such as personal information management) wherein a fixed schema is often not available a priori. We propose a simple Three-way Triple Tree (TripleT) secondary-memory indexing technique to facilitate efficient SPARQL query evaluation on such data sets. The novelty of TripleT is that (1) the index is built over the atoms occurring in the data set, rather than at a coarser granularity, such as whole triples occurring in the data set; and (2) the atoms are indexed regardless of the roles (i.e., subjects, predicates, or objects) they play in the triples of the data set. We show through extensive empirical evaluation that TripleT exhibits multiple orders of magnitude improvement over the state of the art on RDF indexing, in terms of both storage and query processing costs.
Supporting SPARQL Update Queries in RDF-XML Integration
Web of Data鼓励组织和公司根据关联数据实践发布数据,并提供SPARQL端点。另一方面,信息交换的主导标准是XML。SPARQL 2XQuery框架专注于自动转换XQuery表达式中的SPARQL查询,以便通过Web访问XML数据。在本文中,我们概述了我们正在进行的工作,支持更新查询的RDF-XML集成方案。
RDF has seen increased adoption in recent years, prompting the standardization of the SPARQL query language for RDF, and the development of local and distributed engines for processing SPARQL queries. This survey paper provides a comprehensive review of techniques and systems for querying RDF knowledge graphs. While other reviews on this topic tend to focus on the distributed setting, the main focus of the work is on providing a comprehensive survey of state-of-the-art storage, indexing and query processing techniques for efficiently evaluating SPARQL queries in a local setting (on one machine…
Semantic Web technologies are widely used for storing RDF data and making them available on the Web through SPARQL endpoints, queryable using the SPARQL query language. While the use of SPARQL endpoints is strongly supported by Semantic Web experts, it hinders broader use of RDF data by common Web users, engineers and developers unfamiliar with Semantic Web technologies, who normally rely on Web RESTful APIs for querying Web-available data and creating applications over them. To solve this problem, we have developed RAMOSE, a generic tool developed in Python to create REST APIs over SPARQL end…
Wangxuan Institute of Computer Technology (WICT), Peking University(北京大学王选计算机研究所);Beijing Institute for General Artificial Intelligence (BIGAI)(北京通用人工智能研究院)
Semantic Web technology has successfully facilitated many RDF models with rich data representation methods. It also has the potential ability to represent and store multimodal knowledge bases such as multimodal scene graphs. However, most existing query languages, especially SPARQL, barely explore the implicit multimodal relationships like semantic similarity, spatial relations, etc. We first explored this issue by organizing a large-scale scene graph dataset, namely Visual Genome, in the RDF graph database. Based on the proposed RDF-stored multimodal scene graph, we extended SPARQL queries to…
RDF以其灵活、通用的类图数据模型成为语义数据发布的主流。然而,RDF数据汇集的规模不断增加,使得在一台机器上存储和处理它们变得越来越不可行,从而提高了对分布式方法的需求。我们不构建独立但封闭的分布式RDF存储,而是支持使用现有的基础设施进行大数据处理,例如Hadoop。然而,SPARQL查询性能是一个主要的挑战,因为这些平台不是为地面RDF处理而设计的。因此,现有的基于Hadoop的方法通常倾向于某些查询模式形状,而其他形状的性能显着下降。在本文中,我们描述了一种新的RDF数据的关系分区模式称为ExtVP,使用半连接为基础的预处理,类似于连接索引的概念,在关系数据库,有效地减少查询输入的大小,无论其模式的形状和直径。我们的原型系统S2RDF构建在Spark之上,并使用其关系接口在ExtVP上执行SPARQL查询。我们使用最近的WatDiv测试套件,与最先进的SPARQL on Hadoop方法相比,展示了其卓越的性能。S2RDF在十亿个三元组RDF图上实现了大多数查询的次秒运行时间。
The Semantic Web research community understood since its beginning how crucial it is to equip practitioners with methods to transform non-RDF resources into RDF. Proposals focus on either engineering content transformations or accessing non-RDF resources with SPARQL. Existing solutions require users to learn specific mapping languages (e.g. RML), to know how to query and manipulate a variety of source formats (e.g. XPATH, JSON-Path), or to combine multiple languages (e.g. SPARQL Generate). In this paper, we explore an alternative solution and contribute a general-purpose meta-model for convert…
A Novel Approach for Generating SPARQL Queries from RDF Graphs
Université De Tunis El Manar(突尼斯埃尔马纳尔大学);Faculté Des Sciences De Tunis(突尼斯理学院);Faculté des Sciences Économiques et de Gestion de Tunis(突尼斯经济与管理科学学院);Faculté des Sciences juridique Économique et de Gestion de Jendouba(坚杜拜法律经济与管理科学学院)
Qatar Computing Research Institute, HBKU(卡塔尔计算研究所,哈马德·本·哈利法大学);College of Science and Engineering, HBKU(哈马德·本·哈利法大学科学与工程学院);Bluescape(Bluescape公司);Technische Universität Berlin(柏林工业大学)
Knowledge graphs represented as RDF datasets are integral to many machine learning applications. RDF is supported by a rich ecosystem of data management systems and tools, most notably RDF database systems that provide a SPARQL query interface. Surprisingly, machine learning tools for knowledge graphs do not use SPARQL, despite the obvious advantages of using a database system. This is due to the mismatch between SPARQL and machine learning tools in terms of data model and programming style. Machine learning tools work on data in tabular format and process it using an imperative programming st…
Compressed k2-Triples for Full-In-Memory RDF Engines
当前的“数据洪流”已经用非常大的RDF数据集淹没了Web of Data。它们通过SPARQL端点托管和查询,SPARQL端点充当基于关联数据项目原则构建的语义网络的节点。尽管这是全局数据发布的现实哲学,但当RDF引擎(在端点后面)管理这些巨大的数据集时,其查询性能会降低。它们的索引不能完全加载到主存中,因此这些系统需要执行缓慢的磁盘访问来解决SPARQL查询。本文通过一种紧凑的索引RDF结构(称为k2-triples)来解决这个问题,该结构将紧凑的k2-树结构应用于众所周知的垂直划分技术。它获得了大型RDF图的超压缩表示,并允许SPARQL查询在内存中完全执行而无需解压缩。我们表明,k2-三元组明显优于国家的最先进的压缩性和传统的垂直分区查询分辨率,保持非常有竞争力的多索引解决方案。
XQOWL: An Extension of XQuery for OWL Querying and Reasoning
所谓的Web of Data的主要目标之一是能够处理异构资源,其中数据可以用XML或RDF表示。设计能够同时处理XML和RDF数据的程序设计语言是这方面的一个关键目标。在本文中,我们提出了一个框架,称为XQOWL,使处理XML和RDF/OWL数据与XQuery。XQOWL可以被认为是XQuery语言的扩展,它将XQuery与SPARQL和OWL推理器连接起来。XQOWL将SPARQL查询(通过Jena SPARQL引擎)嵌入到XQuery中,并允许从XQuery调用OWL推理机(HermiT,Pellet和FaCT++)。它允许结合对XML和RDF/OWL资源的查询,以及对RDF/OWL数据的推理。因此,输入数据可以是XML或RDF/OWL,而输出数据可以用XML格式化(也使用RDF/OWL XML序列化)。
How can we maximize the value of accumulated RDF data? Whereas the RDF data can be queried using the SPARQL language, even the SPARQL-based operation has a limitation in implementing traversal or analytical algorithms. Recently, a variety of database implementations dedicated to analyses on the property graph (PG) model have emerged. Importing RDF datasets into these graph analysis engines provides access to the accumulated datasets through various application interfaces. However, the RDF model and the PG model are not interoperable. Here, we developed a framework based on the Graph to Graph M…
This document defines extensions of the RDF data model and of the SPARQL query language that capture an alternative approach to represent statement-level metadata. While this alternative approach is backwards compatible with RDF reification as defined by the RDF standard, the approach aims to address usability and data management shortcomings of RDF reification. One of the great advantages of the proposed approach is that it clarifies a means to (i) understand sparse matrices, the property graph model, hypergraphs, and other data structures with an emphasis on link attributes, (ii) map such da…
Efficient execution of SPARQL queries over large RDF datasets is a topic of considerable interest due to increased use of RDF to encode data. Most of this work has followed either relational or graph-based approaches. In this paper, we propose an alternative query engine, called gSmart, based on matrix algebra. This approach can potentially better exploit the computing power of high-performance heterogeneous architectures that we target. gSmart incorporates: (1) grouped incident edge-based SPARQL query evaluation, in which all unevaluated edges of a vertex are evaluated together using a series…
The SPARQL2XQuery Interoperability Framework. Utilizing Schema Mapping, Schema Transformation and Query Translation to Integrate XML and the Semantic Web
Web of Data是一个开放的环境,由来自不同领域的大量相互链接的大型RDF数据集组成。在这种环境中,组织和公司采用利用语义Web(SW)技术的关联数据实践,以便发布他们的数据并提供SPARQL端点(即,基于SPARQL的搜索服务)。另一方面,当今Web中信息交换的主导标准是XML。SW和XML世界及其开发的基础设施基于不同的数据模型、语义和查询语言。因此,至关重要的是开发互操作性机制,允许Web of Data用户从他们自己的工作环境中使用SPARQL访问XML数据集。期望所有现有的遗留数据(例如,关系、XML等)将转换为软件数据。因此,将遗留数据发布为关联数据并在其上提供SPARQL端点已成为一个主要的研究挑战。在这个方向上,我们引入了SPARQL 2XQuery框架,它创建了一个可互操作的环境,SPARQL查询自动转换为XQuery查询,以便在Web上访问XML数据。SPARQL 2XQuery框架为OWL-RDF/S到XML Schema映射的表达提供了一个映射模型,也为SPARQL到XQuery的转换提供了一种方法。为此,我们的框架支持本体和XML模式之间的手动和自动映射规范。在自动映射规范场景中,SPARQL 2XQuery利用将XML模式转换为OWL本体的XS 2 OWL组件。最后,进行了大量的实验,以评估模式转换,映射生成,查询翻译和查询评估效率,使用真实和合成…