arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1402.7063cs.DB
收藏

快速AkNN查询处理,用于云中多维数据的快速分类

Rapid AkNN Query Processing for Fast Classification of Multidimensional Data in the Cloud

Nikolaos Nodarakis, Spyros Sioutas, Dimitrios Tsoumakos, Giannis Tzimas, Evaggelia Pitoura

摘要:

$k$ -最近邻($k$ NN)查询使用距离度量确定距特定位置的$k$最近点。全$k$最近邻($k$ NN)查询构成$k$ NN查询的变体,并且检索数据库内的每个点的$k$最近点。它们的主要用途在空间数据库中产生共鸣,它们构成了许多基于位置的应用程序的主干,不仅如此(即$k$ NN加入数据库,数据采掘中的分类)。因此,开发有效解决这些问题的方法至关重要。在这项工作中,我们提出了一种新的方法分类多维数据使用一个$k$ NN算法在MapReduce框架。我们的方法利用空间分解技术以并行和分布式的方式处理分类过程。据我们所知,我们是第一个在这个角度下研究多维对象的分类。通过广泛的实验评估,我们证明了我们的解决方案是有效的和可扩展的处理给定的查询。我们调查了许多不同的角度,可以影响总的计算成本,如不同的数据集分布,维数,增长的$k$值和粒度的空间分解,并证明我们的系统是有效的,鲁棒性和可扩展性。

英文摘要:

A $k$-nearest neighbor ($k$NN) query determines the $k$ nearest points, using distance metrics, from a specific location. An all $k$-nearest neighbor (A$k$NN) query constitutes a variation of a $k$NN query and retrieves the $k$ nearest points for each point inside a database. Their main usage resonates in spatial databases and they consist the backbone of many location-based applications and not only (i.e. $k$NN joins in databases, classification in data mining). So, it is very crucial to develop methods that answer them efficiently. In this work, we propose a novel method for classifying multidimensional data using an A$k$NN algorithm in the MapReduce framework. Our approach exploits space decomposition techniques for processing the classification procedure in a parallel and distributed manner. To our knowledge, we are the first to study the classification of multidimensional objects under this perspective. Through an extensive experimental evaluation we prove that our solution is efficient and scalable in processing the given queries. We investigate many different perspectives that can affect the total computational cost, such as different dataset distributions, number of dimensions, growth of $k$ value and granularity of space decomposition and prove that our system is efficient, robust and scalable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑