arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.12417cs.DB
收藏

位置感知Pub/Sub的分布式空间关键字kNN监控

Distributed Spatial-Keyword kNN Monitoring for Location-aware Pub/Sub

Shohei Tsuruoka, Daichi Amagata, Shunya Nishio, Takahiro Hara

摘要:

最近的应用采用发布/订阅(Pub/Sub)系统,使得发布者可以容易地接收客户的注意,并且订阅者可以监视由发布者生成的有用信息。由于智能设备和社交网络服务的普及,大量包含空间和关键字信息的对象不断产生,订阅者的数量也不断增加。这对Pub/Sub系统提出了一个挑战:它们需要实时的从每个订阅者的大量对象中连续提取有用的信息。在本文中,我们解决的问题,k最近邻监测的空间关键字数据流的大量订阅。为了很好地扩展到大规模的对象和订阅,我们提出了一个分布式的解决方案,即DkM-SKS。给定m个工作者,DkM-SKS基于成本模型将一组订阅划分为m个不相交的子集,使得每个工作者具有几乎相同的kNN更新成本,以保持负载均衡。DkM-SKS允许使用任意方法来更新每个订阅的kNN,因此使用合适的内存索引,DkM-SKS可以通过为给定的新对象修剪不相关的订阅来加快更新效率。我们在真实数据集上进行了实验,结果证明了DkM-SKS的效率和可扩展性。

英文摘要:

Recent applications employ publish/subscribe (Pub/Sub) systems so that publishers can easily receive attentions of customers and subscribers can monitor useful information generated by publishers. Due to the prevalence of smart devices and social networking services, a large number of objects that contain both spatial and keyword information have been generated continuously, and the number of subscribers also continues to increase. This poses a challenge to Pub/Sub systems: they need to continuously extract useful information from massive objects for each subscriber in real time. In this paper, we address the problem of k nearest neighbor monitoring on a spatial-keyword data stream for a large number of subscriptions. To scale well to massive objects and subscriptions, we propose a distributed solution, namely DkM-SKS. Given m workers, DkM-SKS divides a set of subscriptions into m disjoint subsets based on a cost model so that each worker has almost the same kNN-update cost, to maintain load balancing. DkM-SKS allows an arbitrary approach to updating kNN of each subscription, so with a suitable in-memory index, DkM-SKS can accelerate update efficiency by pruning irrelevant subscriptions for a given new object. We conduct experiments on real datasets, and the results demonstrate the efficiency and scalability of DkM-SKS.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑