arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.07259cs.DS
收藏

一种通信高效的Top-k和k-Select分布式数据结构

A Communication-Efficient Distributed Data Structure for Top-k and k-Select Queries

Felix Biermeier, Björn Feldkord, Manuel Malatyali, Friedhelm Meyer auf der Heide

摘要:

我们考虑的情况下,$n$传感器节点观察数据流。节点连接到中央服务器,其任务是计算节点观察到的所有数据项的某个函数。在我们的例子中,节点观察到的数据项存在一个全序。我们的目标是计算$k$当前最低观测值或在概率为$(1-δ)$的情况下在$[(1-\varepsilon)k,(1+\varepsilon)k]$中具有秩的值。我们提出了这些问题的解决方案,在分布式监控模型的扩展,服务器可以发送广播消息到所有节点的单位成本。我们希望最小化多个时间步上的通信,其中在查询之间存在对节点值的$m$更新。结果由两个主要部分组成,每个部分可能是独立的兴趣:(1)回答Top-k和k-Select查询的协议。这些协议是无记忆的,因为它们在请求时收集所有信息。(2)一种动态数据结构,其为每个$k$跟踪接近于$k$的元素。我们描述了如何将这两个部分结合起来,以接收一个协议,在多个时间步长上回答所述查询。总的来说,对于Top- $k$查询,我们使用$O(k + \log m + \log \log n)$,对于$k$ -Select查询,我们使用预期的$O(\frac{1}{\varepsilon^2} \log \frac{1}δ + \log m + \log^2 \log n)$消息。如果$m$不太小,这些结果是渐近紧的.

英文摘要:

We consider the scenario of $n$ sensor nodes observing streams of data. The nodes are connected to a central server whose task it is to compute some function over all data items observed by the nodes. In our case, there exists a total order on the data items observed by the nodes. Our goal is to compute the $k$ currently lowest observed values or a value with rank in $[(1-\varepsilon)k,(1+\varepsilon)k]$ with probability $(1-δ)$. We propose solutions for these problems in an extension of the distributed monitoring model where the server can send broadcast messages to all nodes for unit cost. We want to minimize communication over multiple time steps where there are $m$ updates to a node's value in between queries. The result is composed of two main parts, which each may be of independent interest: (1) Protocols which answer Top-k and k-Select queries. These protocols are memoryless in the sense that they gather all information at the time of the request. (2) A dynamic data structure which tracks for every $k$ an element close to $k$. We describe how to combine the two parts to receive a protocol answering the stated queries over multiple time steps. Overall, for Top-$k$ queries we use $O(k + \log m + \log \log n)$ and for $k$-Select queries $O(\frac{1}{\varepsilon^2} \log \frac{1}δ + \log m + \log^2 \log n)$ messages in expectation. These results are shown to be asymptotically tight if $m$ is not too small.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑