数据流管理系统中基于标点符号的操作员间反馈
Inter-Operator Feedback in Data Stream Management Systems via Punctuation
摘要：
大容量、高速的数据流可能会压倒流处理系统的能力;数据优先级排序、避免不必要的处理和按需结果生成等技术可能是降低处理要求所必需的。然而，数据流在速率和内容方面的动态性质使得这些技术的应用具有挑战性。这样的技术已经在静态和集中式查询优化的上下文中被解决;然而，它们还没有被完全解决用于数据流管理系统。在这项工作中，我们提出了一个全面的框架，支持优先级，避免不必要的工作，并按需结果生产的分布式，不可靠的，突发的，无序的数据源，典型的许多数据流。我们提出了一种形式的运营商间的反馈，它的流动对流的方向，沟通所需的信息，使这些技术的执行。该反馈利用标点来描述感兴趣的子集。我们确定反馈信息的潜在来源，表征新类型的标点符号，以支持反馈，并描述查询操作员可能实现的反馈的生产者，开发者和中继器的角色。我们提出了使用NiagaraST数据流系统的初步实验观察。
英文摘要：
High-volume, high-speed data streams may overwhelm the capabilities of stream processing systems; techniques such as data prioritization, avoidance of unnecessary processing and on-demand result production may be necessary to reduce processing requirements. However, the dynamic nature of data streams, in terms of both rate and content, makes the application of such techniques challenging. Such techniques have been addressed in the context of static and centralized query optimization; however, they have not been fully addressed for data stream management systems. In this work, we present a comprehensive framework that supports prioritization, avoidance of unnecessary work, and on-demand result production over distributed, unreliable, bursty, disordered data sources, typical of many data streams. We propose a form of inter-operator feedback, which flows against the stream direction, to communicate the information needed to enable execution of these techniques. This feedback leverages punctuations to describe the subsets of interest. We identify potential sources of feedback information, characterize new types of punctuation to support feedback, and describe the roles of producers, exploiters, and relayers of feedback that query operators may implement. We present initial experimental observations using the NiagaraST data-stream system.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
