arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2002.04436cs.DC
收藏

pSPICE:用于复杂事件处理的部分匹配脱落

pSPICE: Partial Match Shedding for Complex Event Processing

Ahmad Slo, Sukanya Bhowmik, Albert Flaig, Kurt Rothermel

摘要:

复杂事件处理(CEP)系统连续地处理输入事件流以检测模式。随着时间的推移,输入事件率可能会波动并超过系统的能力。减少系统过载的一种方法是使用甩负荷。在本文中,我们提出了一种CEP系统的甩负荷策略,该策略丢弃了CEP操作员的一部分内部状态(a.k.a.部分匹配)以维持给定的等待时间界限。这里的关键问题是要丢弃多少部分匹配以及哪些部分匹配,以便在保持给定延迟界限的同时最大限度地降低结果质量。在流处理领域,已经提出了不同的减载策略,主要取决于各个元组的重要性。然而,当CEP系统执行模式检测时,事件的重要性也受到流中其他事件的影响。我们的甩负荷策略使用马尔可夫链和马尔可夫奖励过程来预测部分匹配的效用/重要性,以确定要丢弃的。此外,我们代表的方式,最大限度地减少负荷削减的开销的实用程序。此外,我们提供算法来决定何时开始丢弃部分匹配以及丢弃多少部分匹配。通过对三个真实数据集和几个代表性查询的广泛评估,我们表明我们的减载策略对结果质量的不利影响远远小于最先进的减载策略的影响。

英文摘要:

Complex event processing (CEP) systems continuously process input event streams to detect patterns. Over time, the input event rate might fluctuate and overshoot the system's capabilities. One way to reduce the overload on the system is to use load shedding. In this paper, we propose a load shedding strategy for CEP systems which drops a portion of the CEP operator's internal state (a.k.a. partial matches) to maintain a given latency bound. The crucial question here is how many and which partial matches to drop so that a given latency bound is maintained while minimizing the degradation in the quality of results. In the stream processing domain, different load shedding strategies have been proposed that mainly depend on the importance of individual tuples. However, as CEP systems perform pattern detection, the importance of events is also influenced by other events in the stream. Our load shedding strategy uses Markov chain and Markov reward process to predict the utility/importance of partial matches to determine the ones to be dropped. In addition, we represent the utility in a way that minimizes the overhead of load shedding. Furthermore, we provide algorithms to decide when to start dropping partial matches and how many partial matches to drop. By extensively evaluating our approach on three real-world datasets and several representative queries, we show that the adverse impact of our load shedding strategy on the quality of results is considerably less than the impact of state-of-the-art load shedding strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑