流处理中的离散化和弹性问题综述
A Comprehensive Survey on Parallelization and Elasticity in Stream Processing
摘要:
流处理(SP)已经发展为处理例如在物联网领域中产生的大量流数据并从中获得价值的领先范例。SP系统是一个中间件,它在数据源(如传感器)和消费应用程序之间部署操作员网络。SP系统通常面临密集和高度动态的数据流。灵活性和弹性使SP系统能够以持续高的服务质量处理这些流。目前的研究景观提供了广泛的方法,并行化和弹性的SP。每种方法都有特定的假设,并侧重于特定方面的问题。然而,文献缺乏一个全面的概述和分类的最先进的SP并行化和弹性,这是必要的,以巩固国家的研究,并在此基础上规划未来的研究方向。因此,在这次调查中,我们研究了文献,并开发了一个分类的SP系统的并行化和弹性的当前方法。
英文摘要:
Stream Processing (SP) has evolved as the leading paradigm to process and gain value from the high volume of streaming data produced e.g. in the domain of the Internet of Things. An SP system is a middleware that deploys a network of operators between data sources, such as sensors, and the consuming applications. SP systems typically face intense and highly dynamic data streams. Parallelization and elasticity enables SP systems to process these streams with continuously high quality of service. The current research landscape provides a broad spectrum of methods for parallelization and elasticity in SP. Each method makes specific assumptions and focuses on particular aspects of the problem. However, the literature lacks a comprehensive overview and categorization of the state of the art in SP parallelization and elasticity, which is necessary to consolidate the state of the research and to plan future research directions on this basis. Therefore, in this survey, we study the literature and develop a classification of current methods for both parallelization and elasticity in SP systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。