arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.02845cs.DCcs.LG
收藏

基于微服务的BDA应用组合、部署和执行平台

A Novel Micro-service Based Platform for Composition, Deployment and Execution of BDA Applications

Engineering Ingegneria Informatica SpA(工程信息工程股份公司)

Davide Profeta, Nicola Masi, Domenico Messina, Davide Dalle Carbonare, Susanna Bonura, Vito Morreale

摘要:

大数据正在以指数级速度增长,因此有必要使用工具和技术来管理,处理和可视化它们,以提取价值。本文提出了一个基于微服务的平台,用于在多个领域和场景中组合、部署和执行大数据分析(BDA)应用程序工作流。ALIDA是工程部以前研究活动的结果。它旨在实现一个统一的平台,允许BDA应用程序开发人员和数据分析师与之交互。开发人员将能够通过公开的API和/或通过Web用户界面注册新的BDA应用程序。数据分析师将能够使用提供的BDA应用程序,通过仪表板用户界面创建批处理/流工作流,以操纵并随后可视化来自一个或多个源的结果。该平台还支持大数据框架部署属性的自动调整,以改善分析应用程序的指标。ALIDA已被适当扩展并集成到一个软件解决方案中,用于分析航空电子工业的大量数据。然后给出了此上下文中的一个用例。

英文摘要:

Big Data are growing at an exponential rate and it becomes necessary the use of tools and technologies to manage, process and visualize them in order to extract value. In this paper a micro-service based platform is presented for the composition, deployment and execution of Big Data Analytics (BDA) application workflows in several domains and scenarios is presented. ALIDA is a result coming from previous research activities by ENGINEERING. It aims to achieve a unified platform that allows both BDA application developers and data analysts to interact with it. Developers will be able to register new BDA applications through the exposed API and/or through the web user interface. Data analysts will be able to use the BDA applications provided to create batch/stream workflows through a dashboard user interface to manipulate and subsequently visualize results from one or more sources. The platform also supports the auto-tuning of Big Data frameworks deployment properties to improve metrics for analytics application. ALIDA has been properly extended and integrated into a software solution for the analysis of large amounts of data from the avionic industries. A use case within this context is then presented.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑