arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.00223cs.NIcs.PF
收藏

大数据量下自动生成交通报告的性能挑战评估

Evaluation of the performance challenges in automatic traffic report generation with huge data volumes

Carlos Vega Moreno, Eduardo Miravalls Sierra, Guillermo Julián Moreno, Jorge E. López de Vergara, Eduardo Magaña, Javier Aracil

摘要:

在本文中,我们分析了涉及到的性能问题,在生成自动化的交通报告的大型IT基础设施。此类报告允许IT经理主动检测可能的异常情况并转出相应的纠正措施。随着当前网络带宽的不断增加,流量报告自动生成系统的设计是非常具有挑战性的。在第一步中,收集的大量流量被转换为从不同的收集器和分析器获得的丰富的流量记录。然后,这些流量记录以及从原始流量中获得的时间序列被进一步处理以产生可用的报告。正如将要显示的,流记录中的数据量也非常大,并且需要仔细选择要包括在报告中的关键性能指标(KPI)。在这方面,我们讨论了使用高级语言与低级方法,在速度和通用性方面。此外,我们的设计方法旨在快速开发商品硬件,这对于经济高效地解决苛刻的流量分析场景至关重要。

英文摘要:

In this paper we analyze the performance issues involved in the generation of auto- mated traffic reports for large IT infrastructures. Such reports allows the IT manager to proactively detect possible abnormal situations and roll out the corresponding cor- rective actions. With the ever-increasing bandwidth of current networks, the design of automated traffic report generation systems is very challenging. In a first step, the huge volumes of collected traffic are transformed into enriched flow records obtained from diverse collectors and dissectors. Then, such flow records, along with time series obtained from the raw traffic, are further processed to produce a usable report. As will be shown, the data volume in flow records is very large as well and requires careful selection of the Key Performance Indicators (KPIs) to be included in the report. In this regard, we discuss the use of high-level languages versus low- level approaches, in terms of speed and versatility. Furthermore, our design approach is targeted for rapid development in commodity hardware, which is essential to cost-effectively tackle demanding traffic analysis scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑