arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2112.03074cs.NIhep-ex
收藏

业务分析与网络诊断DataPipeline

The Service Analysis and Network Diagnosis DataPipeline

Derek Weitzel, Shawn McKee, Brian Paul Bockelman, John Thiltges, Marian Babik, Ilija Vukotic

摘要:

现代网络性能监控工具包,如perfSONAR,对本地网络环境进行了大量的测量。然而,为了获得网络性能的完整图像,需要跨大量端点聚合数据。服务分析和网络诊断(SAND)数据管道从不同的来源收集数据,并将这些测量结果纳入消息总线。消息总线允许项目将数据发送给多个消费者,包括磁带存档,Elasticsearch数据库和CERN的对等基础设施。在本文中,我们解释了SAND数据管道的架构和演变,结果数据集的规模,以及它如何支持各种网络分析应用程序。

英文摘要:

Modern network performance monitoring toolkits, such as perfSONAR, take a remarkable number of measurements about the local network environment. To gain a complete picture of network performance, however, one needs to aggregate data across a large number of endpoints. The Service Analysis and Network Diagnosis (SAND) data pipeline collects data from diverse sources and ingests these measurements into a message bus. The message bus allows the project to send the data to multiple consumers, including a tape archive, an Elasticsearch database, and a peer infrastructure at CERN. In this paper, we explain the architecture and evolution of the SAND data pipeline, the scale of the resulting dataset, and how it supports a wide variety of network analysis applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑