直接遥测访问
Direct Telemetry Access
AI总结:
本文提出基于 RDMA 的直接遥测访问(DTA)方案,通过新型上报原语高效聚合海量网络遥测报告,单服务器每秒可处理超 4 亿条报告,显著提升遥测收集速率并降低收集器开销。
摘要:
细粒度网络遥测正在成为现代数据中心的标准,并且是拥塞控制、负载均衡和高级故障排查等关键应用的基础。随着网络规模不断扩大且遥测粒度日益细化,需要从交换机上报至收集器以支持全网视图的数据量急剧增长,这使得数据收集系统的扩展变得愈发困难。我们提出了直接遥测访问(DTA),这是一种针对每秒从交换机聚合和传输数亿条报告到收集器内存中可查询数据结构而优化的解决方案。DTA 轻量高效,能够大幅降低收集器的开销。DTA 构建于 RDMA 之上,我们提出了新颖且具有表达力的上报原语,以便与现有最先进的遥测机制(如 INT 或 Marple)轻松集成。我们展示了 DTA 显著提升了遥测收集速率。例如,与 INT 配合使用时,单台服务器每秒可收集和聚合超过 4 亿条报告,相比 Atomic MultiLog 最高提升 16 倍。
英文摘要:
Fine-grained network telemetry is becoming a modern datacenter standard and is the basis of essential applications such as congestion control, load balancing, and advanced troubleshooting. As network size increases and telemetry gets more fine-grained, there is a tremendous growth in the amount of data needed to be reported from switches to collectors to enable network-wide view. As a consequence, it is progressively hard to scale data collection systems. We introduce Direct Telemetry Access (DTA), a solution optimized for aggregating and moving hundreds of millions of reports per second from switches into queryable data structures in collectors' memory. DTA is lightweight and it is able to greatly reduce overheads at collectors. DTA is built on top of RDMA, and we propose novel and expressive reporting primitives to allow easy integration with existing state-of-the-art telemetry mechanisms such as INT or Marple. We show that DTA significantly improves telemetry collection rates. For example, when used with INT, it can collect and aggregate over 400M reports per second with a single server, improving over the Atomic MultiLog by up to $16$x.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。