SwiftQueue: 通过Swift数据包队列优化低延迟应用
SwiftQueue: Optimizing Low-Latency Applications with Swift Packet Queuing
AI总结:
SwiftQueue通过新颖的每包延迟预测算法优化L4S队列选择,提升低延迟应用性能,减少尾延迟。
摘要:
低延迟、低丢包率和可扩展吞吐量(L4S)作为一种新兴的路由器队列管理技术,已在行业内稳步部署。一个启用了L4S的路由器根据数据包头部标记将每个数据包分配到队列中。目前,L4S采用每流队列选择,即每个流的所有数据包都以相同方式标记,因此使用相同的队列,即使每个数据包单独标记。然而,这可能会损害尾延迟和对延迟敏感的应用,因为瞬时拥塞和队列堆积可能只影响流中的一小部分数据包。我们提出了SwiftQueue,一种新的L4S队列选择策略,其中发送方使用新颖的每包延迟预测器来确定哪些数据包可能具有延迟尖峰或下降。关键见解是许多包级延迟变化源于最近数据包在共享路由器队列中的复杂相互作用。然而,这些复杂的包级延迟模式难以通过传统模型高效学习。相反,SwiftQueue使用一个定制的Transformer,它在处理序列模式时表现出色,以预测下一个数据包的延迟,基于最近接收到的确认(ACK)的延迟。基于每个传出数据包的预测延迟,SwiftQueue的发送方动态标记L4S数据包头部,以将数据包分配到可能不同的队列,即使在同一流中。使用真实网络跟踪,我们证明SwiftQueue在预测延迟及其变化方面的准确性比最先进的方法高45-65%。基于其延迟预测,SwiftQueue将L4S启用流的尾延迟减少了36-45%,与现有L4S队列选择方法相比。
英文摘要:
Low Latency, Low Loss, and Scalable Throughput (L4S), as an emerging router-queue management technique, has seen steady deployment in the industry. An L4S-enabled router assigns each packet to the queue based on the packet header marking. Currently, L4S employs per-flow queue selection, i.e. all packets of a flow are marked the same way and thus use the same queues, even though each packet is marked separately. However, this may hurt tail latency and latency-sensitive applications because transient congestion and queue buildups may only affect a fraction of packets in a flow. We present SwiftQueue, a new L4S queue-selection strategy in which a sender uses a novel per-packet latency predictor to pinpoint which packets likely have latency spikes or drops. The insight is that many packet-level latency variations result from complex interactions among recent packets at shared router queues. Yet, these intricate packet-level latency patterns are hard to learn efficiently by traditional models. Instead, SwiftQueue uses a custom Transformer, which is well-studied for its expressiveness on sequential patterns, to predict the next packet's latency based on the latencies of recently received ACKs. Based on the predicted latency of each outgoing packet, SwiftQueue's sender dynamically marks the L4S packet header to assign packets to potentially different queues, even within the same flow. Using real network traces, we show that SwiftQueue is 45-65% more accurate in predicting latency and its variations than state-of-art methods. Based on its latency prediction, SwiftQueue reduces the tail latency for L4S-enabled flows by 36-45%, compared with the existing L4S queue-selection method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。