Kollaps:分散式动态拓扑仿真
Kollaps: Decentralized and Dynamic Topology Emulation
摘要:
大规模分布式应用程序的性能和行为受到网络属性(如延迟、带宽、数据包丢失和抖动)的高度影响。例如,工程师可能需要回答这样的问题:网络延迟的增加对应用程序响应时间有什么影响?在地理区域之间移动群集如何影响应用程序吞吐量?网络动态如何影响应用程序的稳定性?考虑到底层网络的可变性和缺乏控制,以系统和可重复的方式解决这些问题非常困难。不幸的是,现有技术的网络仿真或测试床的扩展性很差(即,MiniNet),只关注控制平面(即,CrystalNet)或忽略网络动态(即,EmuLab)。Kollaps是一个完全分布式的网络仿真器,可以解决这些限制。Kollaps取决于两个关键的观察结果。首先,从应用程序的角度来看,重要的是出现的端到端属性(例如,延迟、带宽、分组丢失和抖动),而不是导致这些属性的路由器和交换机的内部状态。这个前提允许我们构建一个更简单的,动态适应的仿真模型,避免维护完整的网络状态。其次,这个简化的模型是以完全分散的方式维护的,允许仿真随着应用程序的机器数量而扩展。Kollaps是完全去中心化的,与应用程序语言和传输协议无关,可扩展到数千个进程,并且与模拟网络完整状态的裸机部署或最先进的方法相比是准确的。我们展示了Kollaps如何准确地再现文献中的结果,并预测复杂的未经修改的分布式键值存储的行为(即,Cassandra)在不同的部署下。
英文摘要:
The performance and behavior of large-scale distributed applications is highly influenced by network properties such as latency, bandwidth, packet loss, and jitter. For instance, an engineer might need to answer questions such as: What is the impact of an increase in network latency in application response time? How does moving a cluster between geographical regions affect application throughput? How network dynamics affects application stability? Answering these questions in a systematic and reproducible way is very hard, given the variability and lack of control over the underlying network. Unfortunately, state-of-the-art network emulation or testbeds scale poorly (i.e., MiniNet), focus exclusively on the control-plane (i.e., CrystalNet) or ignore network dynamics (i.e., EmuLab). Kollaps is a fully distributed network emulator that address these limitations. Kollaps hinges on two key observations. First, from an application's perspective, what matters are the emergent end-to-end properties (e.g., latency, bandwidth, packet loss, and jitter) rather than the internal state of the routers and switches leading to those properties. This premise allows us to build a simpler, dynamically adaptable, emulation model that circumvent maintaining the full network state. Second, this simplified model is maintainable in a fully decentralized way, allowing the emulation to scale with the number of machines for the application. Kollaps is fully decentralized, agnostic of the application language and transport protocol, scales to thousands of processes and is accurate when compared against a bare-metal deployment or state-of-the-art approaches that emulate the full state of the network. We showcase how Kollaps can accurately reproduce results from the literature and predict the behaviour of a complex unmodified distributed key-value store (i.e., Cassandra) under different deployments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。