Named data networking (NDN) constructs a network by names, providing a flexible and decentralized way to manage resources within the edge computing continuum. This paper aims to solve the question, "Given a function with its parameters and metadata, how to select the executor in a distributed manner and obtain the result in NDN?" To answer it, we design R2 that involves the following stages. First, we design a name structure including data, function names, and other function parameters. Second, we develop a 2-phase mechanism, where in the first phase, the function request from a client-first reaches the data source and retrieves the metadata, then the best node is selected while the metadata is responding to the client. In the second phase, the chosen node directly retrieves the data, executes the function, and provides the result to the client. Furthermore, we propose a stop condition to intelligently reduce the processing time of the first phase and provide a simple proof and range analysis. Simulations confirm that R2 outperforms the current solutions in terms of resource allocation, especially when the data volume and the function complexity are high. In the experiments, when the data size is 100 KiB and the function complexity is $\mathcal{O}(n^2)$, the speedup ratio is 4.61. To further evaluate R2, we also implement a general intermediate data processing logic named ``Bolt'' implemented on an app-level in ndnSIM. We believe that R2 shall help the researchers and developers to verify their ideas smoothly.
Write-Optimized and Consistent RDMA-based NVM Systems
为了在云计算中提供高性能,我们通常在网络中利用和利用RDMA(远程直接存储器访问),在终端系统中利用和利用NVM(非易失性存储器)。由于不涉及CPU,单侧RDMA变得高效地访问远程存储器,并且NVM技术具有非易失性、字节可寻址性和类似DRAM的延迟的优点。为了实现端到端的高性能,许多努力旨在协同单侧RDMA和NVM。由于需要保证远程数据原子性(RDA),我们必须消耗额外的网络往返、远程CPU参与和双重NVM写入。为了解决这些问题,我们提出了一个零拷贝日志结构的内存设计,高效的远程数据原子性,称为Erda。在Erda中,客户端通过单侧RDMA写入直接将数据传输到服务器的目的地址,而无需冗余复制和远程CPU消耗。为了检测获取数据的不完整性,我们在没有客户端-服务器协调的情况下验证校验和。我们通过在哈希表中利用8字节的原子更新来进一步确保元数据的一致性,该哈希表还包含陈旧数据的地址信息。发生故障时,服务器会正确恢复到一致的版本。实验结果表明,与Redo Logging(CPU参与方案)和Read After Write(网络主导方案)相比,Erda将NVM写入减少了约50%,同时显著提高了吞吐量并降低了延迟。
Scalable Runtime Architecture for Data-driven, Hybrid HPC and ML Workflow Applications
Rutgers, the State University of New Jersey(罗格斯大学(新泽西州立大学));Brookhaven National Laboratory(布鲁克海文国家实验室);Princeton Plasma Physics Laboratory(普林斯顿等离子体物理实验室);Princeton University(普林斯顿大学)
本文扩展 RADICAL-Pilot,提出支持基于服务执行的可扩展运行时架构,以实现跨本地与远程 HPC/云资源的 HPC/ML 无缝耦合和低开销并发 ML 执行。