Suki:Rust 语言中的编排式分布式数据流
Suki: Choreographed Distributed Dataflow in Rust
AI总结:
针对现有分布式数据流编程模型难以兼顾全局优化与细粒度放置控制的问题,提出嵌入式Rust DSL Suki采用阶段式编程实现显式放置的流数据流,结合trait系统支持类型安全的云资源映射,实现零开销编译。
摘要:
分布式数据流的编程模型长期聚焦于分析类工作负载,这类负载允许运行时动态放置和调度计算逻辑。与此同时,能实现细粒度放置控制的模型(如参与者模型)却难以进行全局优化。在这篇扩展摘要中,我们提出Suki——一种嵌入式Rust DSL(领域特定语言),开发者可借助它实现计算显式放置的流数据流。这种编排式编程方法的核心是我们对阶段式编程的运用,它让我们既能提供高层Rust API,同时将本地计算单元编译为零开销的独立二进制文件。我们还探讨了这种方法结合Rust的trait系统,如何为将数据流程序映射到云计算资源提供类型安全的API。
英文摘要:
Programming models for distributed dataflow have long focused on analytical workloads that allow the runtime to dynamically place and schedule compute logic. Meanwhile, models that enable fine-grained control over placement, such as actors, make global optimization difficult. In this extended abstract, we present Suki, an embedded Rust DSL that lets developers implement streaming dataflow with explicit placement of computation. Key to this choreographic programming approach is our use of staged programming, which lets us expose a high-level Rust API while compiling local compute units into individual binaries with zero-overhead. We also explore how this approach, combined with Rust's trait system, enables a type-safe API for mapping dataflow programs to cloud computing resources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。