arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.03385cs.DCcs.LGcs.NI
收藏

通信成本预算下分层联邦学习的响应式编排

Reactive Orchestration for Hierarchical Federated Learning Under a Communication Cost Budget

Faculty of Electrical Engineering and Computing, University of Zagreb(Zagreb大学电气工程与计算学院);Distributed Systems Group, TU Wien(TU Wien分布式系统组)

Ivan Čilić, Anna Lackinger, Pantelis Frangoudis, Ivana Podnar Žarko, Alireza Furutanpey, Ilir Murturi, Schahram Dustdar

AI总结:

提出一种自适应编排 HFL 流水线的响应式框架,基于多级监控信息在通信成本预算内动态重配置并平衡成本与模型准确率,通过扩展 Kubernetes 实现对环境变化的快速响应。

摘要:

在计算连续体(CC)上部署分层联邦学习(HFL)流水线,需要将参与者组织成包含 FL 客户端与全局 FL 服务器之间中间聚合节点的分层结构。由于成本约束、数据分布的变化以及 CC 易变的运行环境,实现这一点极具挑战性。为应对这些挑战,我们提出了一个用于自适应编排 HFL 流水线的框架,该框架能够响应客户端流失和基础设施级事件,同时平衡通信成本与 ML 模型准确率。我们的机制基于多级监控信息(模型准确率、资源可用性、资源成本),识别并对运行时引发 HFL 重配置操作的事件做出反应。此外,该框架引入了一种估算重配置成本的通用方法,以持续重新评估适应操作的质量,并且可扩展以优化各种 HFL 性能指标。通过扩展 Kubernetes 生态系统,我们的框架展示了对运行环境变化做出快速有效响应的能力,能够充分利用可用的通信成本预算,并在运行时有效平衡成本与 ML 性能。

英文摘要:

Deploying a Hierarchical Federated Learning (HFL) pipeline across the computing continuum (CC) requires careful organization of participants into a hierarchical structure with intermediate aggregation nodes between FL clients and the global FL server. This is challenging to achieve due to (i) cost constraints, (ii) varying data distributions, and (iii) the volatile operating environment of the CC. In response to these challenges, we present a framework for the adaptive orchestration of HFL pipelines, designed to be reactive to client churn and infrastructure-level events, while balancing communication cost and ML model accuracy. Our mechanisms identify and react to events that cause HFL reconfiguration actions at runtime, building on multi-level monitoring information (model accuracy, resource availability, resource cost). Moreover, our framework introduces a generic methodology for estimating reconfiguration costs to continuously re-evaluate the quality of adaptation actions, while being extensible to optimize for various HFL performance criteria. By extending the Kubernetes ecosystem, our framework demonstrates the ability to react promptly and effectively to changes in the operating environment, making the best of the available communication cost budget and effectively balancing costs and ML performance at runtime.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑