arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.03403cs.MAcs.LG
收藏

分布式网络化多任务学习

Distributed Networked Multi-task Learning

Texas A&M University(德克萨斯农工大学)

Lingzhou Hong, Alfredo Garcia

AI总结:

该研究提出一种适用于异构/相关数据流的分布式网络化多任务学习方案,节点按任务分组并基于有向拓扑异步通信,通过局部与全局正则项分别降噪和提升泛化,给出有限时间收敛刻画并验证了方案的普遍适用性。

摘要:

我们研究了一种分布式多任务学习方案,该方案可处理具有异构和/或相关数据流的多个线性模型估计任务。我们假设节点可被划分为对应不同学习任务的组,并按照有向网络拓扑进行通信。每个节点异步估计一个线性模型,且受局部(组内)正则项和全局(跨组)正则项约束,二者分别旨在降低噪声和提升泛化性能。我们给出了估计器收敛性与任务关联的有限时间刻画,并通过两个示例(随机场温度估计、不同学区的学生表现建模)说明了该方案的普遍适用性。

英文摘要:

We consider a distributed multi-task learning scheme that accounts for multiple linear model estimation tasks with heterogeneous and/or correlated data streams. We assume that nodes can be partitioned into groups corresponding to different learning tasks and communicate according to a directed network topology. Each node estimates a linear model asynchronously and is subject to local (within-group) regularization and global (across groups) regularization terms targeting noise reduction and generalization performance improvement respectively. We provide a finite-time characterization of convergence of the estimators and task relation and illustrate the scheme's general applicability in two examples: random field temperature estimation and modeling student performance from different academic districts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑