arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1907.13208stat.MLcs.DCcs.LGstat.ME
收藏

基于固有分布式数据的学习

Learning over inherently distributed data

Indigo Agroculture Inc(靛蓝农业公司);University of Massachusetts, Dartmouth(马萨诸塞大学达特茅斯分校)

Donghui Yan, Ying Xu

摘要:

近几十年来,人们对分布式计算的兴趣激增。现有的工作主要集中在分布式计算平台、数据查询工具或划分大数据并在单个机器上征服的算法等。然而,越来越多的情况是,感兴趣的数据本质上是分布式的,即,数据存储在多个分布式站点,由于不同的收集渠道,业务运营等,我们建议,使学习和推理,在这样的设置通过一个通用框架的基础上,失真最小化的本地转换。这个框架只需要在分布式站点之间共享少量的本地签名,从而消除了传输大数据的需要。通过并行本地计算可以非常有效地完成计算。当增加本地签名的大小时,由于分布式计算而引起的错误消失。由于共享数据不需要以其原始形式存在,因此数据隐私也可以得到保护。在线性(逻辑)回归和随机森林上的实验表明了这种方法的前景。这个框架预计将适用于一般类的工具,在学习和推理的连续性。

英文摘要:

The recent decades have seen a surge of interests in distributed computing. Existing work focus primarily on either distributed computing platforms, data query tools, or, algorithms to divide big data and conquer at individual machines etc. It is, however, increasingly often that the data of interest are inherently distributed, i.e., data are stored at multiple distributed sites due to diverse collection channels, business operations etc. We propose to enable learning and inference in such a setting via a general framework based on the distortion minimizing local transformations. This framework only requires a small amount of local signatures to be shared among distributed sites, eliminating the need of having to transmitting big data. Computation can be done very efficiently via parallel local computation. The error incurred due to distributed computing vanishes when increasing the size of local signatures. As the shared data need not be in their original form, data privacy may also be preserved. Experiments on linear (logistic) regression and Random Forests have shown promise of this approach. This framework is expected to apply to a general class of tools in learning and inference with the continuity property.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑