arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2008.01839stat.MLcs.ITcs.LGmath.IT
收藏

Sketching Datasets for Large-Scale Learning(大规模学习的数据集草图)

Sketching Datasets for Large-Scale Learning (long version)

Univ Lyon(里昂大学);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);ENS de Lyon(里昂高等师范学院);UCB Lyon 1(里昂第一大学);Univ Rennes(雷恩大学);IRISA(雷恩信息与自动化系统研究所);GIPSA-lab(格勒诺布尔图像、信号、自动化与控制实验室);Grenoble INP(格勒诺布尔国立理工学院);UGA(格勒诺布尔阿尔卑斯大学);UCLouvain(鲁汶大学);The Ohio State University(俄亥俄州立大学)

Rémi Gribonval, Antoine Chatalic, Nicolas Keriven, Vincent Schellekens, Laurent Jacques, Philip Schniter

摘要:

本文考虑“压缩学习”,这是一种大规模机器学习的方法,其中数据集在学习之前被大规模压缩(例如,聚类、分类或回归)。特别地,首先通过计算精心选择的非线性随机特征(例如,随机傅立叶特征)并在整个数据集上对它们进行平均。然后从草图中学习参数,而无需访问原始数据集。本文综述了压缩学习的最新进展,包括主要概念和算法,它们与已建立的信号处理方法的联系,现有的理论保证-信息保护和隐私保护,以及重要的开放问题。

英文摘要:

This article considers "compressive learning," an approach to large-scale machine learning where datasets are massively compressed before learning (e.g., clustering, classification, or regression) is performed. In particular, a "sketch" is first constructed by computing carefully chosen nonlinear random features (e.g., random Fourier features) and averaging them over the whole dataset. Parameters are then learned from the sketch, without access to the original dataset. This article surveys the current state-of-the-art in compressive learning, including the main concepts and algorithms, their connections with established signal-processing methods, existing theoretical guarantees -- on both information preservation and privacy preservation, and important open problems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑