arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.03882cs.LGstat.ML

Theoretical Analysis of Divide-and-Conquer ERM: Beyond Square Loss and RKHS

Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Inception Institute of Artificial Intelligence(起源人工智能研究院)

Yong Liu, Lizhong Ding, Weiping Wang

英文摘要:

Theoretical analysis of the divide-and-conquer based distributed learning with least square loss in the reproducing kernel Hilbert space (RKHS) have recently been explored within the framework of learning theory. However, the studies on learning theory for general loss functions and hypothesis spaces remain limited. To fill the gap, we study the risk performance of distributed empirical risk minimization (ERM) for general loss functions and hypothesis spaces. The main contributions are two-fold. First, we derive two tight risk bounds under certain basic assumptions on the hypothesis space, as well as the smoothness, Lipschitz continuity, strong convexity of the loss function. Second, we further develop a more general risk bound for distributed ERM without the restriction of strong convexity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑