arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.04262cs.LGcs.GTstat.ML
收藏

机器学习中的算法集体行动

Algorithmic Collective Action in Machine Learning

Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Tübingen AI Center(蒂宾根人工智能中心);California Institute of Technology(加州理工学院);University of California, Berkeley(加州大学伯克利分校)

Moritz Hardt, Eric Mazumdar, Celestine Mendler-Dünner, Tijana Zrnic

AI总结:

本文提出一个理论模型研究算法集体行动,在非参数最优学习、参数风险最小化和梯度优化三种设定下刻画集体规模与成功标准的关系,并通过数万份简历上的类BERT模型实验验证:极小规模的集体也能显著控制平台学习算法。

摘要:

我们对部署机器学习算法的数字平台上的算法集体行动开展了一项原则性研究。我们提出了一个简单的理论模型,描述一个集体与一家企业的学习算法之间的互动。该集体汇集参与个体的数据,并通过指示参与者如何修改自身数据以实现集体目标来执行算法策略。我们在三个基本的学习理论设定中考察了这一模型的后果:非参数最优学习算法情形、参数化风险最小化器情形以及基于梯度的优化情形。在每一种设定中,我们都提出了协调的算法策略,并将自然成功标准刻画为集体规模的函数。作为对理论的补充,我们在一个技能分类任务上开展了系统性实验,该任务涉及来自一个自由职业者零工平台的数万份简历。通过对一个类BERT语言模型进行超过两千次模型训练运行,我们发现实证观察结果与理论预测之间出现了显著的一致性。综合来看,我们的理论和实验广泛支持以下结论:规模极小、占比极低的算法集体也能对平台的学习算法施加显著控制。

英文摘要:

We initiate a principled study of algorithmic collective action on digital platforms that deploy machine learning algorithms. We propose a simple theoretical model of a collective interacting with a firm's learning algorithm. The collective pools the data of participating individuals and executes an algorithmic strategy by instructing participants how to modify their own data to achieve a collective goal. We investigate the consequences of this model in three fundamental learning-theoretic settings: the case of a nonparametric optimal learning algorithm, a parametric risk minimizer, and gradient-based optimization. In each setting, we come up with coordinated algorithmic strategies and characterize natural success criteria as a function of the collective's size. Complementing our theory, we conduct systematic experiments on a skill classification task involving tens of thousands of resumes from a gig platform for freelancers. Through more than two thousand model training runs of a BERT-like language model, we see a striking correspondence emerge between our empirical observations and the predictions made by our theory. Taken together, our theory and experiments broadly support the conclusion that algorithmic collectives of exceedingly small fractional size can exert significant control over a platform's learning algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑