arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.08484cs.DScs.CGcs.LGstat.ML
收藏

具有公平性约束的聚类核心集

Coresets for Clustering with Fairness Constraints

EPFL(洛桑联邦理工学院);Weizmann Institute of Science(魏茨曼科学研究所);Yale University(耶鲁大学)

Lingxiao Huang, Shaofeng H. -C. Jiang, Nisheeth K. Vishnoi

摘要:

在最近的一项工作中,[19]研究了经典聚类问题的以下“公平”变体,例如$k$ -means和$k$ -median:给定$\mathbb{R}^d$中的一组$n$数据点和与每个数据点相关的二进制类型,目标是对点进行聚类,同时确保每个聚类中每个类型的比例与其基本比例大致相同。随后的工作集中在将此设置扩展到每个数据点具有多个非分离的敏感类型(如种族和性别)时[6],或者解决上述工作中的聚类算法无法很好地扩展的问题。本文的主要贡献是一种公平性约束的聚类方法,涉及多个,非不相交的类型,这也是可扩展的。我们的方法是基于新的构造coreset:为$k$ -中位数目标,我们构建了一个$\varepsilon$ -coreset的大小$O(Γk^2 \varepsilon^{-d})$,其中$Γ$是不同的集合的组,一个点可能属于的数量,并为$k$ -手段目标,我们展示了如何构建一个$\varepsilon$ -coreset的大小$O(Γk^3\varepsilon^{-d-1})$。前一个结果是针对具有$k$ -中值目标的公平聚类问题的第一个已知核心集构造,后一个结果消除了对完整数据集大小的依赖性,如[39]中所述,并将其推广到多个非不相交类型。将我们的核心集插入现有的公平聚类算法中,如[5],在几种情况下会产生最快的算法。从经验上讲,我们评估我们的方法在\textbf{Adult},\textbf{Bank},\textbf{Diabetes}和\textbf{Athlete}数据集,并表明,coreset的大小比完整的数据集小得多。我们还通过结合我们的coreset构造实现了对最近的公平聚类算法[5,6]的加速。

英文摘要:

In a recent work, [19] studied the following "fair" variants of classical clustering problems such as $k$-means and $k$-median: given a set of $n$ data points in $\mathbb{R}^d$ and a binary type associated to each data point, the goal is to cluster the points while ensuring that the proportion of each type in each cluster is roughly the same as its underlying proportion. Subsequent work has focused on either extending this setting to when each data point has multiple, non-disjoint sensitive types such as race and gender [6], or to address the problem that the clustering algorithms in the above work do not scale well. The main contribution of this paper is an approach to clustering with fairness constraints that involve multiple, non-disjoint types, that is also scalable. Our approach is based on novel constructions of coresets: for the $k$-median objective, we construct an $\varepsilon$-coreset of size $O(Γk^2 \varepsilon^{-d})$ where $Γ$ is the number of distinct collections of groups that a point may belong to, and for the $k$-means objective, we show how to construct an $\varepsilon$-coreset of size $O(Γk^3\varepsilon^{-d-1})$. The former result is the first known coreset construction for the fair clustering problem with the $k$-median objective, and the latter result removes the dependence on the size of the full dataset as in [39] and generalizes it to multiple, non-disjoint types. Plugging our coresets into existing algorithms for fair clustering such as [5] results in the fastest algorithms for several cases. Empirically, we assess our approach over the \textbf{Adult}, \textbf{Bank}, \textbf{Diabetes} and \textbf{Athlete} dataset, and show that the coreset sizes are much smaller than the full dataset. We also achieve a speed-up to recent fair clustering algorithms [5,6] by incorporating our coreset construction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑