An impurity measures $I: \mathbb{R}^d \mapsto \mathbb{R}^+$ is a function that assigns a $d$-dimensional vector ${\bf v}$ to a non-negative value $I({\bf v})$ so that the more homogeneous ${\bf v}$, with respect to the values of its coordinates, the larger its impurity. A well known example of impurity measures is the Entropy impurity.
We study the problem of clustering based on impurity measures. Let $V$ be a collection of $n$ many $d$-dimensional vectors with non-negative components. Given $V$ and an impurity measure $I$, the goal is to find a partition ${\mathcal P}$ of $V$ into $k$ groups $V_1,\ldots,V_k$ so as to minimize the sum of the impurities of the groups in ${\cal P}$, i.e., $I({\cal P})= \sum_{i=1}^{k} I\bigg(\sum_{ {\bf v} \in V_i} {\bf v} \bigg).$
Impurity minimization has been widely used as quality assessment measure in probability distribution clustering (KL-divergence) as well as in categorical clustering. However, in contrast to the case of metric based clustering, the current knowledge of impurity measure based clustering in terms of approximation and inapproximability results is very limited. Here, we contribute to change this scenario by proving that for the Entropy impurity measure the problem does not admit a PTAS even when all vectors have the same $\ell_1$ norm. This result solves a question that remained open in previous work on this topic [Chaudhuri and McGregor COLT 08; Ackermann et. al. ECCC 11].
Graduate School of Informatics, Kyoto University(京都大学信息科学研究科);Institute of Informatics, University of Warsaw(华沙大学信息学研究所);Department of Computer Science, Lund University(隆德大学计算机科学系);Department of Computer Science and Media Technology, Malmö University(马尔默大学计算机科学与媒体技术系)
Exact and Approximate Hierarchical Clustering Using A*
National Institute of Standards and Technology(美国国家标准与技术研究院);New York University(纽约大学);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Google Research(谷歌研究院)
On Approximability of $\ell_2^2$ Min-Sum Clustering
Rutgers University(罗格斯大学);University of Michigan(密歇根大学);The Hebrew University of Jerusalem(耶路撒冷希伯来大学);Aarhus University(奥胡斯大学);Texas A&M University(德克萨斯农工大学)