arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1707.01212stat.MLcs.LG
收藏

基于重要性权重的原型选择的高效数据表示

Efficient Data Representation by Selecting Prototypes with Importance Weights

Amazon Development Center(亚马逊开发中心);IBM Research(IBM研究院)

Karthik S. Gurumoorthy, Amit Dhurandhar, Guillermo Cecchi, Charu Aggarwal

摘要:

最好地总结和解释代表底层复杂数据分布的原型示例在难以提取简单解释的领域中向人类传达有意义的见解。在本文中,我们提出了强有力的理论保证挖掘这些数据集,并选择原型a.k.a.算法。最好的代表来描述它们。我们的工作特别概括了Kim等人(2016)最近的工作,除了选择原型之外,我们还关联了非负权重,这表明了它们的重要性。这个扩展提供了一个单一的连贯框架,在这个框架下可以找到原型和批评(即离群值)。此外,我们的框架适用于任何对称正定核,从而解决了Kim et al.(2016)中提出的一个关键开放问题。通过建立我们的目标函数享有的弱次模块化的关键属性,我们提出了一个快速的ProtoDash算法,并获得近似保证相同。我们证明了我们的方法在不同领域的有效性,如零售,数字识别(MNIST)和公开的40个健康问卷从美国疾病控制中心(CDC)网站维护的美国部门。of Health.我们根据专家反馈和最近发表的关于公共卫生的科学研究,定量和定性地验证了结果,从而展示了我们的技术在提供可操作性(零售),实用性(MNIST)和洞察力(CDC数据集)方面的力量,这可以说是有效数据挖掘方法的标志。

英文摘要:

Prototypical examples that best summarizes and compactly represents an underlying complex data distribution communicate meaningful insights to humans in domains where simple explanations are hard to extract. In this paper we present algorithms with strong theoretical guarantees to mine these data sets and select prototypes a.k.a. representatives that optimally describes them. Our work notably generalizes the recent work by Kim et al. (2016) where in addition to selecting prototypes, we also associate non-negative weights which are indicative of their importance. This extension provides a single coherent framework under which both prototypes and criticisms (i.e. outliers) can be found. Furthermore, our framework works for any symmetric positive definite kernel thus addressing one of the key open questions laid out in Kim et al. (2016). By establishing that our objective function enjoys a key property of that of weak submodularity, we present a fast ProtoDash algorithm and also derive approximation guarantees for the same. We demonstrate the efficacy of our method on diverse domains such as retail, digit recognition (MNIST) and on publicly available 40 health questionnaires obtained from the Center for Disease Control (CDC) website maintained by the US Dept. of Health. We validate the results quantitatively as well as qualitatively based on expert feedback and recently published scientific studies on public health, thus showcasing the power of our technique in providing actionability (for retail), utility (for MNIST) and insight (on CDC datasets) which arguably are the hallmarks of an effective data mining method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑