arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1810.09841cs.CYphysics.data-anphysics.soc-ph
收藏

基于结构化特征空间分解的行为数据预测与解释

Predicting and Explaining Behavioral Data with Structured Feature Space Decomposition

Peter G Fennell, Zhiya Zuo, Kristina Lerman

摘要:

由于人类行为数据的规模、稀疏性(每个个体的观察结果很少)、异质性(行为不同的个体)和类别不平衡(对感兴趣的结果的观察结果很少),对人类行为数据进行建模具有挑战性。另一个挑战是学习一个可解释的模型,不仅可以准确预测结果,还可以识别与给定行为相关的重要因素。为了解决这些挑战,我们描述了一种称为结构化平方和分解(S3D)的行为数据建模的统计方法。该算法受决策树的启发,选择共同解释结果变化的重要特征,量化特征之间的相关性,并将重要特征的子空间划分为更小、更均匀的块,这些块对应于人口中行为相似的子组。这个划分的子空间允许我们在统计和视觉上预测和分析结果变量的行为,提供了一种媒介来检查各种特征的影响并创建可解释的预测。我们应用S3D从不同网站收集的大规模数据中学习在线活动模型,如Stack Exchange,Khan Academy,Twitter,Duolingo和Digg。我们表明,S3D创建了简约的模型,可以预测与最先进方法相当的水平上的结果,但除此之外,还产生了可解释的模型,提供了对行为的见解。这对于为旨在改变行为的策略提供信息、设计社会系统非常重要,而且对于解释预测也很重要,这是最大限度地减少算法偏见的关键一步。

英文摘要:

Modeling human behavioral data is challenging due to its scale, sparseness (few observations per individual), heterogeneity (differently behaving individuals), and class imbalance (few observations of the outcome of interest). An additional challenge is learning an interpretable model that not only accurately predicts outcomes, but also identifies important factors associated with a given behavior. To address these challenges, we describe a statistical approach to modeling behavioral data called the structured sum-of-squares decomposition (S3D). The algorithm, which is inspired by decision trees, selects important features that collectively explain the variation of the outcome, quantifies correlations between the features, and partitions the subspace of important features into smaller, more homogeneous blocks that correspond to similarly-behaving subgroups within the population. This partitioned subspace allows us to predict and analyze the behavior of the outcome variable both statistically and visually, giving a medium to examine the effect of various features and to create explainable predictions. We apply S3D to learn models of online activity from large-scale data collected from diverse sites, such as Stack Exchange, Khan Academy, Twitter, Duolingo, and Digg. We show that S3D creates parsimonious models that can predict outcomes in the held-out data at levels comparable to state-of-the-art approaches, but in addition, produces interpretable models that provide insights into behaviors. This is important for informing strategies aimed at changing behavior, designing social systems, but also for explaining predictions, a critical step towards minimizing algorithmic bias.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑