具有协变量的新LDA公式
A new LDA formulation with covariates
摘要:
潜在狄利克雷分配(LDA)模型是一种用于创建混合成员集群的流行方法。尽管LDA最初是为文本分析而开发的,但它已被广泛用于其他应用。我们提出了一个新的制定LDA模型,其中包括协变量。在这个模型中,LDA中嵌入了一个负二项回归,可以直接解释回归系数,并分析每个采样单元中特定于聚类的元素的数量(而不是像结构主题模型那样,分析重点是对每个聚类的比例进行建模)。我们使用切片抽样的吉布斯抽样算法来估计模型参数。我们依靠模拟来展示我们的算法如何能够成功地检索真实的参数值,以及使用协变量给出的信息来预测丰度矩阵的能力。该模型使用来自三个不同领域的真实数据集进行说明:冠状病毒文章的文本挖掘,杂货店购物篮的分析以及Barro Colorado Island(巴拿马)的树种生态。该模型允许识别离散数据中的混合成员聚类,并提供协变量与这些聚类丰度之间关系的推断。
英文摘要:
The Latent Dirichlet Allocation (LDA) model is a popular method for creating mixed-membership clusters. Despite having been originally developed for text analysis, LDA has been used for a wide range of other applications. We propose a new formulation for the LDA model which incorporates covariates. In this model, a negative binomial regression is embedded within LDA, enabling straight-forward interpretation of the regression coefficients and the analysis of the quantity of cluster-specific elements in each sampling units (instead of the analysis being focused on modeling the proportion of each cluster, as in Structural Topic Models). We use slice sampling within a Gibbs sampling algorithm to estimate model parameters. We rely on simulations to show how our algorithm is able to successfully retrieve the true parameter values and the ability to make predictions for the abundance matrix using the information given by the covariates. The model is illustrated using real data sets from three different areas: text-mining of Coronavirus articles, analysis of grocery shopping baskets, and ecology of tree species on Barro Colorado Island (Panama). This model allows the identification of mixed-membership clusters in discrete data and provides inference on the relationship between covariates and the abundance of these clusters.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。