arXivDaily arXiv每日学术速递 周一至周五更新
看起来今天可以划水了
arXiv 2001.00631cs.LGstat.ML
收藏

基于非负CP张量分解的大规模动态话题建模

On Large-Scale Dynamic Topic Modeling with Nonnegative CP Tensor Decomposition

Southern Methodist University(南卫理公会大学);Grinnell College(格林内尔学院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Colorado State University(科罗拉多州立大学);California State University, Channel Islands(加利福尼亚州立大学海峡群岛分校);Occidental College(西方学院);Boston Medical Center(波士顿医疗中心)

Miju Ahn, Nicole Eikmeier, Jamie Haddock, Lara Kassab, Alona Kryshchenko, Kathryn Leonard, Deanna Needell, R. W. M. A. Madushani, Elena Sizikova, Chuntian Wang

摘要:

由于数据的爆炸性增长,目前对大规模时态数据分析的需求是前所未有的。动态主题建模已广泛应用于社会和数据科学,其目标是学习随着时间的推移而出现、发展和消失的潜在主题。以前的动态主题建模工作主要采用非负矩阵分解(NMF)的方法,其中数据张量的切片每个都分解为低维非负矩阵的乘积。然而,采用这种方法时,数据的时间维度所包含的信息往往被忽视或利用不足。为了克服这个问题,我们建议采用非负CANDECOMP/PARAPAC(CP)张量分解(NNCPD)的方法,其中数据张量直接分解为非负向量的外积的最小和,从而保留时间信息。NNCPD的可行性证明通过应用到合成和真实数据,其中显着改善的结果相比,那些典型的基于NMF的方法。NNCPD的优点,这样的方法进行了研究和讨论。据我们所知,这是NNCPD第一次被用于动态主题建模的目的,我们的研究结果将是变革性的应用和进一步的发展。

英文摘要:

There is currently an unprecedented demand for large-scale temporal data analysis due to the explosive growth of data. Dynamic topic modeling has been widely used in social and data sciences with the goal of learning latent topics that emerge, evolve, and fade over time. Previous work on dynamic topic modeling primarily employ the method of nonnegative matrix factorization (NMF), where slices of the data tensor are each factorized into the product of lower-dimensional nonnegative matrices. With this approach, however, information contained in the temporal dimension of the data is often neglected or underutilized. To overcome this issue, we propose instead adopting the method of nonnegative CANDECOMP/PARAPAC (CP) tensor decomposition (NNCPD), where the data tensor is directly decomposed into a minimal sum of outer products of nonnegative vectors, thereby preserving the temporal information. The viability of NNCPD is demonstrated through application to both synthetic and real data, where significantly improved results are obtained compared to those of typical NMF-based methods. The advantages of NNCPD over such approaches are studied and discussed. To the best of our knowledge, this is the first time that NNCPD has been utilized for the purpose of dynamic topic modeling, and our findings will be transformative for both applications and further developments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑