基于在线张量LDA的大规模政治文本分析
Analyzing Political Text at Scale with Online Tensor LDA
AI总结:
本文提出了一种可扩展的TLDA方法,用于大规模政治文本分析,实现了高效计算和内存使用,支持对大规模社交媒体数据的深入研究。
摘要:
本文提出了一种能够线性扩展到数十亿文档的专题建模方法。我们有三个核心贡献:i)我们提出了一种专题建模方法,即张量潜在狄利克雷分配(TLDA),该方法具有可识别和可恢复的参数保证以及大数据样本复杂度保证;ii)我们证明了该方法在计算和内存效率方面优于以往的并行化LDA方法,速度提高了3-4倍,并能线性扩展到拥有数十亿文档的文本数据集;iii)我们提供了该方法的开源GPU实现。这种扩展使以前无法实现的分析成为可能,我们进行了两个真实世界的大规模新研究,对政治科学家感兴趣:我们提供了对#MeToo运动演变的首次详尽分析,通过两年的推特对话,以及对2020年总统大选期间关于选举舞弊的社交媒体对话的详细研究。因此,该方法为社会科学家提供了研究非常大规模语料库的能力,并能够回答关于显着问题的重要理论相关问题。
英文摘要:
This paper proposes a topic modeling method that scales linearly to billions of documents. We make three core contributions: i) we present a topic modeling method, Tensor Latent Dirichlet Allocation (TLDA), that has identifiable and recoverable parameter guarantees and sample complexity guarantees for large data; ii) we show that this method is computationally and memory efficient (achieving speeds over 3-4x those of prior parallelized Latent Dirichlet Allocation (LDA) methods), and that it scales linearly to text datasets with over a billion documents; iii) we provide an open-source, GPU-based implementation, of this method. This scaling enables previously prohibitive analyses, and we perform two real-world, large-scale new studies of interest to political scientists: we provide the first thorough analysis of the evolution of the #MeToo movement through the lens of over two years of Twitter conversation and a detailed study of social media conversations about election fraud in the 2020 presidential election. Thus this method provides social scientists with the ability to study very large corpora at scale and to answer important theoretically-relevant questions about salient issues in near real-time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。