arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.09556cs.LGcs.CLstat.ML
收藏

$S^3$——语义信号分离

$S^3$ -- Semantic Signal Separation

Aarhus University(奥胡斯大学)

Márton Kardos, Jan Kostkan, Arnault-Quentin Vermillet, Kristoffer Nielbo, Kenneth Enevoldsen, Roberta Rocca

AI总结:

针对现有上下文主题模型速度慢、不稳定、需大量预处理的问题,提出基于理论的$S^3$语义信号分离方法,通过独立成分分析分解文档嵌入挖掘主题,无需预处理,速度是BERTopic的4.5倍,已在Turftopic包中开源实现。

摘要:

主题模型是在大型文本语料库中发现潜在语义结构的有用工具。近期研究致力于将上下文表示融入主题建模,且已被证明性能优于经典主题模型。这类方法通常速度慢、稳定性差,还需要大量预处理才能获得最优结果。我们提出语义信号分离($S^3$),这是一种在神经嵌入空间中基于理论的主题建模方法。$S^3$将主题概念化为语义空间的独立轴,并通过独立成分分析分解上下文化的文档嵌入来挖掘这些主题。我们的方法能生成多样且高度连贯的主题,无需预处理,且被证明是速度最快的上下文主题模型,平均速度比排名第二的BERTopic快4.5倍。我们在Turftopic Python包中提供了$S^3$以及所有上下文基线模型的实现。

英文摘要:

Topic models are useful tools for discovering latent semantic structures in large textual corpora. Recent efforts have been oriented at incorporating contextual representations in topic modeling and have been shown to outperform classical topic models. These approaches are typically slow, volatile, and require heavy preprocessing for optimal results. We present Semantic Signal Separation ($S^3$), a theory-driven topic modeling approach in neural embedding spaces. $S^3$ conceptualizes topics as independent axes of semantic space and uncovers these by decomposing contextualized document embeddings using Independent Component Analysis. Our approach provides diverse and highly coherent topics, requires no preprocessing, and is demonstrated to be the fastest contextual topic model, being, on average, 4.5x faster than the runner-up BERTopic. We offer an implementation of $S^3$, and all contextual baselines, in the Turftopic Python package.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑