可视化降维文本嵌入的空间语义
Visualizing Spatial Semantics of Dimensionally Reduced Text Embeddings
AI总结:
本文提出基于梯度的可视化方法,将空间词云融入降维文本投影,以揭示文档投影中的语义特征,并设计系统验证其应用价值。
摘要:
降维(DR)可以将高维文本嵌入转换为二维视觉投影,从而便于探索文档相似性。然而,由于文本嵌入的不透明性和非线性降维,该投影往往缺乏与文本语义的联系。为了解决这些问题,我们提出了一种基于梯度的方法,用于可视化降维文本嵌入的空间语义。该方法利用梯度来评估投影文档对底层单词的敏感性。该方法可应用于现有的降维算法和文本嵌入模型。利用这些梯度,我们设计了一个可视化系统,将空间词云融入文档投影空间,以展示具有影响力的文本特征。我们进一步展示了三个使用场景,证明了我们的系统在促进发现和解释文本投影中底层语义方面的实际应用。
英文摘要:
Dimension reduction (DR) can transform high-dimensional text embeddings into a 2D visual projection facilitating the exploration of document similarities. However, the projection often lacks connection to the text semantics, due to the opaque nature of text embeddings and non-linear dimension reductions. To address these problems, we propose a gradient-based method for visualizing the spatial semantics of dimensionally reduced text embeddings. This method employs gradients to assess the sensitivity of the projected documents with respect to the underlying words. The method can be applied to existing DR algorithms and text embedding models. Using these gradients, we designed a visualization system that incorporates spatial word clouds into the document projection space to illustrate the impactful text features. We further present three usage scenarios that demonstrate the practical applications of our system to facilitate the discovery and interpretation of underlying semantics in text projections.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。