声学词嵌入的表征几何分析
Analyzing the Representational Geometry of Acoustic Word Embeddings
摘要:
声学词嵌入(AWE)是一种矢量表示,使得同一个词的不同声学样本在嵌入空间中被投影到附近。除了它们在语音技术应用中的使用,如口语术语发现和关键字定位,AWE模型已被采用作为口语字处理的模型在几个认知动机的研究,并已被证明在一些听觉处理任务中表现出类似人类的性能。然而,AWE的代表性几何形状仍然是一个未被研究的主题,尚未在文献中研究。在本文中,我们采取了更密切的分析看看从英语语音学习AWE和学习目标的选择和架构如何塑造他们的代表性的个人资料。为此,我们采用了一套分析技术,从机器学习和神经科学在三个不同的分析:嵌入空间均匀性,词的可辨别性,和代表性的一致性。我们的主要研究结果突出了突出的作用,学习目标塑造的代表性配置文件相比,模型架构。
英文摘要:
Acoustic word embeddings (AWEs) are vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding space. In addition to their use in speech technology applications such as spoken term discovery and keyword spotting, AWE models have been adopted as models of spoken-word processing in several cognitively motivated studies and have been shown to exhibit human-like performance in some auditory processing tasks. Nevertheless, the representational geometry of AWEs remains an under-explored topic that has not been studied in the literature. In this paper, we take a closer analytical look at AWEs learned from English speech and study how the choice of the learning objective and the architecture shapes their representational profile. To this end, we employ a set of analytic techniques from machine learning and neuroscience in three different analyses: embedding space uniformity, word discriminability, and representational consistency. Our main findings highlight the prominent role of the learning objective on shaping the representation profile compared to the model architecture.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。