arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2009.11485cs.AIcs.CL
收藏

CogniFNN:一个用于认知词嵌入评价的模糊神经网络框架

CogniFNN: A Fuzzy Neural Network Framework for Cognitive Word Embedding Evaluation

Xinping Liu, Zehong Cao, Son Tran

摘要:

词嵌入能够反映语义表征,嵌入质量可以用人类自然阅读相关认知数据源进行综合评价。在本文中,我们提出了CogniFNN框架,这是第一次尝试使用模糊神经网络来提取非线性和非平稳特性的英语词嵌入对相应的认知数据集的评价。在我们的实验中,我们使用了15个人类认知数据集在三种模式:EEG,fMRI和眼动跟踪,并选择均方误差和多假设检验作为指标来评估我们提出的CogniFNN框架。与最近的先驱框架相比,我们提出的CogniFNN对上下文无关(GloVe)和上下文相关(BERT)词嵌入的预测误差较小,并且对随机生成的词嵌入实现了更高的显著性比率。我们的研究结果表明,CogniFNN框架可以提供一个更准确和全面的认知词嵌入的评估。这对于进一步的外部自然语言处理任务的词嵌入评价具有潜在的意义。

英文摘要:

Word embeddings can reflect the semantic representations, and the embedding qualities can be comprehensively evaluated with human natural reading-related cognitive data sources. In this paper, we proposed the CogniFNN framework, which is the first attempt at using fuzzy neural networks to extract non-linear and non-stationary characteristics for evaluations of English word embeddings against the corresponding cognitive datasets. In our experiment, we used 15 human cognitive datasets across three modalities: EEG, fMRI, and eye-tracking, and selected the mean square error and multiple hypotheses testing as metrics to evaluate our proposed CogniFNN framework. Compared to the recent pioneer framework, our proposed CogniFNN showed smaller prediction errors of both context-independent (GloVe) and context-sensitive (BERT) word embeddings, and achieved higher significant ratios with randomly generated word embeddings. Our findings suggested that the CogniFNN framework could provide a more accurate and comprehensive evaluation of cognitive word embeddings. It will potentially be beneficial to the further word embeddings evaluation on extrinsic natural language processing tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑