给黑盒子上色:联觉告诉我们的关于角色嵌入的信息
Coloring the Black Box: What Synesthesia Tells Us about Character Embeddings
摘要:
相对于单词级或字符级的对应物,字符嵌入仍然知之甚少。我们的目标是通过对英语字符嵌入的深入研究来缩小这一差距。为此,我们使用了来自字形-颜色联觉研究的资源-一种神经心理学现象,其中字母与颜色相关,这使我们了解哪些字符与联觉者相似以及字符如何在颜色空间中组织。比较10个不同的字符嵌入,我们问:字符嵌入有多相似的联觉者的字符感知?从不同模型中提取的字符嵌入有多相似?我们发现LSTM比Transformers更适合人类。比较不同的任务,字素到音素转换的结果是最像人类的字符嵌入。最后,ELMo嵌入不同于人类和其他模型。
英文摘要:
In contrast to their word- or sentence-level counterparts, character embeddings are still poorly understood. We aim at closing this gap with an in-depth study of English character embeddings. For this, we use resources from research on grapheme-color synesthesia -- a neuropsychological phenomenon where letters are associated with colors, which give us insight into which characters are similar for synesthetes and how characters are organized in color space. Comparing 10 different character embeddings, we ask: How similar are character embeddings to a synesthete's perception of characters? And how similar are character embeddings extracted from different models? We find that LSTMs agree with humans more than transformers. Comparing across tasks, grapheme-to-phoneme conversion results in the most human-like character embeddings. Finally, ELMo embeddings differ from both humans and other models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。