发表机构
Huawei Turkey R&D Center; Istanbul Technical University（华为土耳其研发中心; 伊斯坦布尔理工大学）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本研究提出基于Hüllermeier-Rifqi Index的新型评估方案，结合多语言转录数据集与碰撞率，评估语音编码算法与IPA转录的符合度，还可测量语言正字法透明度。
AI 中文摘要
本研究提出一种基于Rand Index测度广义变体（即Hüllermeier-Rifqi Index）的新型评估方案，用于评估语音编码算法与IPA（国际音标）标注的基于单词的转录文本的符合程度。为实现该目标，通过计算基准转录文本与对应语音编码文本的成对相似度值的绝对差值得到不一致分数，其中成对相似度值采用归一化编辑距离作为依赖排列的字符串度量进行计算。随后，将所得分数与纳入待评估编码器相同字母表的随机字符串生成器的分数进行调整。基于此方案，在多语言转录数据集上对多种语音编码器进行了评估，同时结合碰撞率评估其召回能力。当将书写系统视为固有语音表示时，该方案可用于测量语言的正字法透明度，进一步验证了其有效性。
英文摘要
In this work, a novel evaluation scheme built on a generalized variant of the Rand Index measure, namely, the Hüllermeier-Rifqi Index, is proposed in order to assess how well phonetic encoding algorithms conform to word-based transcriptions in IPA (International Phonetic Alphabet) notation. For this objective, the discordance score is obtained by calculating the absolute difference between the pairwise similarity values of ground-truth transcriptions and those of corresponding phonetic encodings, which are computed using normalized edit distance as a permutation dependent string metric. The resulting score is subsequently adjusted with respect to that of a random string generator incorporating the same alphabet as the encoder under consideration. A wide range of phonetic encoders were evaluated as such on multi-lingual transcription datasets along with their recall capabilities based on the collision rate. The validity of the proposed scheme is further supported by its applicability in measuring the orthographic transparency of a language when the writing system is viewed as an inherent phonetic representation.
Comments17 pages, 3 figures, 5 tables
