arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.21345eess.AS
收藏

探索具有项链形态的 EMG-to-Speech

Towards EMG-to-Speech with a Necklace Form Factor

Peter Wu, Ryan Kaveh, Raghav Nautiyal, Christine Zhang, Albert Guo, Anvitha Kachinthaya, Tavish Mishra, Bohan Yu, Alan W Black, Rikky Muller, Gopala Krishna Anumanchipalli

AI总结:

本文提出一种颈部项链形态的干电极设备用于肌电语音解码,多说话者分类准确率达92.7%,并验证了电极数量对性能的影响及EMG频谱与自监督语音表征间的线性关系。

摘要:

用于从肌电图(EMG)解码语音的电极通常放置在面部,需要使用粘合剂,若经常使用会带来不便并刺激皮肤。我们探索了一种不同的设备形态,将干电极放置在颈部周围。使用该设备记录的数据训练的 11 词、多说话者发声 EMG 分类器达到了 92.7% 的准确率。消融研究表明,颈部配置两个以上电极的重要性,语音学分析揭示了仅颈部形态与颈面部形态之间存在相似的分类混淆。最后,语音-EMG 相关性实验表明,许多 EMG 频谱图频率箱与自监督语音表征维度之间存在线性关系。

英文摘要:

Electrodes for decoding speech from electromyography (EMG) are typically placed on the face, requiring adhesives that are inconvenient and skin-irritating if used regularly. We explore a different device form factor, where dry electrodes are placed around the neck instead. 11-word, multi-speaker voiced EMG classifiers trained on data recorded with this device achieve 92.7% accuracy. Ablation studies reveal the importance of having more than two electrodes on the neck, and phonological analyses reveal similar classification confusions between neck-only and neck-and-face form factors. Finally, speech-EMG correlation experiments demonstrate a linear relationship between many EMG spectrogram frequency bins and self-supervised speech representation dimensions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑