arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.01634eess.AScs.AI
收藏

HuPER:一种受人类启发的语音感知框架

HuPER: A Human-Inspired Framework for Phonetic Perception

Zhejiang University, China(浙江大学);University of California, Berkeley, USA(加州大学伯克利分校)

Chenxu Guo, Jiachen Lian, Yisi Liu, Baihe Huang, Shriyaa Narayanan, Bixing Wu, Zoe Ezzes, Jet Vonk, Zachary Miller, Cheol Jun Cho, Maria Gorno-Tempini, Gopala Anumanchipalli

AI总结:

HuPER是一种受人类启发的语音感知框架,通过自适应推断实现高效语音识别,仅需100小时训练数据即可在多个语言基准中取得最佳性能,并支持跨语言零样本迁移。

摘要:

我们提出HuPER,一种受人类启发的框架,将语音感知建模为对语音-声学证据和语言知识的自适应推断。仅使用100小时的训练数据,HuPER在五个英语基准上实现了最先进的语音错误率,并在95种未见过的语言上实现了强大的零样本迁移。HuPER也是第一个能够在多路径语音感知下适应不同声音条件的框架。所有训练数据、模型和代码均已开源。代码和演示可访问https://github.com/HuPER29/HuPER。

英文摘要:

We propose HuPER, a human-inspired framework that models phonetic perception as adaptive inference over acoustic-phonetics evidence and linguistic knowledge. With only 100 hours of training data, HuPER achieves state-of-the-art phonetic error rates on five English benchmarks and strong zero-shot transfer to 95 unseen languages. HuPER is also the first framework to enable adaptive, multi-path phonetic perception under diverse acoustic conditions. All training data, models, and code are open-sourced. Code and demo avaliable at https://github.com/Berkeley-Speech-Group/HuPER.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑