arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.29541cs.CL
收藏

大语言模型能否像语言学家一样识别口音?

Can LLM Agents Identify Spoken Dialects like a Linguist?

Department of Computer Science, University of Bonn(波恩大学计算机科学系);Research Center Deutscher Sprachatlas, Marburg University(马尔堡大学德语语言地图研究中心);Bonn-Aachen International Center for Information Technology, University of Bonn(波恩大学波恩-亚琛国际信息技术中心);Lamarr Institute for Machine Learning and Artificial Intelligence(拉马尔机器学习和人工智能研究所)

Tobias Bystrich, Lukas Hamm, Maria Hassan, Lea Fischbach, Lucie Flek, Akbar Karimi

AI总结:

本文研究大语言模型在识别口音方面的能力,对比了LLM与HuBERT等模型的性能,并提供LLM和人类语言学家的基线方法。

摘要:

由于标注有限的方言语音,大多数语言的音频方言分类都是一个具有挑战性的任务,包括瑞士德语。在本工作中,我们探讨了大语言模型(LLMs)作为理解方言的代理的能力,以及它们是否能在方言分类任务上表现出与HuBERT等模型相当的性能。此外,我们提供了一个LLM基线和一个人类语言学家的基线。我们的方法利用由ASR系统生成的语音转录文本,并将其与方言特征图、元音历史和规则等语言资源相结合。我们的发现表明,当提供语言信息时,LLM的预测结果会有所提升。人类基线显示,自动生成的转录文本对这样的分类是有益的,但也展示了改进的机会。

英文摘要:

Due to the scarcity of labeled dialectal speech, audio dialect classification is a challenging task for most languages, including Swiss German. In this work, we explore the ability of large language models (LLMs) as agents in understanding the dialects and whether they can show comparable performance to models such as HuBERT in dialect classification. In addition, we provide an LLM baseline and a human linguist one. Our approach uses phonetic transcriptions produced by ASR systems and combines them with linguistic resources such as dialect feature maps, vowel history, and rules. Our findings indicate that, when linguistic information is provided, the LLM predictions improve. The human baseline shows that automatically generated transcriptions can be beneficial for such classifications, but also presents opportunities for improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑