arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.20113eess.SYcs.SDcs.SY
收藏

SpeechAgent:面向言语障碍辅助的端到端移动基础设施

SpeechAgent: An End-to-End Mobile Infrastructure for Speech Impairment Assistance

University of New South Wales(新南威尔士大学);Macquarie University(麦考瑞大学);National University of Singapore(国立新加坡大学);CSIRO's Data61(澳大利亚联邦科学与工业研究组织Data61部门)

Haowei Lou, Chengkai Huang, Hye-young Paik, Yongquan Hu, Aaron Quigley, Wen Hu, Lina Yao

AI总结:

SpeechAgent是一个端到端移动系统,结合大语言模型推理与语音处理模块,为构音障碍、口吃和失语症用户提供实时、低延迟的个性化辅助交流,并在真实数据集上验证了有效性和实用性。

摘要:

言语对于人类交流至关重要,然而数百万人面临构音障碍、口吃和失语症等言语障碍,这些状况常常导致社交孤立和参与度降低。尽管自动语音识别(ASR)和文本转语音(TTS)技术近期取得了进展,但面向言语障碍用户的可访问网页和移动基础设施仍然有限,阻碍了这些进展在日常交流中的实际应用。为弥合这一差距,我们提出了SpeechAgent,一个旨在帮助言语障碍人士进行日常交流的移动SpeechAgent。该系统将大语言模型(LLM)驱动的推理与先进的语音处理模块相结合,针对不同障碍类型提供自适应支持。为确保现实世界的实用性,我们开发了一个结构化部署流水线,能够在移动和边缘设备上实现实时语音处理,在保持高准确率和语音质量的同时实现难以察觉的延迟。在真实世界言语障碍数据集上的评估和边缘设备延迟分析证实,SpeechAgent能够提供有效且用户友好的性能,展示了其在个性化、日常辅助交流中的可行性。

英文摘要:

Speech is essential for human communication, yet millions of people face impairments such as dysarthria, stuttering, and aphasia conditions that often lead to social isolation and reduced participation. Despite recent progress in automatic speech recognition (ASR) and text-to-speech (TTS) technologies, accessible web and mobile infrastructures for users with impaired speech remain limited, hindering the practical adoption of these advances in daily communication. To bridge this gap, we present SpeechAgent, a mobile SpeechAgent designed to facilitate people with speech impairments in everyday communication. The system integrates large language model (LLM)- driven reasoning with advanced speech processing modules, providing adaptive support tailored to diverse impairment types. To ensure real-world practicality, we develop a structured deployment pipeline that enables real-time speech processing on mobile and edge devices, achieving imperceptible latency while maintaining high accuracy and speech quality. Evaluation on real-world impaired speech datasets and edge-device latency profiling confirms that SpeechAgent delivers both effective and user-friendly performance, demonstrating its feasibility for personalized, day-to-day assistive communication.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑