FlexDuo:一种为语音对话系统启用全双工能力的可插拔系统
FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems
AI总结:
本文提出FlexDuo,一种即插即用的全双工控制模块,通过解耦双工控制与对话系统并引入显式Idle状态过滤噪声与缓冲语义,显著降低了错误打断率并提升了响应准确率。
摘要:
全双工语音对话系统通过实现实时双向通信,显著提升了人机交互的自然性。然而,由于高度耦合的架构设计和过于简化的二元状态建模,现有方法面临独立模块优化困难和上下文噪声干扰等挑战。本文提出了FlexDuo,一种灵活的全双工控制模块,通过即插即用的架构设计将全双工控制与语音对话系统解耦。此外,受人类对话中信息过滤机制的启发,我们引入了显式的Idle状态。一方面,Idle状态过滤冗余噪声和无关音频以提升对话质量。另一方面,它建立了基于语义完整性的缓冲机制,在确保准确响应转换的同时降低相互打断的风险。在Fisher语料库上的实验结果表明,与集成的全双工对话系统基线相比,FlexDuo将错误打断率降低了24.9%,并将响应准确率提高了7.6%。在中文和英文对话质量上,它也优于语音活动检测(VAD)控制的基线系统。所提出的模块化架构和基于状态的对话模型为构建灵活高效的双工对话系统提供了新的技术途径。
英文摘要:
Full-Duplex Speech Dialogue Systems (Full-Duplex SDS) have significantly enhanced the naturalness of human-machine interaction by enabling real-time bidirectional communication. However, existing approaches face challenges such as difficulties in independent module optimization and contextual noise interference due to highly coupled architectural designs and oversimplified binary state modeling. This paper proposes FlexDuo, a flexible full-duplex control module that decouples duplex control from spoken dialogue systems through a plug-and-play architectural design. Furthermore, inspired by human information-filtering mechanisms in conversations, we introduce an explicit Idle state. On one hand, the Idle state filters redundant noise and irrelevant audio to enhance dialogue quality. On the other hand, it establishes a semantic integrity-based buffering mechanism, reducing the risk of mutual interruptions while ensuring accurate response transitions. Experimental results on the Fisher corpus demonstrate that FlexDuo reduces the false interruption rate by 24.9% and improves response accuracy by 7.6% compared to integrated full-duplex dialogue system baselines. It also outperforms voice activity detection (VAD) controlled baseline systems in both Chinese and English dialogue quality. The proposed modular architecture and state-based dialogue model provide a novel technical pathway for building flexible and efficient duplex dialogue systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。