arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.10048cs.SDcs.AIeess.AS
收藏

自然环境中头部朝向的音频驱动强化学习

Audio-Driven Reinforcement Learning for Head-Orientation in Naturalistic Environments

Radboud University(拉德堡德大学);Donders Institute(多纳德研究所)

Wessel Ledder, Yuzhen Qin, Kiki van der Heijden

AI总结:

本研究提出音频驱动的深度Q学习框架,使智能体在自然声学环境中基于立体声朝向说话者,并验证了其性能及跨混响环境的泛化局限性。

摘要:

尽管近年来深度强化学习(DRL)方法在音频信号处理领域取得了显著进展,但在人机交互背景下,音频驱动的DRL用于导航、视线控制和头部朝向控制等任务却鲜受关注。在此,我们提出一个音频驱动的DRL框架,利用深度Q学习开发一个自主智能体,该智能体基于立体声语音记录在声学环境中朝向说话者。我们的结果表明,当在无回声(即无混响)环境中对语音片段进行训练时,智能体学会了以近乎完美的水平执行任务。自然声学环境中存在的混响影响了智能体的性能,尽管该智能体仍显著优于随机行动的基线智能体。最后,我们量化了所提出的DRL方法在自然声学环境中的泛化程度。我们的实验揭示,在中等或高混响环境中训练的智能体所学到的策略能够泛化到低混响环境,但在无回声或低混响环境中训练的智能体所学到的策略不能泛化到中等或高混响环境。综上所述,本研究展示了音频驱动DRL在头部朝向控制等任务中的潜力,并强调了对于真实世界音频驱动DRL应用,需要能够跨环境实现稳健泛化的训练策略。

英文摘要:

Although deep reinforcement learning (DRL) approaches in audio signal processing have seen substantial progress in recent years, audio-driven DRL for tasks such as navigation, gaze control and head-orientation control in the context of human-robot interaction have received little attention. Here, we propose an audio-driven DRL framework in which we utilise deep Q-learning to develop an autonomous agent that orients towards a talker in the acoustic environment based on stereo speech recordings. Our results show that the agent learned to perform the task at a near perfect level when trained on speech segments in anechoic environments (that is, without reverberation). The presence of reverberation in naturalistic acoustic environments affected the agent's performance, although the agent still substantially outperformed a baseline, randomly acting agent. Finally, we quantified the degree of generalization of the proposed DRL approach across naturalistic acoustic environments. Our experiments revealed that policies learned by agents trained on medium or high reverb environments generalized to low reverb environments, but policies learned by agents trained on anechoic or low reverb environments did not generalize to medium or high reverb environments. Taken together, this study demonstrates the potential of audio-driven DRL for tasks such as head-orientation control and highlights the need for training strategies that enable robust generalization across environments for real-world audio-driven DRL applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑