arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.14971cs.SDcs.LGeess.AS
收藏

从独立的房间特定信息与场景特定信息生成盲空间脉冲响应

Blind Spatial Impulse Response Generation from Separate Room- and Scene-Specific Information

Bang & Olufsen A/S(邦及欧路夫森公司);Aalto University(阿尔托大学)

Francesc Lluís, Nils Meyer-Kahlen

AI总结:

本文提出一种用于增强现实音频的盲空间脉冲响应生成方法,通过对比损失训练的编码器提取房间特定信息,并结合基于扩散的生成器在给定新声源-接收器位置时生成空间房间脉冲响应,同时兼顾房间与位置参数。

摘要:

对于增强现实(AR)中的音频,了解用户的真实声学环境对于渲染无缝融入该环境的虚拟声音至关重要。由于在实际的AR应用中通常无法进行声学测量,因此需要从可用的声源推断房间信息。随后,便可以使用相同的房间声学特性来渲染额外的声源。关键在于,这些新声源的放置位置不同于用于估计的声源位置。在此,我们提出使用一种通过对比损失训练的编码器网络,将输入声音映射到仅表示房间特定信息的低维特征空间。接着,训练一个基于扩散的空间房间脉冲响应生成器,使其在给定新的声源-接收器位置时,接收该潜空间并生成新的响应。我们展示了最终输出如何同时考虑房间特定和位置特定的参数。

英文摘要:

For audio in augmented reality (AR), knowledge of the users' real acoustic environment is crucial for rendering virtual sounds that seamlessly blend into the environment. As acoustic measurements are usually not feasible in practical AR applications, information about the room needs to be inferred from available sound sources. Then, additional sound sources can be rendered with the same room acoustic qualities. Crucially, these are placed at different positions than the sources available for estimation. Here, we propose to use an encoder network trained using a contrastive loss that maps input sounds to a low-dimensional feature space representing only room-specific information. Then, a diffusion-based spatial room impulse response generator is trained to take the latent space and generate a new response, given a new source-receiver position. We show how both room- and position-specific parameters are considered in the final output.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑