实时的三维映射与声学材料估计
Real-time 3-D Mapping with Estimating Acoustic Materials
摘要:
本文提出了一个实时的【形】系统集成的声学材料估计从视觉外观和在3维的飞行映射。所提出的方法估计室内场景中周围环境的声学材料,并将它们合并到3-D占用图中,机器人在环境中移动。为了从视觉线索中估计声学材料,我们应用最先进的语义分割CNN网络,该网络基于视觉外观和声学材料具有强关联的假设。此外,我们引入了一个更新策略来处理在线映射过程中的重大估计。因此,我们的具有声学材料的环境地图可以用于与声音相关的机器人应用,例如考虑到各种声学传播(例如,反射)。
英文摘要:
This paper proposes a real-time system integrating an acoustic material estimation from visual appearance and an on-the-fly mapping in the 3-dimension. The proposed method estimates the acoustic materials of surroundings in indoor scenes and incorporates them to a 3-D occupancy map, as a robot moves around the environment. To estimate the acoustic material from the visual cue, we apply the state-of-the-art semantic segmentation CNN network based on the assumption that the visual appearance and the acoustic materials have a strong association. Furthermore, we introduce an update policy to handle the material estimations during the online mapping process. As a result, our environment map with acoustic material can be used for sound-related robotics applications, such as sound source localization taking into account various acoustic propagation (e.g., reflection).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。