arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.05486cs.RO
收藏

Listen to Your Map: 一种用于空间声化的在线表示方法

Listen to Your Map: An Online Representation for Spatial Sonification

Robotics Institute, University of Technology Sydney(悉尼科技大学机器人学院);University of Sydney(悉尼大学)

Lan Wu, Craig Jin, Monisha Mushtary Uttsha, Teresa Vidal-Calleja

AI总结:

针对机器人感知辅助导航尤其是视障人士空间声化的需求,本文提出一种基于深度传感器的在线空间表示方法,通过VDB-高斯过程距离场实现高效建图定位,将3D场景编码为与听觉感知对齐的紧凑表示,提升声化性能并支持动态物体处理。

摘要:

机器人感知正成为导航辅助的关键技术,尤其通过空间声化为视障人士提供帮助。本文提出一种能准确捕捉场景几何结构以用于声化的地图表示方法,将物理空间转化为听觉体验。我们利用深度传感器,将增量构建的3D场景编码为包含角度和距离信息的紧凑360度表示,使其与人类听觉空间感知对齐。所提框架通过VDB-高斯过程距离场执行定位与建图,以实现高效的在线场景重建。关键在于以传感器为中心的结构,可维持2D圆形或3D圆柱形的栅格化投影。该空间表示通过使用来自典型房间的简单预录响应转换为双耳听觉信号。定量和定性评估显示,与其他方法相比,该方法在准确性、覆盖范围、时间性能和声化适用性方面均有提升,且能有效处理动态物体。随附视频展示了在类房间环境中的空间声化效果。

英文摘要:

Robotic perception is becoming a key technology for navigation aids, especially helping individuals with visual impairments through spatial sonification. This paper introduces a mapping representation that accurately captures scene geometry for sonification, turning physical spaces into auditory experiences. Using depth sensors, we encode an incrementally built 3D scene into a compact 360-degree representation with angular and distance information, aligning this way with human auditory spatial perception. The proposed framework performs localisation and mapping via VDB-Gaussian Process Distance Fields for efficient online scene reconstruction. The key aspect is a sensor-centric structure that maintains either a 2D-circular or 3D-cylindrical raster-based projection. This spatial representation is then converted into binaural auditory signals using simple pre-recorded responses from a representative room. Quantitative and qualitative evaluations show improvements in accuracy, coverage, timing and suitability for sonification compared to other approaches, with effective handling of dynamic objects as well. An accompanying video demonstrates spatial sonification in room-like environments. https://tinyurl.com/ListenToYourMap

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑