arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.14643cs.RO
收藏

双层软数据融合用于室内机器人WiFi-视觉定位

Double-Layer Soft Data Fusion for Indoor Robot WiFi-Visual Localization

laboratory CESI LINEACT UR7527, France(法国CESI LINEACT UR7527实验室)

Yuehua Ding, Jean-Francois Dollinger, Vincent Vauchey, Mourad Zghal

AI总结:

本文提出一种双层软数据融合方法,融合WiFi时空特征与视觉特征,用于室内机器人定位,平均误差1.32米,避免硬决策信息损失,具有鲁棒性。

摘要:

本文提出了一种新颖的WiFi-视觉数据融合方法,用于室内机器人(TIAGO++)的定位。该方法可以利用10个WiFi样本和4张低分辨率图像(像素为$58 \ imes 58$)对室内机器人进行定位,平均误差距离约为1.32米。实验测试是在数据收集3个月后,在一栋普通教学楼内进行的,该教学楼的WiFi和视觉环境均发生了部分变化。这间接证明了所提出方法的鲁棒性。\n本文不侧重于神经网络设计,而是聚焦于软数据融合,以防止视觉定位中的无界误差。提出了一种双层软数据融合方法。所提出的软数据融合包括第一层WiFi-视觉特征融合和第二层决策向量融合。首先,受神经网络在图像处理和识别方面卓越能力的启发,从WiFi数据中提取时空特征,这些特征以图像形式表示。其次,将图像形式的WiFi时空特征与机器人相机拍摄的视觉特征相结合,并由一个分类神经网络共同利用,以生成用于WiFi-视觉定位的似然向量。这被称为第一层WiFi-视觉融合。类似地,这两种类型的特征可以分别由神经网络利用,以生成另外两个独立的似然向量。第三,将这三个似然向量通过Hadamard乘积和中值滤波进行融合,以生成最终的定位似然向量。这被称为第二层决策向量融合。所提出的软数据融合在融合过程中不应用任何阈值,也不优先考虑任何数据源。它从不排除低概率的位置,这可以避免因硬决策而导致的信息损失。提供了演示视频。代码将开源。

英文摘要:

This paper presents a novel WiFi-Visual data fusion method for indoor robot (TIAGO++) localization. This method can use 10 WiFi samples and 4 low-resolution images ($58 \times 58$ in pixels) to localize a indoor robot with an average error distance about 1.32 meters. The experiment test is 3 months after the data collection in a general teaching building, whose WiFi and visual environments are partially changed. This indirectly shows the robustness of the proposed method. Instead of neural network design, this paper focuses on the soft data fusion to prevent unbounded errors in visual localization. A double-layer soft data fusion is proposed. The proposed soft data fusion includes the first-layer WiFi-Visual feature fusion and the second-layer decision vector fusion. Firstly, motivated by the excellent capability of neural network in image processing and recognition, the temporal-spatial features are extracted from WiFi data, these features are represented in image form. Secondly, the WiFi temporal-spatial features in image form and the visual features taken by the robot camera are combined together, and are jointly exploited by a classification neural network to produce a likelihood vector for WiFi-Visual localization. This is called first-layer WiFi-Visual fusion. Similarly, these two types of features can exploited separately by neural networks to produce another two independent likelihood vectors. Thirdly, the three likelihood vectors are fused by Hadamard product and median filtering to produce the final likelihood vector for localization. This called the second-layer decision vector fusion. The proposed soft data fusion does not apply any threshold or prioritize any data source over the other in the fusion process. It never excludes the positions of low probabilities, which can avoid the information loss due to a hard decision. The demo video is provided. The code will be open.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑