This paper presents a novel WiFi-Visual data fusion method for indoor robot (TIAGO++) localization. This method can use 10 WiFi samples and 4 low-resolution images ($58 \times 58$ in pixels) to localize a indoor robot with an average error distance about 1.32 meters. The experiment test is 3 months after the data collection in a general teaching building, whose WiFi and visual environments are partially changed. This indirectly shows the robustness of the proposed method.
Instead of neural network design, this paper focuses on the soft data fusion to prevent unbounded errors in visual localization. A double-layer soft data fusion is proposed. The proposed soft data fusion includes the first-layer WiFi-Visual feature fusion and the second-layer decision vector fusion. Firstly, motivated by the excellent capability of neural network in image processing and recognition, the temporal-spatial features are extracted from WiFi data, these features are represented in image form. Secondly, the WiFi temporal-spatial features in image form and the visual features taken by the robot camera are combined together, and are jointly exploited by a classification neural network to produce a likelihood vector for WiFi-Visual localization. This is called first-layer WiFi-Visual fusion. Similarly, these two types of features can exploited separately by neural networks to produce another two independent likelihood vectors. Thirdly, the three likelihood vectors are fused by Hadamard product and median filtering to produce the final likelihood vector for localization. This called the second-layer decision vector fusion. The proposed soft data fusion does not apply any threshold or prioritize any data source over the other in the fusion process. It never excludes the positions of low probabilities, which can avoid the information loss due to a hard decision. The demo video is provided. The code will be open.
TWC-SLAM: Multi-Agent Cooperative SLAM with Text Semantics and WiFi Features Integration for Similar Indoor Environments
Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东人工智能与数字经济实验室);Shenzhen University(深圳大学);College of natural resources and environment(自然资源与环境学院)
Inverse k-visibility for RSSI-based Indoor Geometric Mapping
Department of Cognitive Robotics, Delft University of Technology(认知机器人系,代尔夫特理工大学);Department of Mechanical and Industrial Engineering, University of Toronto(机械与工业工程系,多伦多大学);Department of Computer Science, Toronto Metropolitan University(计算机科学系,多伦多 Metropolitan 大学);Department of Computer Science, University College London(计算机科学系,伦敦大学学院)
Fast and Reliable WiFi Fingerprint Collection for Indoor Localization
University of Melbourne(墨尔本大学);China University of Geosciences(中国地质大学);National Engineering Research Center for Geographic Information System(国家地理信息系统工程技术研究中心)
Error Model of Radio Fingerprint and PDR Fusion Indoor Localization
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, China(中国教育部航空航天信息安全与可信计算重点实验室);School of Cyber Science and Engineering, Wuhan University, China(中国武汉大学网络空间安全学院)
MDF: Multi-Modal Data Fusion with CNN-Based Object Detection for Enhanced Indoor Localization Using LiDAR-SLAM
Department of Artificial Intelligence Convergence, Pukyong National University(人工智能融合系,浦项国立大学);School of Computer Science, University of Nottingham Ningbo China(计算机科学学院,诺丁汉国际大学)