RoVaR:基于视觉和RF传感器融合双层多样性的鲁棒多智能体跟踪
RoVaR: Robust Multi-agent Tracking through Dual-layer Diversity in Visual and RF Sensor Fusion
摘要:
我们的商品设备中过多的传感器为传感器融合跟踪提供了丰富的基础。然而,今天的解决方案无法在实际的日常环境中跨多个代理提供强大且高的跟踪精度-这是未来沉浸式和协作应用的核心功能。这可以归因于这些融合解决方案所利用的多样性范围有限,阻止它们同时满足准确性,鲁棒性(不同的环境条件)和可扩展性(多个代理)的多个维度。在这项工作中,我们朝着这个目标迈出了重要的一步,通过引入双层多样性的概念,在多智能体跟踪传感器融合的问题。我们证明了互补跟踪方式的融合,被动/相对(例如,视觉里程计)和主动/绝对跟踪(例如,基础设施辅助的RF定位)提供了关键的第一层多样性,带来了可扩展性,而第二层多样性在于融合方法,我们将算法(鲁棒性)和数据驱动(准确性)方法的互补优势结合在一起。RoVaR是这种双层多样性方法的一个实施例,它使用算法和数据驱动技术智能地处理跨模态信息,共同分担准确跟踪野外多个代理的负担。广泛的评估揭示了RoVaR在跟踪精度(中位数为15厘米),鲁棒性(在看不见的环境中),重量轻(在Jetson Nano/TX 2等移动平台上实时运行)方面的多维优势,以实现日常环境中的实际多代理沉浸式应用。
英文摘要:
The plethora of sensors in our commodity devices provides a rich substrate for sensor-fused tracking. Yet, today's solutions are unable to deliver robust and high tracking accuracies across multiple agents in practical, everyday environments - a feature central to the future of immersive and collaborative applications. This can be attributed to the limited scope of diversity leveraged by these fusion solutions, preventing them from catering to the multiple dimensions of accuracy, robustness (diverse environmental conditions) and scalability (multiple agents) simultaneously. In this work, we take an important step towards this goal by introducing the notion of dual-layer diversity to the problem of sensor fusion in multi-agent tracking. We demonstrate that the fusion of complementary tracking modalities, - passive/relative (e.g., visual odometry) and active/absolute tracking (e.g., infrastructure-assisted RF localization) offer a key first layer of diversity that brings scalability while the second layer of diversity lies in the methodology of fusion, where we bring together the complementary strengths of algorithmic (for robustness) and data-driven (for accuracy) approaches. RoVaR is an embodiment of such a dual-layer diversity approach that intelligently attends to cross-modal information using algorithmic and data-driven techniques that jointly share the burden of accurately tracking multiple agents in the wild. Extensive evaluations reveal RoVaR's multi-dimensional benefits in terms of tracking accuracy (median of 15cm), robustness (in unseen environments), light weight (runs in real-time on mobile platforms such as Jetson Nano/TX2), to enable practical multi-agent immersive applications in everyday environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。