arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.14397cs.RO

eNavi:基于事件的模仿策略用于低光室内移动机器人导航

eNavi: Event-based Imitation Policies for Low-Light Indoor Mobile Robot Navigation

Prithvi Jai Ramesh, Kaustav Chanda, Krishna Vinod, Joseph Raj Vishal, Yezhou Yang, Bharatesh Chakravarthi

AI总结:

本文提出eNavi,通过结合RGB和事件数据的多模态策略提升低光环境下机器人导航的鲁棒性,实验显示融合模型在未见低光条件下表现更优。

摘要:

事件相机提供高动态范围和微秒级时间分辨率,使其适合室内机器人导航,传统RGB相机在快速运动或低光条件下性能下降。尽管事件感知在检测、SLAM和姿态估计方面有进展,但端到端控制策略利用事件流异步特性仍有不足。为此,我们引入了一个真实室内人跟随数据集,使用TurtleBot 2机器人收集,包含同步的原始事件流、RGB帧和专家控制动作。我们构建了多模态数据预处理管道,对齐事件和RGB观测并重建地面真实动作以支持高质量模仿学习。基于此数据集,我们提出了一种晚融合的RGB-Event导航策略,结合双MobileNet编码器和基于Transformer的融合模块,通过行为克隆训练。系统评估了RGB-only、Event-only和RGB-Event融合模型在12种训练变体中的性能,结果显示融合模型在未见低光条件下鲁棒性更高,动作预测误差更低。

英文摘要:

Event cameras provide high dynamic range and microsecond-level temporal resolution, making them well-suited for indoor robot navigation, where conventional RGB cameras degrade under fast motion or low-light conditions. Despite advances in event-based perception spanning detection, SLAM, and pose estimation, there remains limited research on end-to-end control policies that exploit the asynchronous nature of event streams. To address this gap, we introduce a real-world indoor person-following dataset collected using a TurtleBot 2 robot, featuring synchronized raw event streams, RGB frames, and expert control actions across multiple indoor maps, trajectories under both normal and low-light conditions. We further build a multimodal data preprocessing pipeline that temporally aligns event and RGB observations while reconstructing ground-truth actions from odometry to support high-quality imitation learning. Building on this dataset, we propose a late-fusion RGB-Event navigation policy that combines dual MobileNet encoders with a transformer-based fusion module trained via behavioral cloning. A systematic evaluation of RGB-only, Event-only, and RGB-Event fusion models across 12 training variations ranging from single-path imitation to general multi-path imitation shows that policies incorporating event data, particularly the fusion model, achieve improved robustness and lower action prediction error, especially in unseen low-light conditions where RGB-only models fail. We release the dataset, synchronization pipeline, and trained models at https://eventbasedvision.github.io/eNavi/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑