arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2507.15499cs.RO
收藏

CLEVER:基于流式主动学习实现人类指令驱动的鲁棒语义感知

CLEVER: Stream-based Active Learning for Robust Semantic Perception from Human Instructions

Institute of Robotics and Mechatronics, German Aerospace Center (DLR)(机器人与机电研究所,德国航空航天中心);Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology(人机学与机器人研究所,卡尔斯鲁厄技术大学)

Jongseok Lee, Timo Birr, Rudolph Triebel, Tamim Asfour

AI总结:

CLEVER系统通过贝叶斯先验编码领域知识,在数据流中结合人类指令在线调整DNN,首次在真实机器人上实现流式主动学习,提升语义感知鲁棒性。

摘要:

我们提出CLEVER,一个面向深度神经网络(DNNs)鲁棒语义感知的主动学习系统。对于以流形式到达的数据,该系统在遇到失败时寻求人类支持,并根据人类指令在线调整DNNs。通过这种方式,CLEVER最终能够完成给定的语义感知任务。我们的主要贡献是设计了一个满足实现上述能力若干要求的系统。其中的关键使能因素是我们的贝叶斯公式化方法,它通过先验编码领域知识。在实证方面,我们不仅论证了CLEVER的设计动机,还通过用户验证研究以及在人形物体和可变形物体上的实验进一步展示了其能力。据我们所知,我们是首个在真实机器人上实现基于流的主动学习的工作,提供了基于DNN的语义感知鲁棒性可以在实践中得到提升的证据。项目网站可访问:https://sites.google.com/view/thecleversystem。

英文摘要:

We propose CLEVER, an active learning system for robust semantic perception with Deep Neural Networks (DNNs). For data arriving in streams, our system seeks human support when encountering failures and adapts DNNs online based on human instructions. In this way, CLEVER can eventually accomplish the given semantic perception tasks. Our main contribution is the design of a system that meets several desiderata of realizing the aforementioned capabilities. The key enabler herein is our Bayesian formulation that encodes domain knowledge through priors. Empirically, we not only motivate CLEVER's design but further demonstrate its capabilities with a user validation study as well as experiments on humanoid and deformable objects. To our knowledge, we are the first to realize stream-based active learning on a real robot, providing evidence that the robustness of the DNN-based semantic perception can be improved in practice. The project website can be accessed at https://sites.google.com/view/thecleversystem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑