arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.01167cs.ROcs.LG
收藏

ConditionNET:学习前置条件与效果以进行执行监控

ConditionNET: Learning Preconditions and Effects for Execution Monitoring

Technische Universität Wien (TU Wien)(维也纳工业大学);German Aerospace Center(德国航空航天中心)

Daniel Sliwowski, Dongheui Lee

AI总结:

提出 ConditionNET,通过数据驱动方式学习动作前置条件与效果,显式建模依赖关系并优化特征表示,在异常检测和阶段预测任务上优于基线,并在真实机器人上验证了其实用性。

摘要:

将机器人引入日常场景需要能够监控任务执行的算法。在本文中,我们提出了 ConditionNET,一种以完全数据驱动的方式学习动作前置条件和效果的方法。我们开发了一个高效的视觉-语言模型,并在训练期间引入额外的优化目标以优化一致的特征表示。ConditionNET 显式地建模了动作、前置条件和效果之间的依赖关系,从而带来了性能的提升。我们在两个机器人数据集上评估了我们的模型,其中一个是我们为本文收集的,包含 406 个成功和 138 个失败的遥操作演示,演示了 Franka Emika Panda 机器人执行倒水和清洁台面等任务。我们在实验中表明,ConditionNET 在异常检测和阶段预测任务上均优于所有基线。此外,我们在真实机器人上实现了动作监控系统,以展示学习到的前置条件和效果的实用适用性。我们的结果突出了 ConditionNET 在增强机器人在真实环境中的可靠性和适应性方面的潜力。数据可在项目网站获取:https://dsliwowski1.github.io/ConditionNET_page。

英文摘要:

The introduction of robots into everyday scenarios necessitates algorithms capable of monitoring the execution of tasks. In this paper, we propose ConditionNET, an approach for learning the preconditions and effects of actions in a fully data-driven manner. We develop an efficient vision-language model and introduce additional optimization objectives during training to optimize for consistent feature representations. ConditionNET explicitly models the dependencies between actions, preconditions, and effects, leading to improved performance. We evaluate our model on two robotic datasets, one of which we collected for this paper, containing 406 successful and 138 failed teleoperated demonstrations of a Franka Emika Panda robot performing tasks like pouring and cleaning the counter. We show in our experiments that ConditionNET outperforms all baselines on both anomaly detection and phase prediction tasks. Furthermore, we implement an action monitoring system on a real robot to demonstrate the practical applicability of the learned preconditions and effects. Our results highlight the potential of ConditionNET for enhancing the reliability and adaptability of robots in real-world environments. The data is available on the project website: https://dsliwowski1.github.io/ConditionNET_page.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑