arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.03808cs.ROcs.AIcs.SYeess.SY
收藏

面向工具选择的置信度感知决策与控制

Confidence-Aware Decision-Making and Control for Tool Selection

Donders Institute, Radboud University(唐德斯研究所,拉德堡德大学);Cajal International Center for Neuroscience, Spanish Research Council(西班牙研究委员会卡哈尔国际神经科学中心)

Ajith Anil Meera, Pablo Lanillos

AI总结:

针对机器人缺乏元认知觉知的问题,提出整合控制置信度的决策框架,推导动态系统控制置信度闭式解,验证其在工具选择任务中可提升性能与可靠性,还可作为计算受限时的决策启发式。

摘要:

在执行任务前对自身表现进行自我反思(例如我们的自信程度),对决策至关重要,比如选择最合适的工具或最佳驾驶路线。尽管这种对自身表现或元认知表现进行思考的觉知能力在人类中广为人知,但机器人仍缺乏这种认知能力。这种反思式监控能够提升机器人的具身决策能力、鲁棒性和安全性。\n本文在此方向上开展研究,提出了一种数学框架,使机器人能够利用其控制自置信度做出更明智的决策。我们推导了动态系统控制置信度的数学闭式表达式(即控制动作的后验逆协方差)。该控制置信度可无缝整合到决策目标函数中,该函数在三个要素间取得平衡:i) 任务完成表现,ii) 控制代价,iii) 自置信度。\n为验证我们的理论推导,我们将决策问题置于工具选择场景下,即智能体必须为特定控制任务选择最合适的机械臂。对随机2自由度机械臂的数值仿真进行统计分析表明,在工具选择过程中使用控制置信度,既能提升实际任务表现,又能提高工具在未建模扰动(如外力)下的性能可靠性。此外,研究结果表明控制置信度是性能的早期指标,因此可在计算能力受限或决策难以求解时作为启发式规则用于决策。总体而言,本文证明了动态系统采用置信度感知决策与控制方案的优势。

英文摘要:

Self-reflecting about our performance (e.g., how confident we are) before doing a task is essential for decision making, such as selecting the most suitable tool or choosing the best route to drive. While this form of awareness -- thinking about our performance or metacognitive performance -- is well-known in humans, robots still lack this cognitive ability. This reflective monitoring can enhance their embodied decision power, robustness and safety. Here, we take a step in this direction by introducing a mathematical framework that allows robots to use their control self-confidence to make better-informed decisions. We derive a mathematical closed-form expression for control confidence for dynamic systems (i.e., the posterior inverse covariance of the control action). This control confidence seamlessly integrates within an objective function for decision making, that balances the: i) performance for task completion, ii) control effort, and iii) self-confidence. To evaluate our theoretical account, we framed the decision-making within the tool selection problem, where the agent has to select the best robot arm for a particular control task. The statistical analysis of the numerical simulations with randomized 2DOF arms shows that using control confidence during tool selection improves both real task performance, and the reliability of the tool for performance under unmodelled perturbations (e.g., external forces). Furthermore, our results indicate that control confidence is an early indicator of performance and thus, it can be used as a heuristic for making decisions when computation power is restricted or decision-making is intractable. Overall, we show the advantages of using confidence-aware decision-making and control scheme for dynamic systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑