决策理论规划框架I:结合情境演算、条件规划、概率和效用
A Framework for Decision-Theoretic Planning I: Combining the Situation Calculus, Conditional Plans, Probability and Utility
摘要:
本文展示了我们如何将行动的逻辑表示和决策理论以一种对两者来说都很自然的方式结合起来。特别是,我们假设一个公理化的域的情况演算,使用什么基本上是赖特的解决方案的框架问题,在完成的公理定义的状态变化。不确定性是根据独立选择逻辑来处理的,独立选择逻辑允许独立的选择和给出选择结果的逻辑程序。作为结果的一部分,是(最终)状态效用的规范。机器人采用机器人计划,类似于GOOGLE程序设计语言。在这个逻辑中,我们可以根据行动、不确定性和效用的公理化来定义条件计划的预期效用。什么?规划问题就是要找到期望效用最高的方案。这与POMDPs最近的结构化表示有关;在这里,我们使用随机情景演算规则来指定状态转移函数和奖励/价值函数。最后,我们表明,与随机框架公理,行动表示在概率BCPPS是指数大于使用这里提出的表示。
英文摘要:
This paper shows how we can combine logical representations of actions and decision theory in such a manner that seems natural for both. In particular we assume an axiomatization of the domain in terms of situation calculus, using what is essentially Reiter's solution to the frame problem, in terms of the completion of the axioms defining the state change. Uncertainty is handled in terms of the independent choice logic, which allows for independent choices and a logic program that gives the consequences of the choices. As part of the consequences are a specification of the utility of (final) states. The robot adopts robot plans, similar to the GOLOG programming language. Within this logic, we can define the expected utility of a conditional plan, based on the axiomatization of the actions, the uncertainty and the utility. The ?planning' problem is to find the plan with the highest expected utility. This is related to recent structured representations for POMDPs; here we use stochastic situation calculus rules to specify the state transition function and the reward/value function. Finally we show that with stochastic frame axioms, actions representations in probabilistic STRIPS are exponentially larger than using the representation proposed here.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。