arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 1206.5249cs.AI
收藏

面向多任务的概率关系动力学学习

Learning Probabilistic Relational Dynamics for Multiple Tasks

MIT CSAIL(麻省理工学院计算机科学与人工智能实验室)

Ashwin Deshpande, Brian Milch, Luke S. Zettlemoyer, Leslie Pack Kaelbling

摘要:

代理的行为影响世界的方式通常可以使用一组相关的概率规划规则来建模。本文讨论了学习多个相关任务的规则集的问题。我们采取分层贝叶斯方法,系统学习规则集的先验分布。我们提出了一类先验分布参数化的规则集原型,随机修改,以产生一个特定于任务的规则集。我们还描述了一个坐标上升算法,迭代优化特定于任务的规则集和先验分布。使用该算法的实验表明,从相关的任务中转移信息显着减少了预测块世界域中的动作效果所需的训练数据量。

英文摘要:

The ways in which an agent's actions affect the world can often be modeled compactly using a set of relational probabilistic planning rules. This paper addresses the problem of learning such rule sets for multiple related tasks. We take a hierarchical Bayesian approach, in which the system learns a prior distribution over rule sets. We present a class of prior distributions parameterized by a rule set prototype that is stochastically modified to produce a task-specific rule set. We also describe a coordinate ascent algorithm that iteratively optimizes the task-specific rule sets and the prior distribution. Experiments using this algorithm show that transferring information from related tasks significantly reduces the amount of training data required to predict action effects in blocks-world domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑