In this article, we are interested in planning problems where the agent is aware of the presence of an observer, and where this observer is in a partial observability situation. The agent has to choose its strategy so as to optimize the information transmitted by observations. Building on observer-aware Markov decision processes (OAMDPs), we propose a framework to handle this type of problems and thus formalize properties such as legibility, explicability and predictability. This extension of OAMDPs to partial observability can not only handle more realistic problems, but also permits considering dynamic hidden variables of interest. These dynamic target variables allow, for instance, working with predictability, or with legibility problems where the goal might change during execution. We discuss theoretical properties of PO-OAMDPs and, experimenting with benchmark problems, we analyze HSVI's convergence behavior with dedicated initializations and study the resulting strategies.
Action-Conditioned Risk Gating for Safety-Critical Control under Partial Observability
University of Virginia(弗吉尼亚大学);Google(谷歌);University of Maryland, College Park(马里兰大学 College Park 分校);Stanford University(斯坦福大学);Louisiana State University(路易斯安那州立大学);College of William and Mary(威廉与玛丽学院)
Repeated Deceptive Path Planning against Learnable Observer
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);National Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institution of Automation, Chinese Academy of Sciences(中国科学院复杂系统认知与决策智能国家重点实验室)
Learning Spatiotemporal Decision Priors for Efficient Path Planning under Partial Observability
College of Intelligent Robotics and Advanced Manufacturing, Fudan University(智能机器人与先进制造学院,复旦大学);School of Information Science and Technology, Fudan University(信息科学与技术学院,复旦大学);Department of Information Technology, Old Dominion University(信息技术系,老 Dominion 大学)