Hierarchical Reinforcement Learning has been previously shown to speed up the convergence rate of RL planning algorithms as well as mitigate feature-based model misspecification (Mankowitz et. al. 2016a,b, Bacon 2015). To do so, it utilizes hierarchical abstractions, also known as skills -- a type of temporally extended action (Sutton et. al. 1999) to plan at a higher level, abstracting away from the lower-level details. We incorporate risk sensitivity, also referred to as Situational Awareness (SA), into hierarchical RL for the first time by defining and learning risk aware skills in a Probabilistic Goal Semi-Markov Decision Process (PG-SMDP). This is achieved using our novel Situational Awareness by Risk-Conscious Skills (SARiCoS) algorithm which comes with a theoretical convergence guarantee. We show in a RoboCup soccer domain that the learned risk aware skills exhibit complex human behaviors such as `time-wasting' in a soccer game. In addition, the learned risk aware skills are able to mitigate reward-based model misspecification.
Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Zhejiang Key Laboratory of Big Data Intelligent Computing(浙江省大数据智能计算重点实验室)
Cognitively Layered Data Synthesis for Domain Adaptation of LLMs to Space Situational Awareness
Qian Xuesen Laboratory of Space Technology(钱学森空间技术实验室);China Academy of Space Technology(中国航天科技研究院);State Key Laboratory of Space Information System and Integrated Application(空间信息系统与集成应用国家重点实验室)
The Reasoning Trap -- Logical Reasoning as a Mechanistic Pathway to Situational Awareness
MARS 4.0 Fellowship, Cambridge AI Safety Hub(CAISH), University of Cambridge(MARS 4.0 Fellow,剑桥人工智能安全中心(CAISH),剑桥大学);AWS Generative AI Innovation Center, Amazon Web Services, USA(亚马逊生成AI创新中心,亚马逊网络服务,美国);Google, USA(谷歌,美国);Stanford University(斯坦福大学);Northeastern University, Seattle, WA, USA(东北大学,西雅图,华盛顿州,美国)
An Overlay Multicast Routing Method Based on Network Situational Awareness and Hierarchical Multi-Agent Reinforcement Learning
School of Information and Communication, Guilin University of Electronic Technology(桂林电子科技大学信息与通信学院);School of Computer Science and Information Security, Guilin University of Electronic Technology(桂林电子科技大学计算机科学与信息安全学院);Information Center, Guilin Medical University(桂林医学院信息中心);School of Optoelectronic Engineering, Guilin University of Electronic Technology(桂林电子科技大学光电工程学院)
Situational Awareness as the Imperative Capability for Disaster Resilience in the Era of Complex Hazards and Artificial Intelligence
organization= UrbanResilience.AI Lab, Zachry Department of Civil;Environmental Engineering, Texas A\&M University , city= College Station , postcode= 77843 , state= TX , country= USA
VISTA: An Attention-Based Multi-Agent Reinforcement Learning Architecture for Space Situational Awareness Sensor Tasking
ETSIAE-School of Aeronautics, Universidad Politécnica de Madrid(马德里理工大学航空学院);Indra Sistemas S.A.(英德拉系统公司);Escuela de Ingeniería de Fuenlabrada, Universidad Rey Juan Carlos(胡安卡洛斯国王大学丰拉夫拉达工程学院);Department of Computer Systems Engineering, Universidad Politécnica de Madrid(马德里理工大学计算机系统工程系)
Preventing Adversarial AI Attacks Against Autonomous Situational Awareness: A Maritime Case Study
The School of Engineering, Computing and Mathematics, University of Plymouth(工程、计算与数学学院,普利茅斯大学);The Alan Turing Institute, British Library(艾伦·图灵研究所,大英图书馆)