Given the complexity of real-world, unstructured domains, it is often impossible or impractical to design models that include every feature needed to handle all possible scenarios that an autonomous system may encounter. For an autonomous system to be reliable in such domains, it should have the ability to improve its competence online. In this paper, we propose a method for improving the competence of a system over the course of its deployment. We specifically focus on a class of semi-autonomous systems known as competence-aware systems that model their own competence -- the optimal extent of autonomy to use in any given situation -- and learn this competence over time from feedback received through interactions with a human authority. Our method exploits such feedback to identify important state features missing from the system's initial model, and incorporates them into its state representation. The result is an agent that better predicts human involvement, leading to improvements in its competence and reliability, and as a result, its overall performance.
The Autonomy-Alignment Problem in Open-Ended Learning Robots: Formalising the Purpose Framework
Institute of Cognitive Sciences and Technologies, National Research Council（认知科学与技术研究所，国家研究理事会）；Integrated Group for Engineering Research, CITIC, Universidade da Coruña（工程研究联合组，CITIC，科鲁纳大学）；Institute of Intelligent Systems and Robotics, Sorbonne University / CNRS（智能系统与机器人研究所，索邦大学 / CNRS）
Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMs
Machine Intelligence and Normative Theory Lab, Australian National University, Acton, ACT 2601, Australia（澳大利亚国立大学机器智能与规范理论实验室）；Digital Media Research Centre GenAI Lab, Queensland University of Technology, Kelvin Grove, QLD 4012, Australia（昆士兰科技大学数字媒体研究中心GenAI实验室）
Autonomy, Social Norms, and Alignment: Towards a Developmental Framework for Autonomous Artificial Agents
Institute of Cognitive Sciences and Technologies (ISTC-CNR)（认知科学与技术研究所（ISTC-CNR））；Interdepartmental Center for Research Ethics and Integrity (CID Ethics)（跨部门研究伦理与诚信中心（CID Ethics））
