We present Confidence-Based Autonomy (CBA), an interactive algorithm for policy learning from demonstration. The CBA algorithm consists of two components which take advantage of the complimentary abilities of humans and computer agents. The first component, Confident Execution, enables the agent to identify states in which demonstration is required, to request a demonstration from the human teacher and to learn a policy based on the acquired data. The algorithm selects demonstrations based on a measure of action selection confidence, and our results show that using Confident Execution the agent requires fewer demonstrations to learn the policy than when demonstrations are selected by a human teacher. The second algorithmic component, Corrective Demonstration, enables the teacher to correct any mistakes made by the agent through additional demonstrations in order to improve the policy and future task performance. CBA and its individual components are compared and evaluated in a complex simulated driving domain. The complete CBA algorithm results in the best overall learning performance, successfully reproducing the behavior of the teacher while balancing the tradeoff between number of demonstrations and number of incorrect actions during learning.
Amico: An Event-Driven Modular Framework for Persistent and Embedded Autonomy
Department of Aeronautics and Astronautics, Zhejiang University(浙江大学航空航天学院);Department of Computer Science, University College London(伦敦大学学院计算机系);Steinhardt School of Culture, Education, and Human Development, New York University(纽约大学文化、教育与人类发展学院)
A Survey on Autonomy-Induced Security Risks in Large Model-Based Agents
Dept. of Comp. Sci. & Tech.(计算机科学与技术系);College of AI(人工智能学院);Institute for AI(人工智能研究院);BNRist Center(BNRist中心);THBI Lab(THBI实验室);Tsinghua-Bosch Joint Center for ML(清华大学-博世联合机器学习中心);Tsinghua University(清华大学)
The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy
Hunan University(湖南大学);ByteDance(字节跳动);Duke University(杜克大学);Westlake University(西湖大学);The University of Hong Kong(香港大学);Nanyang Technological University(南洋理工大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Macau(澳门大学);The Ohio State University(俄亥俄州立大学)