Advances in autonomy offer the potential for dramatic positive outcomes in a number of domains, yet enabling their safe deployment remains an open problem. This work's motivating question is: In safety-critical settings, can we avoid the need to have one human supervise one machine at all times? The work formalizes this scalable supervision problem by considering remotely located human supervisors and investigating how autonomous agents can cooperate to achieve safety. This article focuses on the safety-critical context of autonomous vehicles (AVs) merging into traffic consisting of a mixture of AVs and human drivers. The analysis establishes high reliability upper bounds on human supervision requirements. It further shows that AV cooperation can improve supervision reliability by orders of magnitude and counterintuitively requires fewer supervisors (per AV) as more AVs are adopted. These analytical results leverage queuing-theoretic analysis, order statistics, and a conservative, reachability-based approach. A key takeaway is the potential value of cooperation in enabling the deployment of autonomy at scale. While this work focuses on AVs, the scalable supervision framework may be of independent interest to a broader array of autonomous control challenges.
Weak Human Preference Supervision For Deep Reinforcement Learning
University of Tasmania(塔斯马尼亚大学);MyState Bank(MyState银行);Australian Artificial Intelligence Institute(澳大利亚人工智能研究所);University of Technology Sydney(悉尼科技大学)
Scaffolded Language Models with Language Supervision for Mixed-Autonomy: A Survey
Department of Computer Science and Technology, Tsinghua University, Beijing, China(计算机科学与技术系,清华大学,北京,中国);Department of Automation, Tsinghua University, Beijing, China(自动化系,清华大学,北京,中国);Shanghai AI Lab, Shanghai, China(上海人工智能实验室,上海,中国);Xi'an Jiaotong University, Xi'an, China(西安交通大学,西安,中国)
VASP Agent: An Agentic Framework for Autonomous First-principles Calculations
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Department of Computer Science and Technology(计算机科学与技术系);School of Physical Science and Technology(物理科学与技术学院);Department of Automation(自动化系);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心);School of Chemistry and Chemical Engineering(化学与化工学院);Key Laboratory of Computational Physical Sciences (Ministry of Education)(计算物理科学重点实验室);The Chinese University of Hong Kong(香港中文大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究所)