In a rapidly evolving digital landscape autonomous tools and robots are becoming commonplace. Recognizing the significance of this development, this paper explores the integration of Large Language Models (LLMs) like Generative pre-trained transformer (GPT) into human-robot teaming environments to facilitate variable autonomy through the means of verbal human-robot communication. In this paper, we introduce a novel framework for such a GPT-powered multi-robot testbed environment, based on a Unity Virtual Reality (VR) setting. This system allows users to interact with robot agents through natural language, each powered by individual GPT cores. By means of OpenAI's function calling, we bridge the gap between unstructured natural language input and structure robot actions. A user study with 12 participants explores the effectiveness of GPT-4 and, more importantly, user strategies when being given the opportunity to converse in natural language within a multi-robot environment. Our findings suggest that users may have preconceived expectations on how to converse with robots and seldom try to explore the actual language and cognitive capabilities of their robot collaborators. Still, those users who did explore where able to benefit from a much more natural flow of communication and human-like back-and-forth. We provide a set of lessons learned for future research and technical implementations of similar systems.
Census-Based Population Autonomy For Distributed Robotic Teaming
Department of Mechanical Engineering, Massachusetts Institute of Technology（麻省理工学院机械工程系）；Woods Hole Oceanographic Institution（伍兹霍尔海洋研究所）；Sibley School of Mechanical and Aerospace Engineering, Cornell University（康奈尔大学Sibley机械与航空航天工程学院）
The case for delegated AI autonomy for Human AI teaming in healthcare
University of York（约克大学）；University Hospitals Coventry and Warwickshire NHS Trust（考文垂与沃里克郡大学医院NHS信托基金会）；University of Warwick（华威大学）；Histofy Ltd（Histofy有限公司）；Improvement Academy, Bradford Teaching Hospitals NHS Foundation Trust（布拉德福德教学医院NHS基金会信托基金会改进学院）
Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interface
Polytechnique Montreal（蒙特利尔理工学院）；NASA Jet Propulsion Laboratory, California Institute of Technology（美国国家航空航天局喷气推进实验室，加州理工学院）；University of Southern California（南加州大学）；University of California, Riverside（加州大学河滨分校）
Human-Centered Shared Autonomy for Motor Planning, Learning, and Control Applications
Translational Neurorobotics Laboratory（转化神经机器人实验室）；Department of Electrical, Computer, and Biomedical Engineering（电气、计算机与生物医学工程系）；University of Rhode Island（罗德岛大学）；Human-Centered AI (HCAI) Labs（以人为本的人工智能实验室）
SAHRTA: A Supervisory-Based Adaptive Human-Robot Teaming Architecture
Dept. of Electrical Engineering Rochester Institute of Technology（罗切斯特理工学院电气工程系）；School of Electrical Engineering and Computer Science Oregon State University（俄勒冈州立大学电气工程与计算机科学学院）；Collaborative Robotics and Intelligent Systems Institute Oregon State University（俄勒冈州立大学协作机器人与智能系统研究所）
MOSAIC: Modular Scalable Autonomy for Intelligent Coordination of Heterogeneous Robotic Teams
FZI Forschungszentrum für Informatik, Karlsruhe, Germany（弗赖堡信息研究中心，卡尔斯鲁厄，德国）；Robotic Systems Lab (RSL), ETH Zürich, Zürich, Switzerland（机器人系统实验室（RSL），苏黎世联邦理工学院，苏黎世，瑞士）；Machine Intelligence and Robotics Lab (MaiRo), Karlsruhe Institute for Technology (KIT), Karlsruhe, Germany（机器智能与机器人实验室（MaiRo），卡尔斯鲁厄技术学院（KIT），卡尔斯鲁厄，德国）；European Space Agency (ESA), Noordwijk, Netherlands（欧洲航天局（ESA），诺德威克，荷兰）
"I am the follower, also the boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired
Institute for AI Industry Research, Tsinghua University（清华大学人工智能产业研究院）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）
A Mini-Review on Mobile Manipulators with Variable Autonomy
Department of Metallurgy & Materials Science, University of Birmingham（伯明翰大学冶金与材料科学系）；The Faraday Institution（法拉第机构）；Queen Mary University of London, School of Electronic Engineering and Computer Science（伦敦大学女王学院电子工程与计算机科学学院）
A Human Digital Twin Architecture for Knowledge-based Interactions and Context-Aware Conversations
University of Central Florida（中佛罗里达大学）；Osmania University（奥斯曼尼亚大学）；Virtual and Augmented Reality Applications Lab（虚拟与增强现实应用实验室）；Emerging Analytics Center（新兴分析中心）；Louisiana Immersive Technologies Enterprise（路易斯安那沉浸式技术企业）；University of Louisiana at Lafayette（路易斯安那大学拉斐特分校）；School of Modeling, Simulation and Training（建模、仿真与训练学院）；Institute for Simulation and Training（仿真与训练研究所）
Large Language Models in Peer-Run Community Behavioral Health Services: Understanding Peer Specialists and Service Users' Perspectives on Opportunities, Risks, and Mitigation Strategies
School of Computer Science（计算机科学系）；Carnegie Mellon University（卡内基梅隆大学）；Human-Computer Interaction Institute（人机交互研究所）；University of Pittsburgh（匹兹堡大学）；Graduate School of Applied and Professional Psychology（应用与专业心理学研究生院）；Rutgers University（罗格斯大学）；Software and Societal Systems Department（软件与社会系统部门）
Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation
Boise State University（博伊州立大学）；University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；University of Pittsburgh（匹兹堡大学）；New York University（纽约大学）；Florida International University（佛罗里达国际大学）
From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
School of Electrical and Computer Engineering, The University of Sydney（悉尼大学电气与计算机工程学院）；University at Buffalo, SUNY（纽约州立大学布法罗分校）；University of Chicago（芝加哥大学）
SeqAR: Jailbreak LLMs with Sequential Auto-Generated Characters
Shanghai University of Finance and Economics（上海财经大学）；Southern University of Science and Technology（南方科技大学）；Ant Group（蚂蚁集团）；The Chinese University of Hong Kong（香港中文大学）
Exploring how EFL students talk to and through AI to develop texts
Everwrite Limited（Everwrite有限公司）；Shanghai Jiao Tong University（上海交通大学）；The Education University of Hong Kong（香港教育大学）；The University of Hong Kong（香港大学）；The Chinese University of Hong Kong（香港中文大学）
When Robots Say No: Temporal Trust Recovery Through Explanation
School of Engineering Mathematics and Technology, University of Bristol, UK（布里斯托大学工程数学与科技学院）；Bristol Digital Futures Institute, University of Bristol, UK（布里斯托数字未来研究所）；School of Computer Science, University of Birmingham, UK（伯明翰大学计算机科学学院）
