Sonalysts is working on an initiative to expand our current expertise in teaming to Human-Artificial Intelligence (AI) teams by developing original research in this area. To provide a foundation for that research, Sonalysts is investigating the development of a Synthetic Task Environment (STE). In a previous report, we documented the findings of a recent outreach effort in which we asked military Subject Matter Experts (SMEs) and other researchers in the Human-AI teaming domain to identify the qualities that they most valued in a testbed. A surprising finding from that outreach was that several respondents recommended that our team look into existing human-AI teaming testbeds, rather than creating something new. Based on that recommendation, we conducted a systematic investigation of the associated landscape. In this report, we describe the results of that investigation. Building on the survey results, we developed testbed evaluation criteria, identified potential testbeds, and conducted qualitative and quantitative evaluations of candidate testbeds. The evaluation process led to five candidate testbeds for the research team to consider. In the coming months, we will assess the viability of the various alternatives and begin to execute our program of research.
Improving the State of the Art for Training Human-AI Teams: Technical Report #5 -- Individual Differences and Team Qualities to Measure in a Human-AI Teaming Testbed
Integrating Virtual Reality and Large Language Models for Team-Based Non-Technical Skills Training and Evaluation in the Operating Room
Beth Israel Deaconess Medical Center Center（贝希斯尔德医疗中心中心）；Department of Surgery, Northwell Health（外科，北well健康）；College of Engineering, Florida Agricultural and Mechanical University and Florida State University（工程学院，佛罗里达农业与机械大学和佛罗里达州立大学）
Red Teaming LLMs as Socio-Technical Practice: From Exploration and Data Creation to Evaluation
Responsible Tech Research IBM Research Yorktown Heights New York USA（负责技术研究 IBM 研究 Yorktown Heights 新 York 美国）；IBM Research（IBM 研究）；The Pennsylvania State University（宾夕法尼亚州立大学）；University of Notre Dame（诺特达美大学）
Advancing Human-Machine Teaming: Concepts, Challenges, and Applications
Virginia Tech（弗吉尼亚理工大学）；C. G. Woodson High School（C. G. Woodson高中）；US DEVCOM Army Research Laboratory（美国国防高级研究计划局陆军实验室）；Korea Institute of Energy Technology (KENTECH)（韩国能源技术研究所）；The University of Queensland（昆士兰大学）
