CREW:促进人机协同研究
CREW: Facilitating Human-AI Teaming Research
AI总结:
CREW是一个面向实时决策场景的人机协同研究平台,提供预置任务、多模态生理信号记录和人类引导强化学习基准测试,并通过50名受试者实验验证其有效性。
摘要:
随着人工智能(AI)技术的日益普及,人类与AI智能体协作的潜力正以极快的速度增长。人机协同是研究人类与AI智能体共同工作时各个层面的重要范式。人机协同研究的独特之处在于需要同时研究人类和AI智能体,这要求从机器学习到人机交互、机器人学、认知科学、神经科学、心理学、社会科学和复杂系统等多学科的研究投入。然而,现有的人机协同研究平台存在局限性,往往只支持过于简化的场景和单一任务,或者仅侧重于人类协同研究或多智能体AI算法中的某一方面。我们推出了CREW,这是一个在实时决策场景中促进人机协同研究并推动多科学学科协作的平台,特别强调人的参与。该平台包含用于认知研究和人机协同的预置任务,并凭借模块化设计具备可扩展潜力。遵循传统认知神经科学研究方法,CREW还支持多模态人体生理信号记录,用于行为分析。此外,CREW使用最先进的算法和经过良好调优的基线,对实时人类引导的强化学习智能体进行基准测试。借助CREW,我们能够在一周内完成50名受试者的人类研究,以验证我们基准测试的有效性。
英文摘要:
With the increasing deployment of artificial intelligence (AI) technologies, the potential of humans working with AI agents has been growing at a great speed. Human-AI teaming is an important paradigm for studying various aspects when humans and AI agents work together. The unique aspect of Human-AI teaming research is the need to jointly study humans and AI agents, demanding multidisciplinary research efforts from machine learning to human-computer interaction, robotics, cognitive science, neuroscience, psychology, social science, and complex systems. However, existing platforms for Human-AI teaming research are limited, often supporting oversimplified scenarios and a single task, or specifically focusing on either human-teaming research or multi-agent AI algorithms. We introduce CREW, a platform to facilitate Human-AI teaming research in real-time decision-making scenarios and engage collaborations from multiple scientific disciplines, with a strong emphasis on human involvement. It includes pre-built tasks for cognitive studies and Human-AI teaming with expandable potentials from our modular design. Following conventional cognitive neuroscience research, CREW also supports multimodal human physiological signal recording for behavior analysis. Moreover, CREW benchmarks real-time human-guided reinforcement learning agents using state-of-the-art algorithms and well-tuned baselines. With CREW, we were able to conduct 50 human subject studies within a week to verify the effectiveness of our benchmark.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。