arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.14698cs.RO
收藏

SwarmPaint:基于DNN手势接口的人-群交互轨迹生成和编队控制

SwarmPaint: Human-Swarm Interaction for Trajectory Generation and Formation Control by DNN-based Gesture Interface

Skolkovo Institute of Science and Technology(斯科尔科沃科学技术研究院)

Valerii Serpiva, Ekaterina Karmanova, Aleksey Fedoseev, Stepan Perminov, Dzmitry Tsetserukou

摘要:

具有多智能体系统的遥操作任务在支持人类群体协作团队的探索和救援行动中具有很大的潜力。然而,它需要一个直观的和自适应的控制方法,以确保在混乱和动态变化的环境中群体的稳定性。我们提出了一种新的人类群体交互系统,允许用户控制群体的位置和形成,无论是直接的手运动或轨迹绘制与手势界面的基础上DNN手势识别。SwarmPaint的关键技术是用户能够通过在交互模式之间切换来执行各种任务,而无需额外的设备。两种类型的相互作用,提出并开发调整群体行为:自由形式的轨迹生成控制和成形的编队控制。两个初步的用户研究进行了探索用户的性能和主观体验,从人类群体的互动,通过开发的控制模式。实验结果表明,足够的准确性在轨迹跟踪任务(平均误差为5.6厘米的手势绘制和3.1厘米的鼠标绘制与尺寸为1米乘1米的图案)超过三个评估的轨迹模式和高达7.3厘米的精度在目标任务与两个目标图案的1米实现的SwarmPaint接口。此外,参与者认为轨迹绘制界面比通过手势直接控制形状和位置更直观(12.9%),使用起来更省力(22.7%),尽管其物理工作量和性能失败被认为更重要(分别为9.1%和16.3%)。

英文摘要:

Teleoperation tasks with multi-agent systems have a high potential in supporting human-swarm collaborative teams in exploration and rescue operations. However, it requires an intuitive and adaptive control approach to ensure swarm stability in a cluttered and dynamically shifting environment. We propose a novel human-swarm interaction system, allowing the user to control swarm position and formation by either direct hand motion or by trajectory drawing with a hand gesture interface based on the DNN gesture recognition. The key technology of the SwarmPaint is the user's ability to perform various tasks with the swarm without additional devices by switching between interaction modes. Two types of interaction were proposed and developed to adjust a swarm behavior: free-form trajectory generation control and shaped formation control. Two preliminary user studies were conducted to explore user's performance and subjective experience from human-swarm interaction through the developed control modes. The experimental results revealed a sufficient accuracy in the trajectory tracing task (mean error of 5.6 cm by gesture draw and 3.1 cm by mouse draw with the pattern of dimension 1 m by 1 m) over three evaluated trajectory patterns and up to 7.3 cm accuracy in targeting task with two target patterns of 1 m achieved by SwarmPaint interface. Moreover, the participants evaluated the trajectory drawing interface as more intuitive (12.9 %) and requiring less effort to utilize (22.7%) than direct shape and position control by gestures, although its physical workload and failure in performance were presumed as more significant (by 9.1% and 16.3%, respectively).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑