基于神经策略风格迁移的人类情感向机器人运动的迁移
Transferring human emotions to robot motions using Neural Policy Style Transfer
AI总结:
针对机器人领域缺乏预训练运动分类架构的问题,提出NPST3框架,结合TD3网络与自编码器实现人类运动风格向机器人运动的离线/在线迁移,在两类机器人平台上经147份问卷验证有效性。
摘要:
神经风格迁移(Neural Style Transfer, NST)最初被提出用于利用神经网络的特征提取能力实现图像风格迁移,研究人员选用预训练的图像分类架构进行特征提取,生成与原图内容一致但风格不同的新图像。在机器人领域,风格迁移可用于将人类运动风格迁移到机器人运动中,该领域的挑战在于缺乏可用于特征提取的预训练机器人运动分类架构。\n本文提出神经策略风格迁移TD3(Neural Policy Style Transfer TD3, NPST3)框架,用于将人类运动风格迁移到机器人运动中,该框架可让同一机器人运动以不同的人本主义运动风格执行,比如愤怒、开心、平静或悲伤的风格。框架引入双延迟深度确定性策略梯度(Twin Delayed Deep Deterministic Policy Gradient, TD3)网络生成控制策略,由自编码器网络负责风格迁移步骤的特征提取。风格迁移步骤可离线或在线执行:离线模式用于自主执行具备人类风格的机器人运动,在线模式用于在运行时调整(例如遥操作机器人的)运动风格。\n研究人员在两种不同的机器人平台上测试了该框架:一台为遥操作任务设计的机械臂,以及一台为社交互动设计的人形机器人。研究针对两个平台评估了所提方法,共开展147份问卷调查,要求人类受试者识别预设动作集中迁移到机器人运动上的人类运动风格。
英文摘要:
Neural Style Transfer (NST) was originally proposed to use feature extraction capabilities of Neural Networks as a way to perform Style Transfer with images. Pre-trained image classification architectures were selected for feature extraction, leading to new images showing the same content as the original but with a different style. In robotics, Style Transfer can be employed to transfer human motion styles to robot motions. The challenge lies in the lack of pre-trained classification architectures for robot motions that could be used for feature extraction. Neural Policy Style Transfer TD3 (NPST3) is proposed for the transfer of human motion styles to robot motions. This framework allows the same robot motion to be executed in different human-centered motion styles, such as in an angry, happy, calm, or sad fashion. The Twin Delayed Deep Deterministic Policy Gradient (TD3) network is introduced for the generation of control policies. An autoencoder network is in charge of feature extraction for the Style Transfer step. The Style Transfer step can be performed both offline and online: offline for the autonomous executions of human-style robot motions, and online for adapting at runtime the style of e.g., a teleoperated robot. The framework is tested using two different robotic platforms: a robotic manipulator designed for telemanipulation tasks, and a humanoid robot designed for social interaction. The proposed approach was evaluated for both platforms, performing a total of 147 questionnaires asking human subjects to recognize the human motion style transferred to the robot motion for a predefined set of actions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。