基于强化学习的个性化步态训练阻抗地形
Shaping Individualized Impedance Landscapes for Gait Training via Reinforcement Learning
摘要:
按需辅助(AAN)控制旨在通过鼓励患者的积极参与来促进机器人辅助康复的治疗效果。大多数AAN控制器使用阻抗控制来在目标运动周围创建顺应力场,以确保跟踪精度,同时允许适度的运动学误差。然而,由于控制力场形状的参数通常是手动调整或基于关于受试者学习能力的简单假设在线调整的,因此传统AAN控制器的有效性可能受到限制。在这项工作中,我们提出了一种新的自适应AAN控制器,能够根据每个人的运动能力和任务要求,以相位相关的方式自主重塑力场。所提出的控制器包括一个修改的策略改进路径积分算法,一个无模型的,基于采样的强化学习方法,学习对象的特定阻抗景观实时,和一个分层的政策参数评估结构,嵌入AAN范式通过指定性能驱动的学习目标。建议的控制策略,以受试者的运动反应和它的能力,以促进短期的运动适应的适应性进行实验验证,通过跑步机训练课程与健全的受试者谁学会了改变步态模式的援助,一个动力踝足矫形器。
英文摘要:
Assist-as-needed (AAN) control aims at promoting therapeutic outcomes in robot-assisted rehabilitation by encouraging patients' active participation. Impedance control is used by most AAN controllers to create a compliant force field around a target motion to ensure tracking accuracy while allowing moderate kinematic errors. However, since the parameters governing the shape of the force field are often tuned manually or adapted online based on simplistic assumptions about subjects' learning abilities, the effectiveness of conventional AAN controllers may be limited. In this work, we propose a novel adaptive AAN controller that is capable of autonomously reshaping the force field in a phase-dependent manner according to each individual's motor abilities and task requirements. The proposed controller consists of a modified Policy Improvement with Path Integral algorithm, a model-free, sampling-based reinforcement learning method that learns a subject-specific impedance landscape in real-time, and a hierarchical policy parameter evaluation structure that embeds the AAN paradigm by specifying performance-driven learning goals. The adaptability of the proposed control strategy to subjects' motor responses and its ability to promote short-term motor adaptations are experimentally validated through treadmill training sessions with able-bodied subjects who learned altered gait patterns with the assistance of a powered ankle-foot orthosis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。