arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.01616cs.AI
收藏

CLIP-RL: 通过强化学习任务迁移对齐语言和策略表示

CLIP-RL: Aligning Language and Policy Representations for Task Transfer in Reinforcement Learning

Department of Data Science and Artificial Intelligence(数据科学与人工智能系);International Institute of Information Technology(国际信息技术研究所)

Chainesh Gautam, Raghuram Bharadwaj Diddigi

AI总结:

CLIP-RL通过对比学习对齐语言和策略表示,提升强化学习任务迁移效率。

摘要:

最近,开发能够在一个环境中解决多个任务的智能体需求日益增加,尤其是当这些任务与语言自然相关时。在本工作中,我们提出了一种新的方法,利用预训练的(语言,策略)对组合,建立高效的迁移管道。我们的算法受计算机视觉中对比语言-图像预训练(CLIP)原理的启发,该原理在不同模态下对齐表示,基于''表示相同概念的两种模态应有相似表示''的哲学。核心思想是任务的指令和对应的策略在两种不同的模态下代表同一个概念,即任务本身。因此,通过将CLIP的理念扩展到强化学习,我们的方法创建了一个统一的自然语言和策略嵌入表示空间。实验结果表明,我们的算法在跨任务迁移中具有实用性。

英文摘要:

Recently, there has been an increasing need to develop agents capable of solving multiple tasks within the same environment, especially when these tasks are naturally associated with language. In this work, we propose a novel approach that leverages combinations of pre-trained (language, policy) pairs to establish an efficient transfer pipeline. Our algorithm is inspired by the principles of Contrastive Language-Image Pretraining (CLIP) in Computer Vision, which aligns representations across different modalities under the philosophy that ''two modalities representing the same concept should have similar representations.'' The central idea here is that the instruction and corresponding policy of a task represent the same concept, the task itself, in two different modalities. Therefore, by extending the idea of CLIP to RL, our method creates a unified representation space for natural language and policy embeddings. Experimental results demonstrate the utility of our algorithm in achieving faster transfer across tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑