UniJEPA：通过统一的连续和离散表示学习增强机器人策略
UniJEPA: Enhancing Robot Policy via Unified Continuous and Discrete Representation Learning
AI总结：
本文提出UniJEPA，通过大规模预训练学习高维视觉特征，结合理解、规划和连续未来表示学习，提升机器人在开放环境中的任务执行能力。
摘要：
本文提出UniJEPA，通过大规模预训练学习高维视觉特征，结合理解、规划和连续未来表示学习，提升机器人在开放环境中的任务执行能力。
英文摘要：
Building generalist robot policies that can handle diverse tasks in open-ended environments is a central challenge in robotics. To leverage knowledge from large-scale pretraining, prior work (VLA) has typically built generalist policies either on top of vision-language understanding models (VLMs) or generative models. However, both semantic understanding from vision-language pretraining and visual dynamics modeling from visual-generation pretraining are crucial for embodied robots. Recent unified models of generation and understanding have demonstrated strong capabilities in both comprehension and generation through large-scale pretraining. We posit that robotic policy learning can likewise benefit from the combined strengths of understanding, planning, and continuous future representation learning. Building on this insight, we introduce UniJEPA, which acquires the ability to dynamically model high-dimensional visual features through pretraining on over 1M internet-scale instructional manipulation videos. Subsequently, UniJEPA is fine-tuned on data collected from the robot embodiment, enabling the learning of mappings from predictive representations to action tokens. Extensive experiments show our approach consistently outperforms baseline methods in terms of 9\% and 12\% across simulation environments and real-world out-of-distribution tasks.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
