arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.30318cs.RO

Chronos: 一种基于物理信息的全历史框架用于非马尔可夫长时域操作

Chronos: A Physics-Informed Full-History Framework for Non-Markovian Long-Horizon Manipulation

School of Mechanical Science and Engineering, Huazhong University of Science and Technology(华中科技大学机械科学与工程学院)

Yulin Zhou, Yimeng Wang, Nengyu Wang, Shaojia Xing, Shiyun Tu, Xiang Li, Jingkai Zhang, Ningbo Jiang, Yuankai Lin, Hua Yang, Xiangrui Zeng, Zhouping Yin

AI总结:

针对现有策略依赖马尔可夫假设导致记忆依赖任务失败的问题,提出Chronos框架,将观测历史作为策略潜状态,通过选择性状态空间模型传播因果历史状态,并利用二阶薛定谔桥预测加速度场,在16个模拟和4个真实任务中显著超越基线。

摘要:

通用机器人策略应建模为动力系统,但许多VLA和生成式模仿策略仍依赖当前观测或短时间窗口。这种马尔可夫捷径在记忆依赖的操作中失败:相同观测在不同历史后可能要求不同动作。我们提出Chronos,一个基于物理信息的全历史框架,用于非马尔可夫长时域操作。关键思想是将观测历史从辅助上下文提升为策略动力学的潜状态。在每个物理控制步,Chronos通过融合观测和本体感觉形成一个状态代表令牌,使得令牌序列与物理时间一一对齐。选择性状态空间模型传播这个因果历史状态,通过隐式最大似然估计(IMLE)条件化一个多模态粗动作先验。该先验随后由二阶薛定谔启发桥细化,预测加速度场,产生更平滑且更物理的机器人运动。在16个模拟任务和4个真实世界实验中,Chronos在精密插入、一般操作和记忆依赖的长时域控制上进行了评估。在RMBench上,成功需要记住任务阶段,Chronos达到73.6%的平均成功率,超过马尔可夫VLA基线pi0.5 62.4个百分点,相对增益6.6倍,同时使用少10倍的参数。它还超过记忆VLA Mem-0 22.8个百分点,同时使用少30倍以上的参数。在使用单个RGB相机的真实世界双臂实验中,Chronos在四个任务上达到78%的平均成功率,包括三个记忆依赖任务上的72%,而pi0.5整体为7%,记忆依赖子集为0%。这些结果表明,历史不应被视为辅助上下文,而应作为操作策略的潜状态。

英文摘要:

General-purpose robot policies should be modeled as dynamical systems, yet many VLA and generative imitation policies still rely on present observations or short windows. This Markovian shortcut fails in memory-dependent manipulation: identical observations can demand different actions after different histories. We present Chronos, a physics-informed full-history framework for non-Markovian long-horizon manipulation. The key idea is to elevate observation history from auxiliary context to the latent state of the policy dynamics. At each physical control step, Chronos forms one state-representative token by fusing observation and proprioception, so the token sequence is aligned one-to-one with physical time. A selective state space model propagates this causal historical state, which conditions a multimodal coarse action prior through implicit maximum likelihood estimation (IMLE). This prior is then refined by a second-order Schrodinger-inspired bridge that predicts acceleration fields, yielding smoother and more physically grounded robot motion. Across 16 simulated tasks and 4 real-world experiments, Chronos is evaluated on precision insertion, general manipulation, and memory-dependent long-horizon control. On RMBench, where success requires remembering task phase, Chronos achieves 73.6% average success, outperforming Markovian VLA baseline pi0.5 by +62.4 percentage points, a 6.6x relative gain, while using 10x fewer parameters. It also surpasses the memory VLA Mem-0 by 22.8 points while using over 30x fewer parameters. In real-world dual-arm experiments using a single RGB camera, Chronos achieves 78% average success over four tasks, including 72% on the three memory-dependent tasks, whereas pi0.5 achieves 7% overall and 0% on the memory-dependent subset. These results suggest that history should not be treated as auxiliary context, but as the latent state of the manipulation policy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑