具有行为潜变量的可控模拟智能体
Controllable Sim Agents with Behavior Latents
AI总结:
提出可控神经变分智能体(CNeVA),通过闭环共轭变分更新推断行为潜变量,结合修正流轨迹生成器,实现可解释轴上的可控模拟,在Waymo数据集上达到竞争性真实感并提供通道级可控性。
摘要:
真实的交通模拟需要能够模仿记录行为并沿可解释轴进行引导的智能体。这种可控性使工程师能够隔离变量、重现特定边缘情况,并在无真实世界风险的情况下测试自主系统。我们引入了可控神经变分智能体(CNeVA),这是一种可控的模拟智能体框架,通过闭环共轭变分更新从每通道折扣回报中学习推断每个智能体的高斯行为潜变量,并调节在混合通道掩码课程上训练的修正流轨迹生成器,以实现无分类器引导。为了解决奖励信号稀疏的问题,我们提出了软资格门,用平滑指数衰减替代硬二进制阈值,保留了接近阈值智能体的梯度信号。在Waymo开放运动数据集上,CNeVA在基准测试中达到了竞争性的真实感,同时暴露了排名更高的模仿模型所缺乏的每通道可控性。基于速度和加速度的引导产生单调响应,而不会出现停滞引起的奖励黑客行为。引入软资格后,安全可控性具有单调性和实质性。我们成功地在上下文残差回报度量下实现了可引导的地图合规性。此外,我们的实验表明,引导指标必须与物理合理性护栏一起解读,以避免奖励黑客混淆。
英文摘要:
Realistic traffic simulation requires agents that imitate logged behavior and can also be steered along interpretable axes. Such controllability enables engineers to isolate variables, reproduce specific edge cases, and test autonomous systems without real-world risk. We introduce Controllable Neural Variational Agents (CNeVA), a controllable simulated-agent framework that learns to infer a per-agent Gaussian behavior latent from per-channel discounted returns via a closed-form conjugate variational update, conditioning a rectified-flow trajectory generator trained on a mixed channel-mask curriculum for classifier-free guidance. To tackle scarcity in reward signals, we propose soft eligibility gates that replace hard binary thresholds with smooth exponential decay, preserving the gradient signal for near-threshold agents. On the Waymo Open Motion Dataset, CNeVA attains competitive realism on the benchmark while exposing per-channel controllability that the higher-ranked imitation models lack. Speed- and acceleration-based steering produces monotone responses without stall-induced reward hacking. Safety controllability is monotone and substantial with the introduction of soft eligibility. We manage to achieve steerable map compliance under a context-residual return measure. Furthermore, our experiment demonstrates that steering metrics must be read alongside physical-plausibility guardrails to avoid reward-hacking confounds.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。