Sequence models have demonstrated remarkable success in behavioral planning by leveraging previously collected demonstrations. However, solving multi-task missions remains a significant challenge, particularly when the planner must adapt to unseen constraints and tasks, such as discovering goals and unlocking doors. Such behavioral planning problems are challenging to solve due to: a) agents failing to adapt beyond the single task learned through their reward function, and b) inability to generalize to new environments, e.g., those with walls and locked doors, when trained only in planar environments. Consequently, state-of-the-art decision-making methods are limited to missions where the required tasks are well-represented in the training demonstrations and can be solved within a short (temporal) planning horizon. To address this, we propose GenPlan: a stochastic and adaptive planner that leverages discrete-flow models for generative sequence modeling, enabling sample-efficient exploration and exploitation. This framework relies on an iterative denoising procedure to generate a sequence of goals and actions. This approach captures multi-modal action distributions and facilitates goal and task discovery, thereby generalizing to out-of-distribution tasks and environments, i.e., missions not part of the training data. We demonstrate the effectiveness of our method through multiple simulation environments. Notably, GenPlan outperforms state-of-the-art methods by over 10% on adaptive planning tasks, where the agent adapts to multi-task missions while leveraging demonstrations from single-goal-reaching tasks. Our code is available at https://github.com/CL2-UWaterloo/GenPlan.
Duke University(杜克大学);Atom Bioworks(Atom生物工坊);Mila – Québec AI Institute(魁北克AI研究院);Université de Montréal(蒙特利尔大学);The University of Oxford(牛津大学);Aithyra(Aithyra公司);University of Pennsylvania(宾夕法尼亚大学)
University of Alberta(阿尔伯塔大学);Charles University(查理大学);EquiLibre Technologies, Inc.(EquiLibre科技公司);Alberta Machine Intelligence Institute (Amii)(阿尔伯塔机器智能研究所)
Generative AI for Urban Planning: Synthesizing Satellite Imagery via Diffusion Models
Massachusetts Institute of Technology(麻省理工学院);University of Florida(佛罗里达大学);The Singapore-MIT Alliance for Research and Technology(新加坡-麻省理工学院研究与技术联盟);Boston University(波士顿大学)