Automated planning algorithms require an action model specifying the preconditions and effects of each action, but obtaining such a model is often hard. Learning action models from observations is feasible, but existing algorithms for numeric domains are offline, requiring expert traces as input. We propose the Reinforcement learning, Action Model learning, and Planning (RAMP) strategy for learning numeric planning action models online via interactions with the environment. RAMP simultaneously trains a Deep Reinforcement Learning (DRL) policy, learns a numeric action model from past interactions, and uses that model to plan future actions when possible. These components form a positive feedback loop: the RL policy gathers data to refine the action model, while the planner generates plans to continue training the RL policy. To facilitate this integration of RL and numeric planning, we developed Numeric PDDLGym, an automated framework for converting numeric planning problems to Gym environments. Experimental results on standard IPC numeric domains show that RAMP significantly outperforms PPO, a well-known DRL algorithm, in terms of solvability and plan quality.
Decoupling Numerical and Structural Parameters: An Empirical Study on Adaptive Genetic Algorithms via Deep Reinforcement Learning for the Large-Scale TSP
School of Mathematics(数学学院);Statistics(统计学);Xi'an Jiaotong University(西安交通大学);School of Mechanical Engineering(机械工程学院);Frontier Institute of Science(前沿科学研究院);Technology(技术);Xi'an, China(中国西安)
Structure-Enhanced DRL for Optimal Transmission Scheduling
School of Electrical and Information Engineering, The University of Sydney(悉尼大学电气与信息工程学院);School of Electrical Engineering and Robotics, Queensland University of Technology (QUT)(昆士兰科技大学电气与机器人工程学院);Nokia Bell Laboratories(诺基亚贝尔实验室)
Structure-Enhanced Deep Reinforcement Learning for Optimal Transmission Scheduling
The University of Sydney(悉尼大学);School of Electrical and Information Engineering, The University of Sydney(悉尼大学电气与信息工程学院);Queensland University of Technology(昆士兰科技大学);School of Electrical Engineering and Robotics, Queensland University of Technology(昆士兰科技大学电气工程与机器人学院)