Simulation-based optimization (SO or SBO) has become increasingly important to address challenging transportation network design problems. In this paper, we propose to solve two toll pricing problems with different levels of complexity using the concept of the macroscopic or network fundamental diagram (MFD or NFD), where a large-scale simulation-based dynamic traffic assignment model of Melbourne, Australia is used. Four computationally efficient SBO methods are applied and compared, including the proportional-integral (PI) controller, regressing kriging (RK), DIviding RECTangles (DIRECT), and simultaneous perturbation stochastic approximation (SPSA). The comparison reveals that these methods work equally well on the simple problem without exhibiting significant performance differences. But, for the complex problem, RK manifests itself to be the best-performing method thanks to its capability of filtering out the numerical noise arising from computer simulations (i.e. allowing for non-smoothness of the objective function). While the PI controller is a more competitive solution to the simple problem given its faster rate of convergence, the poor scalability of the method in the complex problem results in limited applicability. Two caveats, however, deserve emphasis: (i) the chosen critical network density of the NFD does not necessarily represent a robust network control or optimization threshold, as it might shift in the presence of toll pricing; and (ii) re-interpolation is required as part of RK in order to achieve global convergence.
This article develops a deep reinforcement learning (Deep-RL) framework for dynamic pricing on managed lanes with multiple access locations and heterogeneity in travelers' value of time, origin, and destination. This framework relaxes assumptions in the literature by considering multiple origins and destinations, multiple access locations to the managed lane, en route diversion of travelers, partial observability of the sensor readings, and stochastic demand and observations. The problem is formulated as a partially observable Markov decision process (POMDP) and policy gradient methods are use…
Routing controllability of connected and autonomous vehicles (CAVs) has been shown to reduce the adverse effects of selfish routing on the network efficiency. However, the assumption that CAV owners would readily allow themselves to be controlled externally by a central agency for the good of the system is unrealistic. In this paper, we propose a joint routing and pricing control scheme that aims to incentivize CAVs to seek centrally controlled system-optimal (SO) routing by saving on tolls while user equilibrium (UE) seeking human-driven vehicles (HVs) are subject to a congestion charge. The …
Surrogate-based toll optimization in a large-scale heterogeneously congested network
School of Civil and Environmental Engineering, Research Center for Integrated Transport Innovation (rCITI), University of New South Wales（新南威尔士大学土木与环境工程学院，综合交通创新研究中心）
Mobility-on-Demand (MoD) systems have become a fixture in urban transportation networks, with the rapid growth of ride-hailing services such as Uber and Lyft. Ride-hailing is typically complemented with ridepooling options, which can reduce the negative externalities associated with ride-hailing services and increase the utilization of vehicles. Determining optimal policies for vehicle dispatching and pricing, two key components that enable MoD services, are challenging due to their massive scale and online nature. The challenge is amplified when the MoD platform offers exclusive (conventional…
the University of Tokyo（东京大学）；Tokyo Institute of Technology（东京工业大学）
Traffic congestion is a serious problem in urban areas. Dynamic congestion pricing is one of the useful schemes to eliminate traffic congestion in strategic scale. However, in the reality, an optimal dynamic congestion pricing is very difficult or impossible to determine theoretically, because road networks are usually large and complicated, and behavior of road users is uncertain. To account for this challenge, this work proposes a dynamic congestion pricing method using deep reinforcement learning (DRL). It is designed to eliminate traffic congestion based on observable data in general large…
