This paper proposes a deep learning-based optimal battery management scheme for frequency regulation (FR) by integrating model predictive control (MPC), supervised learning (SL), reinforcement learning (RL), and high-fidelity battery models. By taking advantage of deep neural networks (DNNs), the derived DNN-approximated policy is computationally efficient in online implementation. The design procedure of the proposed scheme consists of two sequential processes: (1) the SL process, in which we first run a simulation with an MPC embedding a low-fidelity battery model to generate a training data set, and then, based on the generated data set, we optimize a DNN-approximated policy using SL algorithms; and (2) the RL process, in which we utilize RL algorithms to improve the performance of the DNN-approximated policy by balancing short-term economic incentives and long-term battery degradation. The SL process speeds up the subsequent RL process by providing a good initialization. By utilizing RL algorithms, one prominent property of the proposed scheme is that it can learn from the data generated by simulating the FR policy on the high-fidelity battery simulator to adjust the DNN-approximated policy, which is originally based on low-fidelity battery model. A case study using real-world data of FR signals and prices is performed. Simulation results show that, compared to conventional MPC schemes, the proposed deep learning-based scheme can effectively achieve higher economic benefits of FR participation while maintaining lower online computational cost.
Motivated by the need of assessing the optimal allocation of battery energy storage services across various markets and the corresponding impact on market operations, an optimization framework is proposed in this work to coordinate the operation of an independent utility-scale price-maker battery energy storage system (BESS) in the energy, spinning reserve and performance-based regulation markets. The entire problem is formulated as a bi-level optimization process, where the structure of all markets is modeled considering the joint operation limits. The strategic bidding behavior of a price-ma…
Battery energy storage systems (BESS) are proving to be an effective solution in providing frequency regulation services to the bulk grid. However, there are several concerns for the transmission/distribution system operators (TSO/DSO) with the frequent dispatching of the distribution-connected fast-responding storage systems. Unfortunately, the existing decoupled models for transmission and distribution (T&D) simulations are unable to capture the complex interactions between the two systems especially concerning frequency regulation problems due to rapidly varying distribution-connected distr…
Battery Asset Management problem determines the minimum cost replacement schedules for each individual asset in a group of battery assets that operate in parallel. Battery cycle life varies under different operating conditions including temperature, depth of discharge, charge rate, etc., and a battery deteriorates due to usage, which cannot be handled by current asset management models. This paper presents battery cycle life prognosis and its integration with parallel asset management to reduce lifecycle cost of the Battery Energy Storage System (BESS). A nonlinear capacity fade model is incor…
Battery management system plays an important role for modern battery-powered application such as Electric vehicles, portable electronic equipment and storage for renewable energy sources. It also increases the life-cycle of the battery, battery state and efficiency. Monitoring the state of charge of the battery is a crucial factor for battery management system. This paper deals with monitoring the state of charge of the battery along with temperature, current for Solar panel fitted with battery for residential application. Microcontroller is used for controlling purpose, analog sensors are use…
This paper proposes a bi-level optimization framework to investigate the optimal market operation strategies of price-maker battery energy storage systems (BESSs) in real-time energy, spinning reserve, and pay as performance regulation markets, with a special focus on understanding BESS's excessive regulation market participation observed by several system operators and the impact of battery degradation cost on BESS market activities. An accurate battery degradation cost function is integrated into the BESS's strategic bidding model. An automatic generation control (AGC) signal dispatch model …
This article proposes an offline Energy Management System (EMS) for Parallel Hybrid Electric Vehicles (PHEVs). Dividing the torque between the Electric Motor (EM) and the Internal Combustion Engine (ICE) requires a suitable EMS. Batteries are vital to HEVs and significantly impact overall vehicle cost and performance. High temperature and high battery State of Charge (SOC) are the main factors that accelerate battery aging. SOC is the most critical state variable in EMS and was usually considered the only dynamic variable in previous studies. For simplicity, the battery temperature was often a…
Battery swapping as a business model for battery energy storage (BES) has great potential in future integrated low-carbon energy and transportation systems. However, frequent battery swapping will inevitably accelerate battery degradation and shorten the battery life accordingly. To model the tradeoff of BES use between energy and transportation applications coupled by battery swapping, we develop a life-cycle decision model that coordinates battery charging and swapping. This model is derived based on an improved intertemporal decision framework, in which the optimal marginal degradation cost…
A novel smart metering technique capable of anomaly detection was proposed for real-time home power management system. Smart meter data generated in real-time was obtained from 900 households of single apartments. To detect outliers and missing values in smart meter data, a deep learning model, the autoencoder, consisting of a graph convolutional network and bidirectional long short-term memory network, was applied to the smart metering technique. Power management based on the smart metering technique was performed by multi-objective optimization in the presence of a battery storage system and…
A hybrid hydropower power plant is a conventional HydroPower Plant (HPP) augmented with a Battery Energy Storage System (BESS) to decrease the wear and tear of sensitive mechanical components and improve the reliability and regulation performance of the overall plant. A central task of controlling hybrid power plants is determining how the total power set-point should be split between the BESS and the hybridized unit (power set-point splitting) as a function of the operational objectives. This paper describes a Model Predictive Control (MPC) framework for hybrid medium- and high-head plants to…
This paper addresses optimal battery thermal management (BTM), charging, and eco-driving of a battery electric vehicle (BEV) with the goal of improving its grid-to-meter energy efficiency. Thus, an optimisation problem is formulated, aiming at finding the optimal trade-off between trip time and charging cost. The formulated problem is then transformed into a hybrid dynamical system, where the dynamics in driving and charging modes are modeled with different functions and with different state and control vectors. Moreover, to improve computational efficiency, we propose modelling the driving dy…
In this paper, we present the use of Model Predictive Control (MPC) based on Reinforcement Learning (RL) to find the optimal policy for a multi-agent battery storage system. A time-varying prediction of the power price and production-demand uncertainty are considered. We focus on optimizing an economic objective cost while avoiding very low or very high state of charge, which can damage the battery. We consider the bounded power provided by the main grid and the constraints on the power input and state of each agent. A parametrized MPC-scheme is used as a function approximator for the determin…
Hybrid fast-charging stations with battery storage and local renewable generation can facilitate low-carbon electric vehicle (EV) charging, while reducing the stress on the distribution grid. This paper proposes energy management strategies for a novel multi-battery design that directly connects its strings to other DC components through a busbar matrix without the need for interfacing power converters. Hence, the energy management system has two degrees of control: (i) allocating strings to other DC microgrid components, in this case a photovoltaic system, two EV fast chargers, and a grid-tie…
We optimize the operation of a fuel cell hybrid train using convex optimization. The main objective is to minimize hydrogen fuel consumption for a target journey time while considering battery thermal constraints. The state trajectories: train speed, energy management system, and battery temperature, are all optimized concurrently within a single optimization problem. A novel thermal model is proposed in order to include battery temperature yet maintain formulation convexity. Simulations show fuel savings and better thermal management when temperature is optimized concurrently with the other s…
The paper proposes an optimal management strategy for a system composed by a battery and a photovoltaic power plant. This integrated system is called to deliver the photovoltaic power and to simultaneously provide droop-based primary frequency regulation to the main grid. The battery state-of-energy is controlled by power offset signals, which are determined using photovoltaic energy generation forecasts and predictions of the energy required to operate frequency regulation. A two level control architecture is developed. A day-ahead planning algorithm schedules the energy profile which is trad…
A full-time scale energy management and battery size optimization for off-grid renewable power to hydrogen systems: A battery energy storage-based grid-forming case in Inner Mongolian
Packetized energy management (PEM) is a demand dispatch scheme that can be used to provide ancillary services such as frequency regulation. In PEM, distributed energy resources (DERs) are granted uninterruptible access to the grid for a pre-specified time interval called the packet length. This results in a down ramp-limited response in PEM for DERs that can only consume power from the grid. In this work, a linearized virtual battery model of PEM is provided that is capable of predicting the down-ramp limited output of PEM and is used in a model predictive control (MPC) framework to improve th…
Fuel cell electric vehicles have earned substantial attentions in recent decades due to their high-efficiency and zero-emission features, while the high operating costs remain the major barrier towards their large-scale commercialization. In such context, this paper aims to devise an energy management strategy for an urban postal-delivery fuel cell electric vehicle for operating cost mitigation. First, a data-driven dual-loop spatial-domain battery state-of-charge reference estimator is designed to guide battery energy depletion, which is trained by real-world driving data collected in postal …
Monitoring the state of health for Li-ion batteries is crucial in the battery management system (BMS), which helps end-users use batteries efficiently and safely. Battery state of health can be monitored by identifying parameters of battery models using various algorithms. Due to the low computation power of BMS and time-varying parameters, it is very important to develop an online algorithm with low computational cost. Among various methods, Equivalent circuit model (ECM) -based recursive least squares (RLS) parameter identification is well suited for such difficult BMS environments. However,…
Dynamically reconfigurable batteries merge battery management with output formation in ac and dc batteries, increasing the available charge, power, and life time. However, the combined ripple generated by the load and the internal reconfiguration can degrade the battery. This paper introduces that the frequency range of the ripple matters for degradation and loss. It presents a novel control method that reduces the low-frequency ripple of dynamically reconfigurable battery technology to reduce cell ageing and loss. It furthermore shifts the residual ripple to higher frequencies where the lower…
Whereas in typical standardized tests batteries are almost exclusively loaded with constant current or relatively slowly changing cycles, real applications involve rapid load ripple, which do not contribute to the net energy. The trend to reduced filter capacitors and even dynamically reconfigurable batteries further increases the ripple. The influence of rippled load on lithium batteries is therefore receiving increased attention. According to recent studies, accelerated ageing strongly depends on the frequency of the ripple. We use electrochemical models to derive a highly simplified regress…
A neural network-based energy management system (NN-EMS) has been proposed in this paper for islanded ac microgrids fed by multiple PV-battery based distributed generators (DG). The stochastic and unequal irradiation results in unequal PV output, which causes an unequal state-of-charge (SoC) among the batteries of the DGs. This effect may cause the difference in the SoCs to increase considerably over time, leading to some batteries reaching their SoC limits. These batteries would no longer be able to control the dc-link of the hybrid grid forming DG. The proposed NN-EMS ensures SoC balancing b…
Lithium-ion battery packs are usually composed of hundreds of cells arranged in series and parallel connections. The proper functioning of these complex devices requires suitable Battery Management Systems (BMSs). Advanced BMSs rely on mathematical models to assure safety and high performance. While many approaches have been proposed for the management of single cells, the control of multiple cells has been less investigated and usually relies on simplified models such as equivalent circuit models. This paper addresses the management of a battery pack in which each cell is explicitly modelled …
This paper studies optimal thermal management and charging of a battery electric vehicle driving over long distance trips. The focus is on the potential benefits of including a heat pump in the thermal management system for waste heat recovery, and charging point planning, in a way to achieve optimality in time, energy, or their trade-off. An optimal control problem is formulated, in which the objective function includes the energy delivered by the charger(s), and the total charging time including the actual charging time and the detour time to and from the charging stop. To reduce the computa…
A novel centralized model predictive control (MPC) is proposed for comfort and energy management in a residential building. The residential setup used here is equipped with a photovoltaic (PV) solar system and a stationary home battery unit. An air-to-air multi-split heat pump (HP) is used as the primary heating system. The electric baseboard (BB) unit in each zone is used as a secondary system. The MPC is simultaneously responsible for controlling the heating inputs of the HP and BB units for comfort management, as well as for the control of energy flow between the PV, the home battery and th…
