In the context of the ongoing Covid-19 pandemic, several reports and studies have attempted to model and predict the spread of the disease. There is also intense debate about policies for limiting the damage, both to health and to the economy. On the one hand, the health and safety of the population is the principal consideration for most countries. On the other hand, we cannot ignore the potential for long-term economic damage caused by strict nation-wide lockdowns. In this working paper, we present a quantitative way to compute lockdown decisions for individual cities or regions, while balancing health and economic considerations. Furthermore, these policies are learnt automatically by the proposed algorithm, as a function of disease parameters (infectiousness, gestation period, duration of symptoms, probability of death) and population characteristics (density, movement propensity). We account for realistic considerations such as imperfect lockdowns, and show that the policy obtained using reinforcement learning is a viable quantitative approach towards lockdowns.
This work examines the use of reinforcement learning (RL) to optimize cyclic lockdowns, which is one of the methods available for control of the COVID-19 pandemic. The problem is structured as an optimal control system for tracking a reference value, corresponding to the maximum usage level of a critical resource, such as ICU beds. However, instead of using conventional optimal control methods, RL is used to find optimal control policies. A framework was developed to calculate optimal cyclic lockdown timings using an RL-based on-off controller. The RL-based controller is implemented as an RL a…
We formulate an optimal control problem to determine the lockdown policy to curb an epidemic where other control measures are not available yet. We present a unified framework to model the epidemic and economy that allows us to study the effect of lockdown on both of them together. The objective function considers cost of deaths and infections during the epidemic, as well as economic losses due to reduced interactions due to lockdown. We tune the parameters of our model for Covid-19 epidemic and the economies of Burundi, India, and the United States (the low, medium and high income countries).…
Vrije Universiteit Brussel（布鲁塞尔自由大学）；National University of Ireland Galway（爱尔兰国立大学戈尔韦分校）；University of Antwerp（安特卫普大学）；Hasselt University（哈瑟尔特大学）；HU University of Applied Sciences Utrecht（乌得勒支应用科学大学）
Infectious disease outbreaks can have a disruptive impact on public health and societal processes. As decision making in the context of epidemic mitigation is hard, reinforcement learning provides a methodology to automatically learn prevention strategies in combination with complex epidemic models. Current research focuses on optimizing policies w.r.t. a single objective, such as the pathogen's attack rate. However, as the mitigation of epidemics involves distinct, and possibly conflicting criteria (i.a., prevalence, mortality, morbidity, cost), a multi-objective approach is warranted to lear…
We consider an epidemic spreading in a city which is divided geographically into different districts. We introduce the reproduction matrix $\R=\bigl(R(i,j)\bigr)$ between districts, where $R(i,j)$ is the mean number of individuals in district $j$ infected by an individual from district $i$. We analyse policies of partial lockdowns of the city, that is of a set of districts, based on the study of matrix $\R$, where rows and columns corresponding to districts in lockdown are set to zero. This schema can also be applied to a country divided into regions or other appropriate units, provided the re…
Accurate modeling of lockdown effects on SARS-CoV-2 epidemic evolution is a key issue in order e.g. to inform health-care decisions on emergency management. The compartmental and spatial models so far proposed use parametric descriptions of the contact rate, often assuming a time-invariant effect of the lockdown. In this paper we show that these assumptions may lead to erroneous evaluations on the ongoing pandemic. Thus, we develop a new class of nonparametric compartmental models able to describe how the impact of the lockdown varies in time. Exploiting regularization theory, hospitalized dat…
In response to the COVID-19 pandemic, National governments have applied lockdown restrictions to reduce the infection rate. We perform a massive analysis on near real-time Italian data provided by Facebook to investigate how lockdown strategies affect economic conditions of individuals and local governments. We model the change in mobility as an exogenous shock similar to a natural disaster. We identify two ways through which mobility restrictions affect Italian citizens. First, we find that the impact of lockdown is stronger in municipalities with higher fiscal capacity. Second, we find a seg…
The pandemic caused by the novel Coronavirus SARS-CoV2 has been responsible for life threatening health complications, and extreme pressure on healthcare systems. While preventive and definite curative medical interventions are yet to arrive, Non-Pharmaceutical Interventions (NPIs) like physical isolation, quarantine and drastic social measures imposed by governing agencies are effective in arresting the spread of infections in a population. In densely populated countries like India, lockdown interventions are partially effective due to social and administrative complexities. Using detailed de…
Within the context of SEIR models, we consider a lockdown that is both imposed and lifted at an early stage of an epidemic. We show that, in these models, although such a lockdown may delay deaths, it eventually does not avert a significant number of fatalities. Therefore, in these models, the efficacy of a lockdown cannot be gauged by simply comparing figures for the deaths at the end of the lockdown with the projected figure for deaths by the same date without the lockdown. We provide a simple but robust heuristic argument to explain why this conclusion should generalize to more elaborate co…
We study variants of the SEIR model for interpreting some qualitative features of the statistics of the Covid-19 epidemic in France. Standard SEIR models distinguish essentially two regimes: either the disease is controlled and the number of infected people rapidly decreases, or the disease spreads and contaminates a significant fraction of the population until herd immunity is achieved. After lockdown, at first sight it seems that social distancing is not enough to control the outbreak. We discuss here a possible explanation, namely that the lockdown is creating social heterogeneity: even if …
The basic Susceptible-Infected-Recovered (SIR) model is extended to include effects of progressive social awareness, lockdowns and anthropogenic migration. It is found that social awareness can effectively contain the spread by lowering the basic reproduction rate $R_0$. Interestingly, the awareness is found to be more effective in a society which can adopt the awareness faster compared to the one having a slower response. The paper also separates the mortality fraction from the clinically recovered fraction and attempts to model the outcome of lockdowns, in absence and presence of social awar…
Background: Northern Italy was one of the most impacted areas by COVID. It is now widely assumed that the virus was silently spreading for at least 2 weeks before the first patient was identified. During this silent phase, and in the following weeks when the hospital system was overburdened, data collection was not performed in an accurate enough way to estimate an epidemic curve. With the aim of assessing both the dynamics of the introduction of the virus and the effectiveness of containment measures introduced, we try to reconstruct the epidemic curve using all cause mortality data. Methods:…
As a common strategy of contagious disease containment, lockdowns will inevitably weaken the economy. The ongoing COVID-19 pandemic underscores the trade-off arising from public health and economic cost. An optimal lockdown policy to resolve this trade-off is highly desired. Here we propose a mathematical framework of pandemic control through an optimal stabilizing non-uniform lockdown, where our goal is to reduce the economic activity as little as possible while decreasing the number of infected individuals at a prescribed rate. This framework allows us to efficiently compute the optimal stab…
National stay-at-home orders, or lockdowns, were imposed in several countries to drastically reduce the social interactions mainly responsible for the transmission of the SARS-CoV-2 virus. Despite being essential to slow down the COVID-19 pandemic, these containment measures are associated with an economic burden. In this work, we propose a network approach to model the implementation of a partial lockdown, breaking the society into disconnected components, or partitions. Our model is composed by two main ingredients: a multiplex network representing human contacts within different contexts, f…
We assess the epidemic situation caused by SARS-CoV-2 using Tsallis' proposal for determining the occurrence of the peak, and also the Susceptible-Infected-Recovered-Asymptomatic-Symptomatic and Dead (\textbf{SIRASD}) compartmental model. Using these two models, we determine a range of probable peak dates and study several social distancing scenarios during the epidemic. Due to the socioeconomic situation and the conflictive political climate, we take for our study the case of Bolivia, where a national election was originally scheduled to occur on September 6th and recently rescheduled on Octo…
During the COVID-19 pandemic, the slope of the epidemic curve in Mexico City has been quite unstable. We have predicted that in the case that a fraction of the population above a certain threshold returns to the public space, the negative tendency of the epidemic curve will revert. Such predictions were based on modeling the reactivation of economic activity after lockdown by means of an epidemiological model on a contact network of Mexico City derived from mobile device co-localization. We evaluated the epidemic dynamics considering the tally of active and recovered cases documented in the me…
In the wake of the COVID-19 pandemic many countries implemented containment measures to reduce disease transmission. Studies using digital data sources show that the mobility of individuals was effectively reduced in multiple countries. However, it remains unclear whether these reductions caused deeper structural changes in mobility networks, and how such changes may affect dynamic processes on the network. Here we use movement data of mobile phone users to show that mobility in Germany has not only been reduced considerably: Lockdown measures caused substantial and long-lasting structural cha…
The nation-wide lockdown starting 25 March 2020, aimed at suppressing the spread of the COVID-19 disease, was extended until 31 May 2020 in three subsequent orders by the Government of India. The extended lockdown has had significant social and economic consequences and `lockdown fatigue' has likely set in. Phased reopening began from 01 June 2020 onwards. Mumbai, one of the most crowded cities in the world, has witnessed both the largest number of cases and deaths among all the cities in India (41986 positive cases and 1368 deaths as of 02 June 2020). Many tough decisions are going to be made…
The ongoing COVID-19 pandemic is the first epidemic in human history in which digital contact-tracing has been deployed at a global scale. Tracking and quarantining all the contacts of individuals who test positive to a virus can help slowing-down an epidemic, but the impact of contact-tracing is severely limited by the generally low adoption of contact-tracing apps in the population. We derive here an analytical expression for the effectiveness of contact-tracing app installation strategies in a SIR model on a given contact graph. We propose a decentralised heuristic to improve the effectiven…
Initially emerged in the Chinese city Wuhan and subsequently spread almost worldwide causing a pandemic, the SARS-CoV-2 virus follows reasonably well the SIR (Susceptible-Infectious-Recovered) epidemic model on contact networks in the Chinese case. In this paper, we investigate the prediction accuracy of the SIR model on networks also for Italy. Specifically, the Italian regions are a metapopulation represented by network nodes and the network links are the interactions between those regions. Then, we modify the network-based SIR model in order to take into account the different lockdown measu…
Contagious diseases can spread quickly in human populations, either through airborne transmission or if some other spreading vectors are abundantly accessible. They can be particularly devastating if the impact on individuals' health has severe consequences on the number of hospitalizations or even deaths. Common countermeasures to contain the epidemic spread include introducing restrictions on human interactions or their mobility in general which are often associated with an economic and social cost. In this paper, we present a targeted model of optimal social distancing on metapopulation net…
In this work, we provide a general mathematical formalism to study the optimal control of an epidemic, such as the COVID-19 pandemic, via incentives to lockdown and testing. In particular, we model the interplay between the government and the population as a principal-agent problem with moral hazard, à la Cvitanić, Possamaï, and Touzi [27], while an epidemic is spreading according to dynamics given by compartmental stochastic SIS or SIR models, as proposed respectively by Gray, Greenhalgh, Hu, Mao, and Pan [45] and Tornatore, Buccellato, and Vetro [88]. More precisely, to limit the spread of a…
The recent COVID-19 pandemic highlighted the need of non-pharmaceutical interventions in the first stages of a pandemic. Among these, lockdown policies proved unavoidable yet extremely costly from an economic perspective. To better understand the tradeoffs between economic and epidemic costs of lockdown interventions, we here focus on a simple SIR epidemic model and study lockdowns as solutions to an optimal control problem. We first show numerically that the optimal lockdown policy exhibits a phase transition from suppression to mitigation as the time horizon grows, i.e., if the horizon is sh…
We introduce a theoretical framework that highlights the impact of physical distancing variables such as human mobility and physical proximity on the evolution of epidemics and, crucially, on the reproduction number. In particular, in response to the coronavirus disease (CoViD-19) pandemic, countries have introduced various levels of 'lockdown' to reduce the number of new infections. Specifically we use a collisional approach to an infection-age structured model described by a renewal equation for the time homogeneous evolution of epidemics. As a result, we show how various contributions of th…
The COVID-19 epidemic that emerged in Wuhan China at the end of 2019 hit Italy particularly hard, yielding the implementation of strict national lockdown rules (Phase 1). There is now a hot ongoing debate in Italy and abroad on what the best strategy is to restart a country to exit a national lockdown (Phase 2). Previous studies have focused on modelling possible restarting scenarios at the national level, overlooking the fact that Italy, as other nations around the world, is divided in administrative regions who can independently oversee their own share of the Italian National Health Service.…
We study and predict the evolution of Covid-19 in six US states from the period May 1 through August 31 using a discrete compartment-based model and prescribe active intervention policies, like lockdowns, on the basis of minimizing a loss function, within the broad framework of partially observed Markov decision processes. For each state, Covid-19 data for 40 days (starting from May 1 for two northern states and June 1 for four southern states) are analyzed to estimate the transition probabilities between compartments and other parameters associated with the evolution of the epidemic. These qu…
Instituto Federal do Norte de Minas Gerais (IFNMG)（北米纳斯吉拉斯联邦学院）；Federal University of Minas Gerais（米纳斯吉拉斯联邦大学）；Universidade Federal de Minas Gerais（米纳斯吉拉斯联邦大学）；Universidade Federal de Ouro Preto（奥罗普雷托联邦大学）
The COVID-19 pandemic due to the SARS-CoV-2 coronavirus has directly impacted the public health and economy worldwide. To overcome this problem, countries have adopted different policies and non-pharmaceutical interventions for controlling the spread of the virus. This paper proposes the COVID-ABS, a new SEIR (Susceptible-Exposed-Infected-Recovered) agent-based model that aims to simulate the pandemic dynamics using a society of agents emulating people, business and government. Seven different scenarios of social distancing interventions were analyzed, with varying epidemiological and economic…
The contact structure of a population plays an important role in transmission of infection. Many ``structured models'' capture aspects of the contact structure through an underlying network or a mixing matrix. An important observation in such models, is that once a fraction $1-1/\mathcal{R}_0$ has been infected, the residual susceptible population can no longer sustain an epidemic. A recent observation of some structured models is that this threshold can be crossed with a smaller fraction of infected individuals, because the disease acts like a targeted vaccine, preferentially immunizing highe…
We analyse 'stop-and-go' containment policies that produce infection cycles as periods of tight lockdowns are followed by periods of falling infection rates. The subsequent relaxation of containment measures allows cases to increase again until another lockdown is imposed and the cycle repeats. The policies followed by several European countries during the Covid-19 pandemic seem to fit this pattern. We show that 'stop-and-go' should lead to lower medical costs than keeping infections at the midpoint between the highs and lows produced by 'stop-and-go'. Increasing the upper and reducing the low…
By the end of July 2020, the COVID-19 pandemic had infected more than seventeen million people and had spread to almost all countries worldwide. In response, many countries all over the world have used different methods to reduce the infection rate, such as including case isolation, the closure of schools and universities, banning public events, and mostly forcing social distancing, including local and national lockdowns. We use a Monte-Carlo (MC) based algorithm to predict the virus infection rate for different population densities using the most recent epidemic data in our work. We test the …
A pandemic caused by a new coronavirus has spread worldwide, affecting Argentina. We implement an SEIR model to analyze the disease evolution in Buenos Aires and neighbouring cities. The model parameters are calibrated using the number of casualties officially reported. Since infinite solutions honour the data, we show different cases. In all of them the reproduction ratio $R_0$ decreases after early lockdown, but then raises, probably due to an increase in contagion in highly populated slums. Therefore it is mandatory to reverse this growing trend in $R_0$ by applying control strategies to av…
We consider here an extended SIR model, including several features of the recent COVID-19 outbreak: in particular the infected and recovered individuals can either be detected (+) or undetected (-) and we also integrate an intensive care unit (ICU) capacity. Our model enables a tractable quantitative analysis of the optimal policy for the control of the epidemic dynamics using both lockdown and detection intervention levers. With parametric specification based on literature on COVID-19, we investigate the sensitivities of various quantities on the optimal strategies, taking into account the su…
Understanding how to effectively control an epidemic spreading on a network is a problem of paramount importance for the scientific community. The ongoing COVID-19 pandemic has highlighted the need for policies that mitigate the spread, without relying on pharmaceutical interventions, that is, without the medical assurance of the recovery process. These policies typically entail lockdowns and mobility restrictions, having thus nonnegligible socio-economic consequences for the population. In this paper, we focus on the problem of finding the optimum policies that "flatten the epidemic curve" wh…
We introduce an epidemic spreading model on a network using concepts from percolation theory. The model is motivated by discussing the standard SIR model, with extensions to describe effects of lockdowns within a population. The underlying ideas and behavior of the lattice model, implemented using the same lockdown scheme as for the SIR scheme, are discussed in detail and illustrated with extensive simulations. A comparison between both models is presented for the case of COVID-19 data from the USA. Both fits to the empirical data are very good, but some differences emerge between the two appr…
The death toll for Covid-19 may be reduced by dividing the population into two classes, the vulnerable and the fit, with different lockdown regimes. Instead of one reproduction number there now are four parameters. These make it possible to quantify the effect of the social distancing measures. There is a simple stochastic model for epidemics in a two type population. Apart from the size of the population of the vulnerable and the fit, and the initial number of infected in the two classes, only the four reproduction parameters are needed to run the two type Reed-Frost model. The program is sim…
We introduce a mathematical description of the impact of sociality in the spread of infectious diseases by integrating an epidemiological dynamics with a kinetic modeling of population-based contacts. The kinetic description leads to study the evolution over time of Boltzmann-type equations describing the number densities of social contacts of susceptible, infected and recovered individuals, whose proportions are driven by a classical SIR-type compartmental model in epidemiology. Explicit calculations show that the spread of the disease is closely related to moments of the contact distribution…
The spread of COVID-19 has been thwarted in most countries through non-pharmaceutical interventions. In particular, the most effective measures in this direction have been the stay-at-home and closure strategies of businesses and schools. However, population-wide lockdowns are far from being optimal carrying heavy economic consequences. Therefore, there is nowadays a strong interest in designing more efficient restrictions. In this work, starting from a recent kinetic-type model which takes into account the heterogeneity described by the social contact of individuals, we analyze the effects of…
The Covid-19 pandemic is ongoing worldwide, and the damage it has caused is unprecedented. For prevention, South Korea has adopted a local quarantine strategy rather than a global lockdown. This approach not only minimizes economic damage, but it also efficiently prevents the spread of the disease. In this work, the spread of COVID-19 under local quarantine measures is modeled using the Susceptible-Exposed-Infected-Recovered model on complex networks. In this network approach, the links connected to isolated people are disconnected and then reinstated when they are released. This link dynamics…
Governments around the world have implemented preventive measures against the spread of the coronavirus disease (COVID-19). In this study, we consider a multivariate discrete-time Markov model to analyze the propagation of COVID-19 across 33 provincial regions in China. This approach enables us to evaluate the effect of mobility restriction policies on the spread of the disease. We use data on daily human mobility across regions and apply the Bayesian framework to estimate the proposed model. The results show that the spread of the disease in China was predominately driven by community transmi…
The 2019 Novel Corona virus infection (COVID 19) is an ongoing public health emergency of international focus. Significant gaps persist in our knowledge of COVID 19 epidemiology, transmission dynamics, investigation tools and management, despite (or possibly because of) the fact that the outbreak is an unprecedented global threat. On the positive side, enough is currently known about the epidemic process to permit the construction of mathematical predictive models. In our work, we adapt a traditional SEIR epidemic model to the specific dynamic compartments and epidemic parameters of COVID 19, …
The COVID-19, the disease caused by the novel coronavirus 2019 (SARS-CoV-2), has caused graving woes across the globe since first reported in the epicenter Wuhan, Hubei, China, December 2019. The spread of COVID-19 in China has been successfully curtailed by massive travel restrictions that put more than 900 million people housebound for more than two months since the lockdown of Wuhan on 23 January 2020 when other provinces in China followed suit. Here, we assess the impact of China's massive lockdowns and travel restrictions reflected by the changes in mobility patterns before and during the…
In this paper, we propose a Boltzmann-type kinetic model of the spreading of an infectious disease on a network. The latter describes the connections among countries, cities or districts depending on the spatial scale of interest. The disease transmission is represented in terms of the viral load of the individuals and is mediated by social contacts among them, taking into account their displacements across the nodes of the network. We formally derive the hydrodynamic equations for the density and the mean viral load of the individuals on the network and we analyse the large-time trends of the…
In this work, we address the connection between population density centers in urban areas, and the nature of human flows between such centers, in shaping the vulnerability to the onset of contagious diseases. A study of 163 cities, chosen from four different continents reveals a universal trend, whereby the risk induced by human mobility increases in those cities where mobility flows are predominantly between high population density centers. We apply our formalism to the spread of SARS-COV-2 in the United States, providing a plausible explanation for the observed heterogeneity in the spreading…
A recent work (DOI 10.1101/2020.05.06.20093310) indicated that temporarily splitting larger populations into smaller groups can efficiently mitigate the spread of SARS-CoV-2 virus. The fact that, soon afterwards, on May 15, 2020, the two million people Slovenia was the first European country proclaiming the end of COVID-19 epidemic within national borders may be relevant from this perspective. Motivated by this evolution, in this paper we investigate the time dynamics of coronavirus cases in Slovenia with emphasis on how efficient various containment measures act to diminish the number of COVI…
We propose a simple SIR model in order to investigate the impact of various confinement strategies on a most virulent epidemic. Our approach is motivated by the current COVID-19 pandemic. The main hypothesis is the existence of two populations of susceptible persons, one which obeys confinement and for which the infection rate does not exceed 1, and a population which, being non confined for various imperatives, can be substantially more infective. The model, initially formulated as a differential system, is discretised following a specific procedure, the discrete system serving as an integrat…
COVID-19 has shown a relatively low mortality rate in young healthy individuals, with the majority of this group being asymptomatic or having mild symptoms, while the severity of the disease among individuals with underlying health conditions has caused signiffcant mortality rates worldwide. Understanding these differences in mortality amongst different sectors of society and modelling this will enable the different levels of risk and vulnerabilities to be determined to enable strategies exit the lockdown. However, epidemiological models do not account for the variability encountered in the se…
Various measures have been taken in different countries to mitigate the Covid-19 epidemic. But, throughout the world, many citizens don't understand well how these measures are taken and even question the decisions taken by their government. Should the measures be more (or less) restrictive? Are they taken for a too long (or too short) period of time? To provide some quantitative elements of response to these questions, we consider the well-known SEIR model for the Covid-19 epidemic propagation and propose a pragmatic model of the government decision-making operation. Although simple and obvio…
The COVID-19 pandemic has challenged authorities at different levels of government administration around the globe. When faced with diseases of this severity, it is useful for the authorities to have prediction tools to estimate in advance the impact on the health system and the human, material, and economic resources that will be necessary. In this paper, we construct an extended Susceptible-Exposed-Infected-Recovered model that incorporates the social structure of Mar del Plata, the $4^\circ$ most inhabited city in Argentina and head of the Municipality of General Pueyrredón. Moreover, we co…
The non-population conserving SIR (SIR-NC) model to describe the spread of infections in a community is proposed and studied. Unlike the standard SIR model, SIR-NC does not assume population conservation. Although similar in form to the standard SIR, SIR-NC admits a closed form solution while allowing us to model mortality, and also provides different, and arguably a more realistic, interpretation of the model parameters. Numerical comparisons of this SIR-NC model with the standard, population conserving, SIR model are provided. Extensions to include imported infections, interacting communitie…
