Hawkes processes are a popular framework to model the occurrence of sequential events, i.e., occurrence dynamics, in several fields such as social diffusion. In real-world scenarios, the inter-arrival time among events is irregular. However, existing neural network-based Hawkes process models not only i) fail to capture such complicated irregular dynamics, but also ii) resort to heuristics to calculate the log-likelihood of events since they are mostly based on neural networks designed for regular discrete inputs. To this end, we present the concept of Hawkes process based on controlled differential equations (HP-CDE), by adopting the neural controlled differential equation (neural CDE) technology which is an analogue to continuous RNNs. Since HP-CDE continuously reads data, i) irregular time-series datasets can be properly treated preserving their uneven temporal spaces, and ii) the log-likelihood can be exactly computed. Moreover, as both Hawkes processes and neural CDEs are first developed to model complicated human behavioral dynamics, neural CDE-based Hawkes processes are successful in modeling such occurrence dynamics. In our experiments with 4 real-world datasets, our method outperforms existing methods by non-trivial margins.
Bridging Dynamic Factor Models and Neural Controlled Differential Equations for Nowcasting GDP
Korea Financial Telecommunications and Clearings Institute(韩国金融电信与清算院);Yonsei University(延世大学);Korea Advanced Institute of Science and Technology(韩国科学技术院);Korea Institute for International Economic Policy(韩国国际经济政策研究院);Korea Institute of Public Finance(韩国公共财政研究院);Electronics and Telecommunications Research Institute(电子通信研究院)
Heidelberg Institute for Theoretical Studies(海德堡理论研究所);Mathematical Institute, University of Oxford(牛津大学数学研究所);City University of Hong Kong(香港城市大学);IAR, Karlsruhe Institute of Technology(卡尔斯鲁厄技术大学IAR研究所);Department of Psychiatry, Warneford Hospital(沃内福德医院精神病科)
Universal Time Series Generation with Neural Controlled Differential Equations
Heidelberg Institute for Theoretical Studies(海德堡理论研究所);IAR, Karlsruhe Institute of Technology(卡尔斯鲁厄技术大学IAR部门);Max Planck Institute for Polymer Research(马克斯·普朗克聚合物研究所);IWR, Heidelberg University(海德堡大学IWR部门);Dept. of Computer Science, University of Toronto(多伦多大学计算机科学系);Mathematical Institute, University of Oxford(牛津大学数学研究所);Vector Institute, Toronto, Canada(多伦多向量研究所)
Istituto Italiano di Tecnologia(意大利技术研究院);CNRS(法国国家科学研究中心);CentraleSupélec(中央高等电力学院);Université Paris-Saclay(巴黎-萨克雷大学);SDA Bocconi School of Management(SDA博科尼管理学院);Bocconi University(博科尼大学)
Dynamical Survival Analysis with Controlled Latent States
Inria Paris(法国国家信息与自动化研究所巴黎中心);Centre de Recherche des Cordeliers(科尔德里耶研究所);INSERM(法国国家健康与医学研究院);Université de Paris(巴黎大学);Sorbonne Université(索邦大学);Paris Saclay University(巴黎萨克雷大学);Univ. Paris Cité(巴黎西岱大学)
Acquisition-Independent Deep Learning for Quantitative MRI Parameter Estimation using Neural Controlled Differential Equations
Amsterdam University Medical Center(阿姆斯特丹大学医学中心);Cancer Center Amsterdam(阿姆斯特丹癌症中心);University of Queensland(昆士兰大学);UNSW Sydney(悉尼新南威尔士大学);University of Amsterdam(阿姆斯特丹大学);University of Fribourg(弗里堡大学);University of Bern(伯尔尼大学)