In medical and biological research, longitudinal data and survival data types are commonly seen. Traditional statistical models mostly consider to deal with either of the data types, such as linear mixed models for longitudinal data, and the Cox models for survival data, while they do not adjust the association between these two different data types. It is desirable to have a joint modeling approach which accomadates both data types and the dependency between them. In this paper, we extend traditional single-index models to a new joint modeling approach, by replacing the single-index component to a varying coefficient component to deal with longitudinal outcomes, and accomadate the random censoring problem in survival analysis by nonparametric synthetic data regression for the link function. Numerical experiments are conducted to evaluate the finite sample performance.
Tree methods (recursive partitioning) are a popular class of nonparametric methods for analyzing data. One extension of the basic tree methodology is the survival tree, which applies recursive partitioning to censored survival data. There are several existing survival tree methods in the literature, which are mainly designed for right-censored data. We propose two new survival trees for left-truncated and right-censored (LTRC) data, which can be seen as a generalization of the traditional survival tree for right-censored data. Further, we show that such trees can be used to analyze survival da…
We develop flexible multi-parameter regression survival models for interval censored survival data arising in longitudinal prospective studies and longitudinal randomised controlled clinical trials. A multi-parameter Weibull regression survival model, which is wholly parametric, and has non-proportional hazards, is the main focus of the paper. We describe the basic model, develop the interval-censored likelihood and extend the model to include gamma frailty and a dispersion model. We evaluate the models by means of a simulation study and a detailed re-analysis of data from the Signal Tandmobie…
We propose a novel approach for estimating mean survival time in the presence of censored data, in which we divide the population under study into survival-ordered fractions defined by a set of proportions, and compute the mean survival time for each fraction separately. Our approach provides a detailed picture of the distribution of the time variable while preserving the appealing interpretation of the mean. Our measure proves to be of great use in applications, particularly those where we are able to detect differences in mean survival across groups for certain fractions of the population th…
Methods for the evaluation of the predictive accuracy of biomarkers with respect to survival outcomes subject to right censoring have been discussed extensively in the literature. In cancer and other diseases, survival outcomes are commonly subject to interval censoring by design or due to the follow up schema. In this paper, we present an estimator for the area under the time-dependent receiver operating characteristic ROC curve for interval censored data based on a nonparametric sieve maximum likelihood approach. We establish the asymptotic properties of the proposed estimator, and illustrat…
Interval-censored data analysis is important in biomedical statistics for any type of time-to-event response where the time of response is not known exactly, but rather only known to occur between two assessment times. Many clinical trials and longitudinal studies generate interval-censored data; one common example occurs in medical studies that entail periodic follow-up. In this paper we propose a survival forest method for interval-censored data based on the conditional inference framework. We describe how this framework can be adapted to the situation of interval-censored data. We show that…
Doubly Robust Conformalized Survival Analysis with Right-Censored Data
Department of Data Sciences and Operations（数据科学与运营系）；Department of Computer Science, University of Southern California（计算机科学系，南加州大学）；Merck & Co., Inc.（默克公司）
This paper is devoted to robust estimation based on dual divergences estimators for parametric models in the framework of right censored data. We give limit laws of the proposed estimators and examine their asymptotic properties through a simulation study.
We describe a new approach to estimating relative risks in time-to-event prediction problems with censored data in a fully parametric manner. Our approach does not require making strong assumptions of constant proportional hazard of the underlying survival distribution, as required by the Cox-proportional hazard model. By jointly learning deep nonlinear representations of the input covariates, we demonstrate the benefits of our approach when used to estimate survival risks through extensive experimentation on multiple real world datasets with different levels of censoring. We further demonstra…
We propose the interval censored recursive forests (ICRF) which is an iterative tree ensemble method for interval censored survival data. This nonparametric regression estimator makes the best use of censored information by iteratively updating the survival estimate, and can be viewed as a self-consistent estimator with convergence monitored using out-of-bag samples. Splitting rules optimized for interval censored data are developed and kernel-smoothing is applied. The ICRF displays the highest prediction accuracy among competing nonparametric methods in most of the simulations and in an appli…
Survival analysis of right censored data arises often in many areas of research including medical research. Effect of covariates (and their interactions) on survival distribution can be studied through existing methods which requires to pre-specify the functional form of the covariates including their interactions. Survival trees offer relatively flexible approach when the form of covariates' effects is unknown. Most of the currently available survival tree construction techniques are not based on a formal test of significance; however, recently proposed ctree algorithm (Hothorn et al., 2006) …
Applications of machine learning in healthcare often require working with time-to-event prediction tasks including prognostication of an adverse event, re-hospitalization or death. Such outcomes are typically subject to censoring due to loss of follow up. Standard machine learning methods cannot be applied in a straightforward manner to datasets with censored outcomes. In this paper, we present auton-survival, an open-source repository of tools to streamline working with censored time-to-event or survival data. auton-survival includes tools for survival regression, adjustment in the presence o…
We introduce a novel procedure to perform Bayesian non-parametric inference with right-censored data, the \emph{beta-Stacy bootstrap}. This approximates the posterior law of summaries of the survival distribution (e.g. the mean survival time). More precisely, our procedure approximates the joint posterior law of functionals of the beta-Stacy process, a non-parametric process prior that generalizes the Dirichlet process and that is widely used in survival analysis. The beta-Stacy bootstrap generalizes and unifies other common Bayesian bootstraps for complete or censored data based on non-parame…
We propose a general index model for survival data, which generalizes many commonly used semiparametric survival models and belongs to the framework of dimension reduction. Using a combination of geometric approach in semiparametrics and martingale treatment in survival data analysis, we devise estimation procedures that are feasible and do not require covariate-independent censoring as assumed in many dimension reduction methods for censored survival data. We establish the root-$n$ consistency and asymptotic normality of the proposed estimators and derive the most efficient estimator in this …
Nonparametric and semiparametric methods are commonly used in survival analysis to mitigate the bias due to model misspecification. However, such methods often cannot estimate upper-tail survival quantiles when a sizable proportion of the data are censored, in which case parametric likelihood-based estimators present a viable alternative. In this article, we extend a popular family of parametric survival models which make the Accelerated Failure Time (AFT) assumption to account for heteroscedasticity in the survival times. The conditional variances can depend on arbitrary covariates, thus addi…
Density estimation is a classical problem in statistics and has received considerable attention when both the data has been fully observed and in the case of partially observed (censored) samples. In survival analysis or clinical trials, a typical problem encountered in the data collection stage is that the samples may be censored from the right. The variable of interest could be observed partially due to the presence of a set of events that occur at random and potentially censor the data. Consequently, developing a methodology that enables robust estimation of the lifetimes in such setting is…
A model for competing (resp. complementary) risks survival data where the failure time can be left (resp. right) censored is proposed. Product-limit estimators for the survival functions of the individual risks are derived. We deduce the strong convergence of our estimators on the whole real half-line without any additional assumptions and their asymptotic normality under conditions concerning only the observed distribution. When the observations are generated according to the double censoring model introduced by Turnbull, the product-limit estimators represent upper and lower bounds for Turnb…
Montreal Institute for Learning Algorithms（蒙特利尔学习算法研究所）；Université de Montréal（蒙特利尔大学）；Centre Hospitalier de l’Université de Montréal（蒙特利尔大学中心医院）；École Polytechnique de Montréal（蒙特利尔综合理工学院）
Survival analysis is a type of semi-supervised ranking task where the target output (the survival time) is often right-censored. Utilizing this information is a challenge because it is not obvious how to correctly incorporate these censored examples into a model. We study how three categories of loss functions, namely partial likelihood methods, rank methods, and our classification method based on a Wasserstein metric (WM) and the non-parametric Kaplan Meier estimate of the probability density to impute the labels of censored examples, can take advantage of this information. The proposed metho…
Individualized treatment rules can lead to better health outcomes when patients have heterogeneous responses to treatment. Very few individualized treatment rule estimation methods are compatible with a multi-treatment observational study with right censored survival outcomes. In this paper we extend policy evaluation methods to the right censored data setting. Existing approaches either make restrictive assumptions about the structure of the data, or use inverse weighting methods that increase the variance of the estimator resulting in decreased performance. We propose a method which uses bal…
There is a surge in medical follow-up studies that include longitudinal covariates in the modeling of survival data. So far, the focus has been largely on right-censored survival data. We consider survival data that are subject to both left truncation and right censoring. Left truncation is well known to produce biased sample. The sampling bias issue has been resolved in the literature for the case which involves baseline or time-varying covariates that are observable. The problem remains open, however, for the important case where longitudinal covariates are present in survival models. A join…
On a penalised likelihood approach for joint modelling of longitudinal covariates and partly interval-censored data -- an application to the Anti-PD1 brain collaboration trial
An optimal dynamic treatment regime (DTR) consists of a sequence of decision rules in maximizing long-term benefits, which is applicable for chronic diseases such as HIV infection or cancer. In this paper, we develop a novel angle-based approach to search the optimal DTR under a multicategory treatment framework for survival data. The proposed method targets maximization the conditional survival function of patients following a DTR. In contrast to most existing approaches which are designed to maximize the expected survival time under a binary treatment framework, the proposed method solves th…
Estimating individualized treatment rules is a central task for personalized medicine. [zhao2012estimating] and [zhang2012robust] proposed outcome weighted learning to estimate individualized treatment rules directly through maximizing the expected outcome without modeling the response directly. In this paper, we extend the outcome weighted learning to right censored survival data without requiring either an inverse probability of censoring weighting or a semiparametric modeling of the censoring and failure times as done in [zhao2015doubly]. To accomplish this, we take advantage of the tree ba…
The restricted mean survival time is a clinically easy-to-interpret measure that does not require any assumption of proportional hazards. We focus on two ways to directly model the survival time and adjust the covariates. One is to calculate the pseudo-survival time for each subject using leave-one-out, and then perform a model analysis using all pseudo-values to adjust for covariates. The pseudo-survival time is used to reflect information of censored subjects in the model analysis. The other method adjusts for covariates using subjects for whom the time-to-event was observed while adjusting …
In this paper, we consider survival analysis with right-censored data which is a common situation in predictive maintenance and health field. We propose a model based on the estimation of two-parameter Weibull distribution conditionally to the features. To achieve this result, we describe a neural network architecture and the associated loss functions that takes into account the right-censored data. We extend the approach to a finite mixture of two-parameter Weibull distributions. We first validate that our model is able to precisely estimate the right parameters of the conditional Weibull dis…
Learning Survival Models with Right-Censored Reporting Delays
The Graduate University for Advanced Studies（高级研究大学）；Tokio Marine Holdings, Inc.（东京海上日赤保险株式会社）；The Institute of Statistical Mathematics（统计数学研究所）；RIKEN（理化学研究所）
Self-Consistent Equation-guided Neural Networks for Censored Time-to-Event Data
Harvard Pilgrim Health Care Institute（哈佛朝圣者医疗保健研究所）；Harvard Medical School（哈佛医学院）；Harvard School of Public Health（哈佛公共卫生学院）；North Carolina State University（北卡罗来纳州立大学）
We propose a novel personalized concept for the optimal treatment selection for a situation where the response is a multivariate vector, that could contain right-censored variables such as survival time. The proposed method can be applied with any number of treatments and outcome variables, under a broad set of models. Following a working semiparametric Single Index Model that relates covariates and responses, we first define a patient-specific composite score, constructed from individual covariates. We then estimate conditional means of each response, given the patient score, correspond to ea…
Maximum approximate Bernstein likelihood estimates of the baseline density function and the regression coefficients in the proportional hazard regression models based on interval-censored event time data are proposed. This results in not only a smooth estimate of the survival function which enjoys faster convergence rate but also improved estimates of the regression coefficients. Simulation shows that the finite sample performance of the proposed method is better than the existing ones. The proposed method is illustrated by real data applications.
Spatial survival analysis has received a great deal of attention over the last 20 years due to the important role that geographical information can play in predicting survival. This paper provides an introduction to a set of programs for implementing some Bayesian spatial survival models in R using the package spBayesSurv. The function survregbayes includes the three most commonly-used semiparametric models: proportional hazards, proportional odds, and accelerated failure time. All manner of censored survival times are simultaneously accommodated including uncensored, interval censored, curren…
Texas A&M University（德克萨斯农工大学）；Department of Industrial and Systems Engineering（工业与系统工程系）；Heart, Artery, and Vein Center of Fresno（弗雷斯诺心脏、动脉和静脉中心）
Accuracies of survival models for life expectancy prediction as well as critical-care applications are significantly compromised due to the sparsity of samples and extreme imbalance between the survival (usually, the majority) and mortality class sizes. While a recent random survival forest (RSF) model overcomes the limitations of the proportional hazard assumption, an imbalance in the data results in an underestimation (overestimation) of the hazard of the mortality (survival) classes. A balanced random survival forests (BRSF) model, based on training the RSF model with data generated from a …
Hepatitis C virus (HCV) coinfection has become one of the most challenging clinical situations to manage in HIV-infected patients. Recently the effect of HCV coinfection on HIV dynamics following initiation of highly active antiretroviral therapy (HAART) has drawn considerable attention. Post-HAART HIV dynamics are commonly studied in short-term clinical trials with frequent data collection design. For example, the elimination process of plasma virus during treatment is closely monitored with daily assessments in viral dynamics studies of AIDS clinical trials. In this article instead we use in…
We analyse an issue when comparing survival curves between two subgroups. We show that there is a direct relationship between estimates of subgroups' survival at a time point and positive and negative predictive values in the binary classification settings. Our findings present a case where current methods of comparing survival curves between subgroups may be misleading. We think that this ought to be taken into account during the validation of prognostic diagnostic tests that predict two prognostic subgroups for a given disease or treatment, when the validation data set consists of censored d…
A bivariate cure copula model with zero-inflated gamma frailty for right-censored data
Graduate Institute for Advanced Studies, SOKENDAI（SOKENDAI 高级研究研究生院）；Institute of Statistical Mathematics（统计数学研究所）；School of Informatics and Data Science, Hiroshima University（广岛大学信息科学与数据科学学院）
We are interested in survival analysis of hemodialysis patients for whom several biomarkers are recorded over time. Motivated by this challenging problem, we propose a general framework for multivariate joint longitudinal-survival modeling that can be used to examine the association between several longitudinally recorded covariates and a time-to-event endpoint. Our method allows for simultaneous modeling of longitudinal covariates by taking their correlation into account. This leads to a more efficient method for modeling their trajectories over time, and hence, it can better capture their re…
Feature screening is an important method to reduce the dimension and capture informative variables in ultrahigh-dimensional data analysis. Many methods have been developed for feature screening. These methods, however, are challenged by complex features pertinent to the data collection as well as the nature of the data themselves. Typically, incomplete response caused by right-censoring and covariates measurement error are often accompanying with survival analysis. Even though there are many methods have been proposed for censored data, little work has been available when both incomplete respo…
We propose a flexible joint longitudinal-survival framework to examine the association between longitudinally collected biomarkers and a time-to-event endpoint. More specifically, we use our method for analyzing the survival outcome of end-stage renal disease patients with time-varying serum albumin measurements. Our proposed method is robust to common parametric assumptions in that it avoids explicit distributional assumptions on longitudinal measures and allows for subject-specific baseline hazard in the survival component. Fully joint estimation is performed to account for the uncertainty i…
