Interval-censored data analysis is important in biomedical statistics for any type of time-to-event response where the time of response is not known exactly, but rather only known to occur between two assessment times. Many clinical trials and longitudinal studies generate interval-censored data; one common example occurs in medical studies that entail periodic follow-up. In this paper we propose a survival forest method for interval-censored data based on the conditional inference framework. We describe how this framework can be adapted to the situation of interval-censored data. We show that the tuning parameters have a non-negligible effect on the survival forest performance and guidance is provided on how to tune the parameters in a data-dependent way to improve the overall performance of the method. Using Monte Carlo simulations we find that the proposed survival forest is at least as effective as a survival tree method when the underlying model has a tree structure, performs similarly to an interval-censored Cox proportional hazards model fit when the true relationship is linear, and outperforms the survival tree method and Cox model when the true relationship is nonlinear. We illustrate the application of the method on a tooth emergence data set.
We propose the interval censored recursive forests (ICRF) which is an iterative tree ensemble method for interval censored survival data. This nonparametric regression estimator makes the best use of censored information by iteratively updating the survival estimate, and can be viewed as a self-consistent estimator with convergence monitored using out-of-bag samples. Splitting rules optimized for interval censored data are developed and kernel-smoothing is applied. The ICRF displays the highest prediction accuracy among competing nonparametric methods in most of the simulations and in an appli…
Maximum approximate Bernstein likelihood estimates of the baseline density function and the regression coefficients in the proportional hazard regression models based on interval-censored event time data are proposed. This results in not only a smooth estimate of the survival function which enjoys faster convergence rate but also improved estimates of the regression coefficients. Simulation shows that the finite sample performance of the proposed method is better than the existing ones. The proposed method is illustrated by real data applications.
We develop flexible multi-parameter regression survival models for interval censored survival data arising in longitudinal prospective studies and longitudinal randomised controlled clinical trials. A multi-parameter Weibull regression survival model, which is wholly parametric, and has non-proportional hazards, is the main focus of the paper. We describe the basic model, develop the interval-censored likelihood and extend the model to include gamma frailty and a dispersion model. We evaluate the models by means of a simulation study and a detailed re-analysis of data from the Signal Tandmobie…
Discrimination performance in illness-death models with interval-censored disease data
Mathematical Institute, Leiden University(莱顿大学数学研究所);Department of Biomedical Data Sciences, Leiden University Medical Center(莱顿大学医学中心生物医学数据科学系);Trial and Data Center, Princess Máxima Center for Pediatric Oncology(公主玛克西玛儿童肿瘤中心试验与数据中心)
Continuous-time multi-state survival models can be used to describe health-related processes over time. In the presence of interval-censored times for transitions between the living states, the likelihood is constructed using transition probabilities. Models can be specified using parametric or semi-parametric shapes for the hazards. Semi-parametric hazards can be fitted using $P$-splines and penalised maximum likelihood estimation. This paper presents a method to estimate flexible multi-state models which allows for parametric and semi-parametric hazard specifications. The estimation is based…
Methods for the evaluation of the predictive accuracy of biomarkers with respect to survival outcomes subject to right censoring have been discussed extensively in the literature. In cancer and other diseases, survival outcomes are commonly subject to interval censoring by design or due to the follow up schema. In this paper, we present an estimator for the area under the time-dependent receiver operating characteristic ROC curve for interval censored data based on a nonparametric sieve maximum likelihood approach. We establish the asymptotic properties of the proposed estimator, and illustrat…
Interval censoring arises frequently in clinical, epidemiological, financial, and sociological studies, where the event or failure of interest is known only to occur within an interval induced by periodic monitoring. We formulate the effects of potentially time-dependent covariates on the interval-censored failure time through a broad class of semiparametric transformation models that encompasses proportional hazards and proportional odds models. We consider nonparametric maximum likelihood estimation for this class of models with an arbitrary number of monitoring times for each subject. We de…
A new method for the analysis of time to ankylosis complication on a dataset of replanted teeth is proposed. In this context of left-censored, interval-censored and right-censored data, a Cox model with piecewise constant baseline hazard is introduced. Estimation is carried out with the EM algorithm by treating the true event times as unobserved variables. This estimation procedure is shown to produce a block diagonal Hessian matrix of the baseline parameters. Taking advantage of this interesting feature of the estimation method a L0 penalised likelihood method is implemented in order to autom…
On a penalised likelihood approach for joint modelling of longitudinal covariates and partly interval-censored data -- an application to the Anti-PD1 brain collaboration trial
Single-index Semiparametric Transformation Cure Models with Interval-censored Data
School of Economics, Jinan University(暨南大学经济学院);International Center for Interdisciplinary Statistics, School of Mathematics, Harbin Institute of Technology(哈尔滨工业大学数学学院交叉统计国际中心)
In contrast to the popular Cox model which presents a multiplicative covariate effect specification on the time to event hazards, the semiparametric additive risks model (ARM) offers an attractive additive specification, allowing for direct assessment of the changes or the differences in the hazard function for changing value of the covariates. The ARM is a flexible model, allowing the estimation of both time-independent and time-varying covariates. It has a nonparametric component and a regression component identified by a finite-dimensional parameter. This chapter presents an efficient appro…
The proportional hazards (PH) model is arguably one of the most popular models used to analyze time to event data arising from clinical trials and longitudinal studies, among many others. In many such studies, the event time of interest is not directly observed but is known relative to periodic examination times; i.e., practitioners observe either current status or interval-censored data. The analysis of data of this structure is often fraught with many difficulties. Further exacerbating this issue, in some such studies the observed data also consists of instantaneous failures; i.e., the event…
Censored data, where the event time is partially observed, are challenging for survival probability estimation. In this paper, we introduce a novel nonparametric fiducial approach to interval-censored data, including right-censored, current status, case II censored, and mixed case censored data. The proposed approach leveraging a simple Gibbs sampler has a useful property of being "one size fits all", i.e., the proposed approach automatically adapts to all types of non-informative censoring mechanisms. As shown in the extensive simulations, the proposed fiducial confidence intervals significan…
We consider efficient estimation of flexible transformation models with interval-censored data. To reduce the dimension of semi-parametric models, the unknown monotone transformation function is approximated via monotone splines. A penalization technique is used to provide more computationally efficient estimation of all parameters. To accomplish model fitting, a computationally efficient nested iterative expectation-maximization (EM) based algorithm is developed for estimation, and an easily implemented variance-covariance approach is proposed for inference on regression parameters. Theoretic…
Data quality is an important consideration in many engineering applications and projects. Data collection procedures do not always involve careful utilization of the most precise instruments and strictest protocols. As a consequence, data are invariably affected by imprecision and sometimes sharply varying levels of quality of the data. Different mathematical representations of imprecision have been suggested, including a classical approach to censored data which is considered optimal when the proposed error model is correct, and a weaker approach called interval statistics based on partial id…
The approximate Bernstein polynomial model, a mixture of beta distributions, is applied to obtain maximum likelihood estimates of the regression coefficients, and the baseline density and survival functions in an accelerated failure time model based on interval censored data including current status data. The rate of convergence of the proposed estimates are given under some conditions for uncensored and interval censored data. Simulation shows that the proposed method is better than its competitors. The proposed method is illustrated by fitting the Breast Cosmetic Data using the accelerated f…
The analysis of progressively censored data has received considerable attention in the last few years. In this paper we consider the joint progressive censoring scheme for two populations. It is assumed that the lifetime distribution of the items from the two populations follow Weibull distribution with the same shape but different scale parameters. Based on the joint progressive censoring scheme first we consider the maximum likelihood estimators of the unknown parameters whenever they exist. We provide the Bayesian inferences of the unknown parameters under a fairly general priors on the sha…
The mixture cure rate model is the most commonly used cure rate model in the literature. In the context of mixture cure rate model, the standard approach to model the effect of covariates on the cured or uncured probability is to use a logistic function. This readily implies that the boundary classifying the cured and uncured subjects is linear. In this paper, we propose a new mixture cure rate model based on interval censored data that uses the support vector machine (SVM) to model the effect of covariates on the uncured or the cured probability (i.e., on the incidence part of the model). Our…
We introduce a kernel-based goodness-of-fit test for censored data, where observations may be missing in random time intervals: a common occurrence in clinical trials and industrial life-testing. The test statistic is straightforward to compute, as is the test threshold, and we establish consistency under the null. Unlike earlier approaches such as the Log-rank test, we make no assumptions as to how the data distribution might differ from the null, and our test has power against a very rich class of alternatives. In experiments, our test outperforms competing approaches for periodic and Weibul…
ICODEN: Ordinary Differential Equation Neural Networks for Interval-Censored Data
Department of Biostatistics and Health Data Science, University of Pittsburgh, PA, USA(匹兹堡大学生物统计与健康数据科学系);Center for Applied Statistics and School of Statistics, Renmin University of China, Beijing, China(中国人民大学应用统计中心与统计学院);Department of Applied Statistics, Konkuk University, Seoul, Republic of Korea(韩国康国民大学应用统计系)
Based on a data set obtained in a dental longitudinal study, conducted in Flanders (Belgium), the joint time to caries distribution of permanent first molars was modeled as a function of covariates. This involves an analysis of multivariate continuous doubly-interval-censored data since: (i) the emergence time of a tooth and the time it experiences caries were recorded yearly, and (ii) events on teeth of the same child are dependent. To model the joint distribution of the emergence times and the times to caries, we propose a dependent Bayesian semiparametric model. A major feature of the propo…
When the observations are not quantified and are known to be less than a threshold value, the concept of left censoring needs to be included in the analysis of such datasets. In many real multi component lifetime systems left censored data is very common. The usual assumption that components which are part of a system, work independently seems not appropriate in a number of applications. For instance it is more realistic to acknowledge that the working status of a component affects the remaining components. When you have left-censored data, it is more meaningful to use the reversed hazard rate…
Hepatitis C virus (HCV) coinfection has become one of the most challenging clinical situations to manage in HIV-infected patients. Recently the effect of HCV coinfection on HIV dynamics following initiation of highly active antiretroviral therapy (HAART) has drawn considerable attention. Post-HAART HIV dynamics are commonly studied in short-term clinical trials with frequent data collection design. For example, the elimination process of plasma virus during treatment is closely monitored with daily assessments in viral dynamics studies of AIDS clinical trials. In this article instead we use in…
We study computational aspects of the nonparametric maximum likelihood estimator (NPMLE) for the distribution function of bivariate interval censored data. The computation of the NPMLE consists of two steps: a parameter reduction step and an optimization step. In this paper we focus on the reduction step. We introduce two new reduction algorithms: the Tree algorithm and the HeightMap algorithm. The Tree algorithm is only mentioned briefly. The HeightMap algorithm is discussed in detail and also given in pseudo code. It is a very fast and simple algorithm of time complexity O(n^2). This is an o…
Censored broken adaptive ridge rank regression via induced smoothing
School of Mathematics, Statistics and Data Science, Sungshin Women’s University(成均馆大学数学、统计与数据科学学院);Sungshin Women’s University(诚信女子大学);Department of Biostatistics, Virginia Commonwealth University(弗吉尼亚联邦大学生物统计系);Virginia Commonwealth University(弗吉尼亚联邦大学);Center for Data Science, Sungshin Women’s University(诚信女子大学数据科学中心)
Interval-censored data, in which the event time is only known to lie in some time interval, arise commonly in practice; for example, in a medical study in which patients visit clinics or hospitals at pre-scheduled times, and the events of interest occur between visits. Such data are appropriately analyzed using methods that account for this uncertainty in event time measurement. In this paper we propose a survival tree method for interval-censored data based on the conditional inference framework. Using Monte Carlo simulations we find that the tree is effective in uncovering underlying tree st…
We investigate the performance of model based bootstrap methods for constructing point-wise confidence intervals around the survival function with interval censored data. We show that bootstrapping from the nonparametric maximum likelihood estimator of the survival function is inconsistent for both the current status and case 2 interval censoring models. A model based smoothed bootstrap procedure is proposed and shown to be consistent. In addition, simulation studies are conducted to illustrate the (in)-consistency of the bootstrap methods. Our conclusions in the interval censoring model would…
Censored data are seldom taken into account in Species Sensitivity Distribution (SSD) analysis. However, they are found in virtually every dataset and sometimes represent the better part of the data. Stringent recommendations on data quality often lead to discard a lot of this meaningful data, often resulting in datasets of reduced size, which lack representativeness of any realistic community. However, it is reasonably simple to include censored data into SSD by using an extension of the standard maximum likelihood method. In this paper, we detail this approach based on the use of the R-packa…
Multistate models can be used to describe transitions over time across states. In the presence of interval-censored times for transitions, the likelihood is constructed using transition probabilities. Models are specified using proportional hazards model for the transitions. Time-dependency is usually defined by parametric models, which can be too restrictive. Nonparametric hazards specification with splines allow for flexible modelling of time-dependency without making strong model assumptions. Penalised maximum likelihood is used to estimate the models. Selecting the optimal amount of smooth…
Recently all major weather prediction centres provide forecast ensembles of different weather quantities which are obtained from multiple runs of numerical weather prediction models with various initial conditions and model parametrizations. However, ensemble forecasts often show an underdispersive character and may also be biased, so that some post-processing is needed to account for these deficiencies. Probably the most popular modern post-processing techniques are the ensemble model output statistics (EMOS) and the Bayesian model averaging (BMA) which provide estimates of the density of the…