In this review, we present a simple guide for researchers to obtain pseudo-random samples with censored data. We focus our attention on the most common types of censored data, such as type I, type II, and random censoring. We discussed the necessary steps to sample pseudo-random values from long-term survival models where an additional cure fraction is informed. For illustrative purposes, these techniques are applied in the Weibull distribution. The algorithms and codes in R are presented, enabling the reproducibility of our study. Finally, we developed an R package that encapsulates these methodologies, providing researchers with practical tools for implementation.
We introduce a novel procedure to perform Bayesian non-parametric inference with right-censored data, the \emph{beta-Stacy bootstrap}. This approximates the posterior law of summaries of the survival distribution (e.g. the mean survival time). More precisely, our procedure approximates the joint posterior law of functionals of the beta-Stacy process, a non-parametric process prior that generalizes the Dirichlet process and that is widely used in survival analysis. The beta-Stacy bootstrap generalizes and unifies other common Bayesian bootstraps for complete or censored data based on non-parame…
Self-Consistent Equation-guided Neural Networks for Censored Time-to-Event Data
Harvard Pilgrim Health Care Institute（哈佛朝圣者医疗保健研究所）；Harvard Medical School（哈佛医学院）；Harvard School of Public Health（哈佛公共卫生学院）；North Carolina State University（北卡罗来纳州立大学）
Zhejiang University（浙江大学）；Tsinghua University（清华大学）；National University of Singapore（新加坡国立大学）；George Washington University（乔治华盛顿大学）；New York University（纽约大学）
Data quality is an important consideration in many engineering applications and projects. Data collection procedures do not always involve careful utilization of the most precise instruments and strictest protocols. As a consequence, data are invariably affected by imprecision and sometimes sharply varying levels of quality of the data. Different mathematical representations of imprecision have been suggested, including a classical approach to censored data which is considered optimal when the proposed error model is correct, and a weaker approach called interval statistics based on partial id…
The analysis of progressively censored data has received considerable attention in the last few years. In this paper we consider the joint progressive censoring scheme for two populations. It is assumed that the lifetime distribution of the items from the two populations follow Weibull distribution with the same shape but different scale parameters. Based on the joint progressive censoring scheme first we consider the maximum likelihood estimators of the unknown parameters whenever they exist. We provide the Bayesian inferences of the unknown parameters under a fairly general priors on the sha…
There is a surge in medical follow-up studies that include longitudinal covariates in the modeling of survival data. So far, the focus has been largely on right-censored survival data. We consider survival data that are subject to both left truncation and right censoring. Left truncation is well known to produce biased sample. The sampling bias issue has been resolved in the literature for the case which involves baseline or time-varying covariates that are observable. The problem remains open, however, for the important case where longitudinal covariates are present in survival models. A join…
In this paper we study bayesian analysis of Modified Weibull distribution under progressively censored competing risk model. This study is made for progressively censored data. We use deterministic scan Gibbs sampling combined with slice sampling to generate from the posterior distribution. Posterior distribution is formed by taking prior distribution as reference prior. A real life data analysis is shown for illustrative purpose.
Laplacian-P-splines for shared Gamma frailty models applied to clustered right-censored time-to-event data
Department of Neurodegeneration Diagnostics, University Hospital Bialystok, Poland（比亚韦斯托克医院神经退行性疾病诊断系）；Interuniversity Institute for Biostatistics and statistical Bioinformatics (I-BioStat), Data Science Institute, Hasselt University, Belgium（哈瑟尔特大学生物统计与统计生物信息学跨大学研究所（I-BioStat））；Global Health Institute, Family Medicine and Population Health, University of Antwerp, Belgium（安特卫普大学全球健康学院）
Texas A&M University（德克萨斯农工大学）；Department of Industrial and Systems Engineering（工业与系统工程系）；Heart, Artery, and Vein Center of Fresno（弗雷斯诺心脏、动脉和静脉中心）
Accuracies of survival models for life expectancy prediction as well as critical-care applications are significantly compromised due to the sparsity of samples and extreme imbalance between the survival (usually, the majority) and mortality class sizes. While a recent random survival forest (RSF) model overcomes the limitations of the proportional hazard assumption, an imbalance in the data results in an underestimation (overestimation) of the hazard of the mortality (survival) classes. A balanced random survival forests (BRSF) model, based on training the RSF model with data generated from a …
We suggest several goodness-of-fit methods which are appropriate with Type-II right censored data. Our strategy is to transform the original observations from a censored sample into an approximately i.i.d. sample of normal variates and then perform a standard goodness-of-fit test for normality on the transformed observations. A simulation study with several well known parametric distributions under testing reveals the sampling properties of the methods. We also provide theoretical analysis of the proposed method.
The problem of estimating censored linear regression models with autocorrelated errors arises in many environmental and social studies. The present work proposes a Bayesian approach to estimate censored regression models with AR(p) errors. The algorithm developed here considers the Gibbs sampler with data augmentation(GDA), in which, at each iteration, both the model parameters and the latent variables are sampled. The data augmentation is achieved from multiple sampling of the latent variables from the corresponding conditional distributions. A suitable variable transformation allows the full…
Survival analysis has been developed and applied in the number of areas including manufacturing, finance, economics and healthcare. In healthcare domain, usually clinical data are high-dimensional, sparse and complex and sometimes there exists few amount of time-to-event (labeled) instances. Therefore building an accurate survival model from electronic health records is challenging. With this motivation, we address this issue and provide a new survival analysis framework using deep learning and active learning with a novel sampling strategy. First, our approach provides better representation w…
Scalable and accurate identification of specific clinical outcomes has been enabled by machine-learning applied to electronic medical record (EMR) systems. The development of classification models requires the collection of a complete labeled data set, where true clinical outcomes are obtained by human expert manual review. For example, the development of natural language processing algorithms requires the abstraction of clinical text data to obtain outcome information necessary for training models. However, if the outcome is rare then simple random sampling results in very few cases and insuf…
Surrogate-Guided Adaptive Importance Sampling for Failure Probability Estimation
Aerospace Engineering and the Institute of Computational and Data Science (ICDS), Penn State（航空航天工程系与计算数据科学研究所，宾夕法尼亚州立大学）；Department of Statistics, Virginia Tech（统计系，弗吉尼亚理工大学）
