• Title/Summary/Keyword: time censored data

Search Result 95, Processing Time 0.033 seconds

Review of statistical methods for survival analysis using genomic data

  • Lee, Seungyeoun;Lim, Heeju
    • Genomics & Informatics
    • /
    • v.17 no.4
    • /
    • pp.41.1-41.12
    • /
    • 2019
  • Survival analysis mainly deals with the time to event, including death, onset of disease, and bankruptcy. The common characteristic of survival analysis is that it contains "censored" data, in which the time to event cannot be completely observed, but instead represents the lower bound of the time to event. Only the occurrence of either time to event or censoring time is observed. Many traditional statistical methods have been effectively used for analyzing survival data with censored observations. However, with the development of high-throughput technologies for producing "omics" data, more advanced statistical methods, such as regularization, should be required to construct the predictive survival model with high-dimensional genomic data. Furthermore, machine learning approaches have been adapted for survival analysis, to fit nonlinear and complex interaction effects between predictors, and achieve more accurate prediction of individual survival probability. Presently, since most clinicians and medical researchers can easily assess statistical programs for analyzing survival data, a review article is helpful for understanding statistical methods used in survival analysis. We review traditional survival methods and regularization methods, with various penalty functions, for the analysis of high-dimensional genomics, and describe machine learning techniques that have been adapted to survival analysis.

Metropolis-Hastings Expectation Maximization Algorithm for Incomplete Data (불완전 자료에 대한 Metropolis-Hastings Expectation Maximization 알고리즘 연구)

  • Cheon, Soo-Young;Lee, Hee-Chan
    • The Korean Journal of Applied Statistics
    • /
    • v.25 no.1
    • /
    • pp.183-196
    • /
    • 2012
  • The inference for incomplete data such as missing data, truncated distribution and censored data is a phenomenon that occurs frequently in statistics. To solve this problem, Expectation Maximization(EM), Monte Carlo Expectation Maximization(MCEM) and Stochastic Expectation Maximization(SEM) algorithm have been used for a long time; however, they generally assume known distributions. In this paper, we propose the Metropolis-Hastings Expectation Maximization(MHEM) algorithm for unknown distributions. The performance of our proposed algorithm has been investigated on simulated and real dataset, KOSPI 200.

Comparing Survival Functions with Doubly Interval-Censored Data: An Application to Diabetes Surveyed by Korean Cancer Prevention Study (이중구간중도절단된 생존자료의 생존함수 비교를 위한 검정: 한국인 암 예방연구 중 당뇨병에의 응용)

  • Jee, Sun-Ha;Nam, Chung-Mo;Kim, Jin-Heum
    • The Korean Journal of Applied Statistics
    • /
    • v.22 no.3
    • /
    • pp.595-606
    • /
    • 2009
  • Two tests were introduced for comparing several survival functions with doubly interval-censored data and illustrated with data surveyed by Korean Cancer Prevention Study (Jee et al., 2005). The test which extended Kim et al. (2006)'s test to the doubly interval-censored data has an advantage over Sun (2006)'s test in terms of saving computation time because the proposed test only depends on the size of risk set, and also the proposed test is applicable to continuous failure time data as well as discrete failure time data unlike Sun's test. Comparing male with female groups on the incubation time of diabetes was highly different and the survival of female group was longer than that of male one. Regardless of gender, the difference in survival functions of four age groups was highly significant with p-value of less than 0.001. This trend was more remarkable for female group than for male one. Simulation results showed that the significance level of both tests was well controlled and the proposed test was better than Sun's test in terms of power.

Pooling shrinkage estimator of reliability for exponential failure model using the sampling plan (n, C, T)

  • Al-Hemyari, Z.A.;Jehel, A.K.
    • International Journal of Reliability and Applications
    • /
    • v.12 no.1
    • /
    • pp.61-77
    • /
    • 2011
  • One of the most important problems in the estimation of the parameter of the failure model, is the cost of experimental sampling units, which can be reduced by using any prior information available about ${\theta}$, and devising a two-stage pooling shrunken estimation procedure. We have proposed an estimator of the reliability function (R(t)) of the exponential model using two-stage time censored data when a prior value about the unknown parameter (${\theta}$) is available from the past. To compare the performance of the proposed estimator with the classical estimator, computer intensive calculations for bias, mean squared error, relative efficiency, expected sample size and percentage of the overall sample size saved expressions, were done for varying the constants involved in the proposed estimator (${\tilde{R}}$(t)).

  • PDF

CUSUM charts for monitoring type I right-censored lognormal lifetime data (제1형 우측중도절단된 로그정규 수명 자료를 모니터링하는 누적합 관리도)

  • Choi, Minjae;Lee, Jaeheon
    • The Korean Journal of Applied Statistics
    • /
    • v.34 no.5
    • /
    • pp.735-744
    • /
    • 2021
  • Maintaining the lifetime of a product is one of the objectives of quality control. In real processes, most samples are constructed with censored data because, in many situations, we cannot measure the lifetime of all samples due to time or cost problems. In this paper, we propose two cumulative sum (CUSUM) control charting procedures to monitor the mean of type I right-censored lognormal lifetime data. One of them is based on the likelihood ratio, and the other is based on the binomial distribution. Through simulations, we evaluate the performance of the two proposed procedures by comparing the average run length (ARL). The overall performance of the likelihood ratio CUSUM chart is better, especially this chart performs better when the censoring rate is low and the shape parameter value is small. Conversely, the binomial CUSUM chart is shown to perform better when the censoring rate is high, the shape parameter value is large, and the change in the mean is small.

Comparisons of Empirical Bayes Approaches to Censored Accelerated Lifetime Data (가속수명자료에 대향 경험적 베이즈 비료연구)

  • Cho, Geon-Ho;Lee, Woo-Dong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.8 no.2
    • /
    • pp.183-194
    • /
    • 1997
  • In accelerated life tests, the failure time of an item is observed under a high stress level and based on the time, the failure rates of items we estimated at the normal stress level. In this paper, when the mean of the prior distribution of a parameter is known in Weibull lifetime model with censored failure time data, we study various estimating methods to obtain the empirical Bayes estimator of a parameter from the empirical Bayes approach under the normal stress level by considering the fact that the Bayes estimator is the function of prior parameters and of the acceleration parameter representing the effect of acceleration. And we compare the performance of several empirical Bayes estimators of a parameter in terms of the Bayes risk.

  • PDF

The Bivariate Kumaraswamy Weibull regression model: a complete classical and Bayesian analysis

  • Fachini-Gomes, Juliana B.;Ortega, Edwin M.M.;Cordeiro, Gauss M.;Suzuki, Adriano K.
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.5
    • /
    • pp.523-544
    • /
    • 2018
  • Bivariate distributions play a fundamental role in survival and reliability studies. We consider a regression model for bivariate survival times under right-censored based on the bivariate Kumaraswamy Weibull (Cordeiro et al., Journal of the Franklin Institute, 347, 1399-1429, 2010) distribution to model the dependence of bivariate survival data. We describe some structural properties of the marginal distributions. The method of maximum likelihood and a Bayesian procedure are adopted to estimate the model parameters. We use diagnostic measures based on the local influence and Bayesian case influence diagnostics to detect influential observations in the new model. We also show that the estimates in the bivariate Kumaraswamy Weibull regression model are robust to deal with the presence of outliers in the data. In addition, we use some measures of goodness-of-fit to evaluate the bivariate Kumaraswamy Weibull regression model. The methodology is illustrated by means of a real lifetime data set for kidney patients.

Conditional Bootstrap Methods for Censored Survival Data

  • Kim, Ji-Hyun
    • Journal of the Korean Statistical Society
    • /
    • v.24 no.1
    • /
    • pp.197-218
    • /
    • 1995
  • We first consider the random censorship model of survival analysis. Efron (1981) introduced two equivalent bootstrap methods for censored data. We propose a new bootstrap scheme, called Method 3, that acts conditionally on the censoring pattern when making inference about aspects of the unknown life-time distribution F. This article contains (a) a motivation for this refined bootstrap scheme ; (b) a proof that the bootstrapped Kaplan-Meier estimatro fo F formed by Method 3 has the same limiting distribution as the one by Efron's approach ; (c) description of and report on simulation studies assessing the small-sample performance of the Method 3 ; (d) an illustration on some Danish data. We also consider the model in which the survival times are censered by death times due to other caused and also by known fixed constants, and propose an appropriate bootstrap method for that model. This bootstrap method is a readily modified version of the Method 3.

  • PDF

Partially Parametric Estimation of Lifetime Distribution from a Record of Failures and Follow-Ups

  • Yoon, Byoung Chang
    • Journal of Korean Society for Quality Management
    • /
    • v.22 no.4
    • /
    • pp.59-78
    • /
    • 1994
  • In some observational studies, we have often random censoring model. However, the data available may be partially observable censored data consisting of the observed failure times and only those nonfailure times which are subject to follow up. In this paper, we present an extension of the problem of partially parametric estimation of the survival function to such partially observable censored data. The proposed estimator treats the observed failure times nonparametrically and uses a parametric model only for those nonfailure times which are subject to follow-up. We discuss the motivation and construction of the proposed estimator and investigate the limiting properties of the proposed estimator such as asymptotic normality. Also, when the assumed parametric model is exponential, the asymptotic variance of the estimator is obtained. Furthermore, an example is given to compare the proposed estimator with the modified Kaplan Meier(MKM) estimator. From the results, it is shown that the relative efficiency of the proposed estimator is higher than that of the MKM estimator in the follow-up study with increasing time.

  • PDF

Estimation for Block and Basu Model under System Level Life Testing

  • Hwang, In-Sob;Cho, Jang-Sik;Cho, Kil-Ho
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.3
    • /
    • pp.637-644
    • /
    • 2007
  • We consider a life testing experiment in which several two component shared parallel system are put on test, and the test is terminated at a pre-designed experiment. The bivariate data obtained from such a system level life testing can be classified into three cases: (1) the case of failed two components with known failure times, (2) the case of one censored component and the other failed component of which the failure time might be known or unknown, (3) the case of censored two components. In this paper, the maximum likelihood estimators of parameters for Block and Basu bivariate exponential model under above censoring scheme are obtained and the results of comparative studies are presented.

  • PDF