• The Korean Journal of Applied Statistics
• /
• v.35 no.1
• /
• pp.35-47
• /
• 2022

The receiver operating characteristic (ROC) curve was developed to quantify the classification ability of marker values (covariates) on the response variable and has been extended to survival data with diverse missing data structure. When survival data is understood as binary data (status of being alive or dead) at each time point, the ROC curve expressed at every time point results in time-dependent ROC curve and time-dependent area under curve (AUC). In particular, a follow-up study brings the change of cohort and incomplete data structures such as censoring and competing risk. In this paper, we review time-dependent ROC estimators under several contexts and perform simulation to check the performance of each estimators. We analyzed a dementia dataset to compare the prognostic power of markers.

• The Korean Journal of Applied Statistics
• /
• v.24 no.2
• /
• pp.269-278
• /
• 2011

There are many researches that have considered the distribution functions and appropriate covariates corresponding to the scores in order to improve the accuracy of a diagnostic test, including the ROC curve that is represented with the relations of the sensitivity and the specificity. The ROC analysis was used by the regression model including some covariates under the assumptions that its distribution function is known or estimable. In this work, we consider a general situation that both the distribution function and the elects of covariates are unknown. For the ROC analysis, the mixtures of normal distributions are used to estimate the distribution function fitted to the credit evaluation data that is consisted of the score random variable and two sub-populations of parameters. The AUC measure is explored to compare with the nonparametric and empirical ROC curve. We conclude that the method using normal mixtures is fitted to the classical one better than other methods.

• Progress in Medical Physics
• /
• v.28 no.3
• /
• pp.77-82
• /
• 2017

We proposed the objective ROC analysis method based on the setting of threshold value for evaluation of single photon emission computed tomography (SPECT) image. This proposed ROC analysis method uses the quantification computational threshold value to each signal on the SPECT image. The SPECT images for this study were acquired by using Monte Carlo n-particle extended simulation code (MCNPX, Ver. 2.6.0, Los Alamos National Laboratory, USA). The basic SPECT detectors and specific water phantom were realized in the simulation, and we could get the simulation results by the simulation operation. We tried to analyze the reconstructed images using threshold value application based objective ROC method. We can get the accuracy information of reconstructed region in the image. This proposed ROC technique can be helpful when we have to evaluate the weak signal for the NM image. In this study, the proposed threshold value based computational ROC analysis method can provide better objectivity than the conventional ROC analysis method.

• Journal of the Korea Society for Simulation
• /
• v.30 no.1
• /
• pp.87-101
• /
• 2021

Required Operational Capability(ROC), which means the performance of a weapon system, is determined when estimating the requirements of a new weapon system. It is very important to define the ROC as it has a decisive influence from acquisition of a weapon system to tactical operation. In this study, we propose a simulation methodology to verify the ROC of the Para-Observation Munition(POM), a newly developed weapon system. To this end, we propose a discrete-event simulation model that takes main performance of the weapon system constituting the ROC and environmental factors that affect performance of the weapon system as input values, and outputs operational effect as a result value. It describes various simulation logic required to implement a simulation model, and explains how to verify ROC using various simulation results such as sensitivity analysis. POM is a weapon system that does not have a similar one and that is difficult to directly utilize the military analysis model. This study can be used as a methodology to analyze the ROC and predict operational effects of weapon systems such as POM.

• The korean journal of orthodontics
• /
• v.25 no.2 s.49
• /
• pp.153-163
• /
• 1995

In this study, Receiver Operating Characteristic(ROC) analysis was used to evaluate the ability of cephalometric measurements to identify patients with Class III malocclusions. ROC analysis is the method for determining the validity of a diagnostic measure and for evaluating the relative value of diagnostic tests. The sample consisted of 496 patients with malocclusion. Class III malocclusion is defined as the dental relationship for which The mesiobuccal groove of the lower first molar is deviated mesially from the mesiobuccal cusp of the upper first molar. Of the total sample of 496 patients, 245 had Class III malocclusions. 16 cephalometric measurements were selected, each of which was treated as a diagnostic test. The ROC curves were generated for each cephalometric measurement with intervals of $1.0^{\circ}$ for angular measurements, 1.0mm for linear measurements. The area under the ROC curves was measured for direct comparison among different diagnostic tests. The results were as follows; 1. The 'Wits' appraisal was found to be a better diagnostic criterion for the presence of Class III malocclusion than any other commonly'used cephalometric measurement. 2. AB plane angle, ANB angle, App-Bpp distance, AF-BF distance, APDI, Distance of point A and Pog to N perpendicular, maxillomandibular differential had high diagnostic value. 3. Cephalometric measurements which evaluate the position of the mandible had moderate diagnostic value. 4. Cephalometric measurements related to the maxilla discriminated least between patients with and without Class III malocclusion.

• Korean Journal of Oriental Medicine
• /
• v.17 no.2
• /
• pp.107-113
• /
• 2011

Objectives : Sasang typology is extensively studied for the Sasang constitution diagnosis objectification with various data, for example, questionaires, reference materials, etc and analyzed with the several statistical methods. In this study, we used ROC-curve (Receiver Operating Characteristic curve) analysis to diagnose Sasang constitution, which is a kind of epidemiologic research methods and is away from traditional statistical methods. Methods : We collected personality questionnaire which consists of 15 items, from 24 oriental medical clinics. We analyzed the sensitivity and specificity using ROC curve method based on the score of personality questionnaire and also investigated classification accuracy and cut-off value of Sasang constitution. Results : The AUC (area under the ROC curve) value was 0.508 (p=.5511) for Taeeumin, 0.629 (p<.0001) for Soeumin and 0.604(p<.0001) for Soyangin, respectively. so the classification accuracy for Soeumin was highest Soeumin for over 30 points and Soyangin for below 28 points respectively. Conclusions : We suggest that Taeeumin is not classified easily in the ROC-curve analysis. We may classify Soeumin and Soyangin but the accuracy of Sasang constitutional diagnosis is still low.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.33 no.5
• /
• pp.1851-1860
• /
• 2013

The Standardized Precipitation Index (SPI) is widely applied to evaluate for meteorological droughts. However, the SPI is limited to capture a drought event with a short duration, expecially shorter than one month. In this study, we proposed a daily SPI (DSPI) as a way to overcome the limitation of the monthly SPI for drought monitoring. In order to objectively assess the ability of the drought reproduction of the DSPI, we performed a receiver operating characteristic (ROC) analysis using the quantified drought records from official reports, newspapers, etc. The results of ROC analysis showed that the DSPI has an ability to reproduce short-term drought compared with other indices. It also showed that the main cause of historical droughts was the shortage of rainfall accumulated during the time period less than 90 days compared with the rainfall of normal years.

• Journal of Korea Water Resources Association
• /
• v.46 no.3
• /
• pp.287-299
• /
• 2013

The objective of this study is to derive and evaluate the drought threshold level based on hydro-meteorological data using historical drought events. After collecting the drought events during 1991 to 2009 year, the observed meteorological data and estimated hydrological component from LSM are used as input for the percentile analysis that is drought analysis data. The drought threshold level that precipitation and runoff of 3 month duration are less than 35%, soil moisture of 2 month duration is less than 35% and evapotranspiration of 3 month duration is more than 65% is derived using ROC analysis that are objective test method. ROC analysis with SPI (3) is performed to evaluate the applicability of threshold level in the domestic. As a result, it can be concluded that the derived drought threshold level show better performance to reflect the historical drought events than SPI (3) and it reasonably explain the spatial drought situation through the spatial analysis.

• Journal of Korean Academy of Oral and Maxillofacial Radiology
• /
• v.27 no.2
• /
• pp.7-13
• /
• 1997

조직학적으로 유용성이 입증된 산탈회법을 이용한 인접면 비교적 초기 치아 우식의 병소를 형성하여 진단율을 조사하였다. 산 용액을 이용하여 20개 인접면 치아우식을 20개 소구치에 형성하였고, 37개 인접면 치아우식을 30개 대구치에 형성하였다. 건전한 소구치 20개, 대구치 30개를 포함하여 총 96개 치아를 4개씩 나누어 24개의 블록을 형성하였고, 각각 2개 블록의 교합면을 교합시켜서, 교익촬영을 하였다. 촬영 결과를 36명의 치과의사들이인접면 치아우식의 유무를 기록하고, 동시에 및 ROC 분석을 위한 5 개 범주의 판독 기준으로 판독하여 기록하였다. 인접면 치아우식증 유, 무만으로 판독한 결과 진단의 sensitivity는 0.71, specificity는 0.78 이였다. ROC 분석 한 결과의 곡선도표 아래부분의 평균 면적은 약 0.806 이였다. 치아우식증 유무만으로 진단한 결과는 특정한 sensitivity와 specificity 만을 나타내지만, ROC 분석 결과는 주관적 진단 기준과 구별되는 고유의 진단 능력을 표시하는 1-specificity(False Positive)의 변화에 따른 sensitivity(True Positive)의 변화를 연속적으로 나타내어 주었다.

• Journal of Veterinary Clinics
• /
• v.33 no.2
• /
• pp.97-101
• /
• 2016

In the field of clinical medicine, diagnostic accuracy studies refer to the degree of agreement between the index test and the reference standard for the discriminatory ability to identify a target disorder of interest in a patient. The receiver operating characteristic (ROC) curve offers a graphical display the trade-off between sensitivity and specificity at each cutoff for a diagnostic test and is useful in assigning the best cutoff for clinical use. In this end, the ROC curve analysis is a useful tool for estimating and comparing the accuracy of competing diagnostic tests. This paper reviews briefly the measures of diagnostic accuracy such as sensitivity, specificity, and area under the ROC curve (AUC) that is a summary measure for diagnostic accuracy across the spectrum of test results. In addition, the methods of creating an ROC curve in single diagnostic test with five-category discrete scale for disease classification from healthy individuals, meaningful interpretation of the AUC, and the applications of ROC methodology in clinical medicine to determine the optimal cutoff values have been discussed using a hypothetical example as an illustration.