• 제목/요약/키워드: Receiver Operating Characteristics (ROC) curve analysis

검색결과 38건 처리시간 0.024초

ROC(receiver operating characteristics) 해석 (Interpretation of Receiver Operating Characteristics (ROC))

  • 김재덕
    • Imaging Science in Dentistry
    • /
    • 제30권3호
    • /
    • pp.155-158
    • /
    • 2000
  • 1. 일반방사선사진과 칼라화한 방사선사진의 비교에서 각각 필름에서 진단을 시행할 때 ROC해석법에서는 true positive fraction (TPF), false positive fraction (FPF)를 매개변수로 하고 있으므로 우선 두가지 필름형태에 대해 각각 따로 다음과 같이 평가한다. 2. 판정기준 병변없다 A, 거의 없다 B, 모르겠다 C, 거의 있다 D, 있다 E 먼저 일반방사선사진에서 실제로 병소가 총있는 것이 50, 총없는 것이 50인데 위 판정기준 각각에 대해(equation omitted) 3. 곡선만들기 a.횡축은 FPF 종축은 TPF로 한 그래프를 plot를 한다. sensitivity 17/50 specificity 26/50 accuracy 43/100 b. 곡선만들기 프로그램을 이용하여 곡선을 만들시에는 TPF를 a에 입력하고 PFP를 b에 입력한다. 이 plot을 그릴 수 있는 프로그램은 http://www.members.tripod.co.kr/jdakim 또는 http://www.chosun.ac.kr/∼jdakim의 홈페이지내 공개자료실에서 다운 받으실 수 있습니다. (equation omitted) 이 프로그램에서 입력할 a, b의 값은 (equation omitted) 위와같이 입력하여 얻어진 일반방사선사진에서의 판독 결과 얻어진 곡선이 그래프에서 곡선이 된다. 이와 같은 커브를 컬러화한 사진 판독에서 똑같이 시행하여 ROC곡선(윗곡선)을 만든 다음 두 곡선을 비교하여 아래면적이 더 큰 쪽이 병소 판독에 우수하다고 결론짓는다.

  • PDF

고속도로 이용자의 승차감 평가특성 및 만족도 분석과 ROC 곡선을 이용한 평탄성 관리기준 적정성 검토 (Analysis of Riding Quality Acceptability and Characteristics of Expressway Users and Evaluation of MRI Thresholds using Receiver Operating Characteristic curves)

  • 이재훈;손덕수;류성우;김용원;박준영
    • 한국도로학회논문집
    • /
    • 제20권2호
    • /
    • pp.35-44
    • /
    • 2018
  • PURPOSES : The purpose of this research is to analyze the characteristics of panels that affect the evaluating results of riding quality and to evaluate the appropriateness of roughness management criteria based on ride comfort satisfaction. METHODS : In order to analyze the influence of panel characteristics of riding quality, 33 panels, consisting of civilians and experts, were selected. Also, considering the roughness distribution of the expressway, 35 sections with MRI ranging from 1.17 m/km to 4.65 m/km were selected. Each panel boarded a passenger car and evaluated the riding quality with grades from 0 to 10, and assessed whether it was satisfied or not. After removing outlier results using a box plot technique, 964 results were analyzed. An ANOVA was conducted to evaluate the effects of panel expertise, age, driving experience, vehicle ownership, and gender on the evaluation results. In addition, by using the receiver operating characteristics (ROC) curve, the MRI value, which can most accurately evaluate the satisfaction with riding quality, was derived. Then, the compatibility of MRI was evaluated using AUC as a criterion to assess whether the riding quality was satisfactory. RESULTS : Only the age of the panel participants were found to have an effect on the riding quality satisfaction. It was found that satisfaction with riding quality and MRI are strongly correlated. The satisfaction rate of roughness management criteria on new (MRI 1.6 m/km) and maintenance (MRI 3.0 m/km) expressways were 95% and 53%, respectively. As a result of evaluating the roughness management criteria by using the ROC curve, it was found that the accuracy of satisfaction was the highest at MRI 3.1-3.2 m/km. In addition, the AUC of the MRI was about 0.8, indicating that the MRI was an appropriate index for evaluating the riding quality satisfaction. CONCLUSIONS : Based on the results, the distribution of the panels' age should be considered when panel rating is conducted. From the results of the ROC curve, MRI of 3.0 m/km, which is a criterion of roughness management on maintenance expressways, is considered as appropriate.

Fault Prediction Using Statistical and Machine Learning Methods for Improving Software Quality

  • Malhotra, Ruchika;Jain, Ankita
    • Journal of Information Processing Systems
    • /
    • 제8권2호
    • /
    • pp.241-262
    • /
    • 2012
  • An understanding of quality attributes is relevant for the software organization to deliver high software reliability. An empirical assessment of metrics to predict the quality attributes is essential in order to gain insight about the quality of software in the early phases of software development and to ensure corrective actions. In this paper, we predict a model to estimate fault proneness using Object Oriented CK metrics and QMOOD metrics. We apply one statistical method and six machine learning methods to predict the models. The proposed models are validated using dataset collected from Open Source software. The results are analyzed using Area Under the Curve (AUC) obtained from Receiver Operating Characteristics (ROC) analysis. The results show that the model predicted using the random forest and bagging methods outperformed all the other models. Hence, based on these results it is reasonable to claim that quality models have a significant relevance with Object Oriented metrics and that machine learning methods have a comparable performance with statistical methods.

불면증 최소스크리닝척도의 심리측정적 특성과 적합성 검증 (Psychometric Properties of Korean Minimal Insomnia Screening Scale)

  • 김인자;김성재;김범종;최희정
    • 대한간호학회지
    • /
    • 제42권6호
    • /
    • pp.853-860
    • /
    • 2012
  • Purpose: The purposes of this study were to develop a Minimal Insomnia Screening Scale for Korean adults (KMISS) and to evaluate psychometric properties and discriminant ability of the developed scale. Methods: Data from a cross-sectional survey of 959 Korean adults were analyzed to develop the summated insomnia scale, which was evaluated in terms of reliability, validity, and discriminant ability by receiver operating characteristics (ROC) curve analysis. Results: Item-total correlations ranged between .71-.79 and Cronbach's ${\alpha}$ was .87. Adequate validity was also evident. ROC-curve analysis showed area under ROC was .87 (95% CI: .84-.90) and identified the optimal cut-off score as ${\leq}20$ (sensitivity, .83; specificity, .75; positive/negative predictive values, .40/.95). Using this cut-off score, the prevalence of insomnia in the study sample was 26.3% and most frequent among women and the oldest group. Conclusion: Data supports the psychometric properties of KMISS as a possible insomnia screening instrument. KMISS also shows promise as a convenient ultra-short screening measure of insomnia for adults and epidemiological studies in community health care settings.

노인과 비노인 외상환자의 손상중증도에 따른 특성 비교 (Comparison of the Characteristics according to Injury Severity Score between Elderly and Non-elderly with Trauma)

  • 김현주;김윤경
    • 한국보건간호학회지
    • /
    • 제32권2호
    • /
    • pp.304-318
    • /
    • 2018
  • Purpose: This study examined the characteristic of the Injury Severity Score (ISS) of Korean geriatric patients with a traumatic injury in a nationally representative sample to determine the optimal cutoff of ISS of mortality according to age. Methods: The subjects were 3,018 non-elderly patients and 1,584 elderly patients with an ISS and Korean Triage and Acuity Scale (KTAS) in 2016 from the data of the Health Insurance Review and Assessment Service. The traumatic characteristics of the elderly and non-elderly were compared by stratifying the ISS. Receiver Operating Characteristic (ROC) curve analysis was used to find the optimal cutoff of ISS of mortality according to age. Results: The elderly were more prone to severe trauma than the non-elderly were. The distribution of KTAS grades was lower, even though the severity of ISS was as high as that of the non-elderly. The optimal cutoff score of the ISS for mortality in the ROC curve was lower in elderly over 65 years than in the other age group. Conclusion: The elderly are more prone to severe trauma and death than non-elderly, even though their ISS is low. Therefore, a strategy to prevent elderly from experiencing serious trauma and managing their geriatric trauma actively is needed.

Usefulness of Estimated Height Loss for Detection of Osteoporosis in Women

  • Yeoum, Soon-Gyo;Lee, Jong-Hwa
    • 대한간호학회지
    • /
    • 제41권6호
    • /
    • pp.758-767
    • /
    • 2011
  • Purpose: This study was done to examine the threshold value of estimated height loss at which the risk of osteoporosis increases and to verify its discriminative ability in the detection of osteoporosis. Methods: It was conducted based on epidemiological descriptive methods on 732 Korean women at a public healthcare center in Seoul between July and November 2010. ANOVA, Pearson correlation, logistic regression analysis and receiver operating characteristics (ROC) curve were used for data analysis. Results: There was an age-related correlation between bone mineral density (lumbar spine: F=37.88, p<.001; femur: F=54.27, p<.001) and estimated height loss (F=27.68, p<.001). Estimated height loss increased significantly with decreasing bone mineral density (lumbar spine: r=-.23, p<.001; femur: r=-.34, p<.001). The odds ratio for the point at which the estimated height loss affects the occurrence of osteoporosis was found to increase at a cut-off value of 2 cm and the area under ROC curve was .71 and .82 in lumbar spine and femur, respectively. Conclusion: The optimal cut-off value of the estimated height loss for detection of osteoporosis was 2 cm. Height loss is therefore a useful indicator for the self-assessment and prognosis of osteoporosis.

Psychometric Properties of Korean Version of Modified Leeds Sleep Evaluation Questionnaire (KMLSEQ)

  • Kim, Inja;Choi, Heejung;Kim, Beomjong
    • 재활간호학회지
    • /
    • 제17권1호
    • /
    • pp.10-17
    • /
    • 2014
  • Purpose: The Leeds Sleep Evaluation Questionnaire (LSEQ) translated into Korean was modified to easily apply and reduce respondents' confusion and was evaluated for psychometric properties and discriminant ability. Methods: A total of 960 Korean adults aged 45 years and older participated in this cross-sectional survey. To test reliability, validity and discriminant ability, Cronbach's alpha, correlation analysis, confirmatory factor analysis, simple regression analysis and receiver operating characteristics (ROC) curve analysis were used. Results: Item-total correlations ranged between 62~.85 and Cronbach's alpha was .95. Area under ROC was .86 (95% CI: .83~.90) and the optimal cutoff score was identified as ${\leq}$ 66 (sensitivity, .77; specificity, .84; positive/negative predictive values, .49/.95). Using this cutoff score, the prevalence of insomnia in the study sample was 25.8% and tended to be more common in female and older groups. Conclusion: The data supported the psychometric properties of Korean Modified Leeds Sleep Evaluation Questionnaire (KMLSEQ) as an acceptable sleep measurement. In addition, KMLSEQ is likely to be a useful screening tool for insomnia.

한국어판 Cornell Assessment of Pediatric Delirium 소아 섬망 사정 도구의 검증 (The Reliability and Validity of the Korean Version of the Cornell Assessment of Pediatric Delirium)

  • 남송이;박기영;최수정
    • 임상간호연구
    • /
    • 제26권2호
    • /
    • pp.254-264
    • /
    • 2020
  • Purpose: This study was to examine the reliability and validity of the Korean version of the Cornell Assessment of Pediatric Delirium (CAPD). Methods: For testing the reliability of the Korean version of the CAPD, this study calculated the internal consistency (Cronbach's α) and the Interrater Correlation Coefficient (ICC) by comparing the independent assessment results of three nurses in Pediatric Intensive Care Unit (PICU). For testing the validity of the Korean version of the CAPD, the assessment result of the Korean version of the CAPD compared with that of the Diagnostic and Statistical Manual of Mental Disorders V (DSM-V). Receiver Operating Characteristics (ROC) analysis was used for measuring sensitivity and specificity. Results: Overall interrater reliability of the Korean version of the CAPD, ICC was .98 (95% CI .96~.99). Cronbach's α was .91 for eight items. The concordance between the Korean version of the CAPD and psychiatrist's diagnosis was 90.0%. When the Korean version of the CAPD has the cut point of 9, sensitivity was 93.8%, and specificity was 75.0%. The area under the curve indicated by the ROC analysis was .88. Conclusion: The Korean version of the CAPD showed good reliability and validity. This tool will be useful for pediatric delirium screening and management in Korean PICU.

안전한 항공기 운항을 위한 현업 전지구예보모델 기반 깊은 대류 예측 지수: Part 1. 개발 및 통계적 검증 (Aviation Convective Index for Deep Convective Area using the Global Unified Model of the Korean Meteorological Administration, Korea: Part 1. Development and Statistical Evaluation)

  • 박이준;김정훈
    • 대기
    • /
    • 제33권5호
    • /
    • pp.519-530
    • /
    • 2023
  • Deep convection can make adverse effects on safe and efficient aviation operations by causing various weather hazards such as convectively-induced turbulence, icing, lightning, and downburst. To prevent such damage, it is necessary to accurately predict spatiotemporal distribution of deep convective area near the airport and airspace. This study developed a new index, the Aviation Convective Index (ACI), for deep convection, using the operational global Unified Model of the Korea Meteorological Administration. The ACI was computed from combination of three different variables: 3-hour maximum of Convective Available Potential Energy, averaged Outgoing Longwave Radiation, and accumulative precipitation using the fuzzy logic algorithm. In this algorithm, the individual membership function was newly developed following the cumulative distribution function for each variable in Korean Peninsula. This index was validated and optimized by using the 1-yr period of radar mosaic data. According to the Receiver Operating Characteristics curve (AUC) and True Skill Score (TSS), the yearly optimized ACI (ACIYrOpt) based on the optimal weighting coefficients for 1-yr period shows a better skill than the no optimized one (ACINoOpt) with the uniform weights. In all forecast time from 6-hour to 48-hour, the AUC and TSS value of ACIYrOpt were higher than those of ACINoOpt, showing the improvement of averaged value of AUC and TSS by 1.67% and 4.20%, respectively.

Nomogram for screening the risk of developing metabolic syndrome using naïve Bayesian classifier

  • Minseok Shin;Jeayoung Lee
    • Communications for Statistical Applications and Methods
    • /
    • 제30권1호
    • /
    • pp.21-35
    • /
    • 2023
  • Metabolic syndrome is a serious disease that can eventually lead to various complications, such as stroke and cardiovascular disease. In this study, we aimed to identify the risk factors related to metabolic syndrome for its prevention and recognition and propose a nomogram that visualizes and predicts the probability of the incidence of metabolic syndrome. We conducted an analysis using data from the Korea National Health and Nutrition Survey (KNHANES VII) and identified 10 risk factors affecting metabolic syndrome by using the Rao-Scott chi-squared test, considering the characteristics of the complex sample. A naïve Bayesian classifier was used to build a nomogram for metabolic syndrome. We then predicted the incidence of metabolic syndrome using the nomogram. Finally, we verified the nomogram using a receiver operating characteristic curve and a calibration plot.