• 제목/요약/키워드: ROC(Receiver Operating Characteristic)

Search Result 375, Processing Time 0.035 seconds

Validity of MAST-CLA for diagnosis of arthropod allergy using receiver operating characteristic (ROC) analysis

  • Park, Joon-Soo;Nam, Hae-Seon;Kim, Yong-Bae;Choi, Young-Jin;Lee, Sang-Han;Kim, Sung-Ho
    • Parasites, Hosts and Diseases
    • /
    • v.45 no.3
    • /
    • pp.239-243
    • /
    • 2007
  • Many allergists are currently focusing on the development of new diagnostic tools, and are attempting to improve both the sensitivity and specificity. A multiple allergen simultaneous test-chemiluminescent assay (MAST-CLA) is one of the most popular diagnostic tools used in the Republic of Korea. However, there remains controversy among allergists with regard to the cut-off point for a positive result. The present study was conducted in order to determine the validity of MAST-CLA as compared with that of the skin prick test, with particular emphasis on arthropod allergens, on the basis of percentage agreement rates and k-values, and also to suggest the optimal positive cutoff points using receiver operating characteristic (ROC) curves. The study was conducted with 97 subjects (54 men, 43 women). Optimal individual cut-off points were calculated as follows; class II for Dermatophagoides farinae, class I for Dermatophagoides pteronyssinus, and trace for a cockroach mix. These findings suggest that attempting to apply optimal individual cut-off points will be a good way of improving diagnostic tests, particularly MAST-CLA.

Analysis of SEER Adenosquamous Carcinoma Data to Identify Cause Specific Survival Predictors and Socioeconomic Disparities

  • Cheung, Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.1
    • /
    • pp.347-352
    • /
    • 2016
  • Background: This study used receiver operating characteristic curve to analyze Surveillance, Epidemiology and End Results (SEER) adenosquamous carcinoma data to identify predictive models and potential disparities in outcome. Materials and Methods: This study analyzed socio-economic, staging and treatment factors available in the SEER database for adenosquamous carcinoma. For the risk modeling, each factor was fitted by a generalized linear model to predict the cause specific survival. An area under the receiver operating characteristic curve (ROC) was computed. Similar strata were combined to construct the most parsimonious models. Results: A total of 20,712 patients diagnosed from 1973 to 2009 were included in this study. The mean follow up time (S.D.) was 54.2 (78.4) months. Some 2/3 of the patients were female. The mean (S.D.) age was 63 (13.8) years. SEER stage was the most predictive factor of outcome (ROC area of 0.71). 13.9% of the patients were un-staged and had risk of cause specific death of 61.3% that was higher than the 45.3% risk for the regional disease and lower than the 70.3% for metastatic disease. Sex, site, radiotherapy, and surgery had ROC areas of about 0.55-0.65. Rural residence and race contributed to socioeconomic disparity for treatment outcome. Radiotherapy was underused even with localized and regional stages when the intent was curative. This under use was most pronounced in older patients. Conclusions: Anatomic stage was predictive and useful in treatment selection. Under-staging may have contributed to poor outcome.

Statistical Method of Ranking Candidate Genes for the Biomarker

  • Kim, Byung-Soo;Kim, In-Young;Lee, Sun-Ho;Rha, Sun-Young
    • Communications for Statistical Applications and Methods
    • /
    • v.14 no.1
    • /
    • pp.169-182
    • /
    • 2007
  • Receive operating characteristic (ROC) approach can be employed to rank candidate genes from a microarray experiment, in particular, for the biomarker development with the purpose of population screening of a cancer. In the cancer microarray experiment based on n patients the researcher often wants to compare the tumor tissue with the normal tissue within the same individual using a common reference RNA. Ideally, this experiment produces n pairs of microarray data. However, it is often the case that there are missing values either in the normal or tumor tissue data. Practically, we have $n_1$ pairs of complete observations, $n_2$ "normal only" and $n_3$ "tumor only" data for the microarray. We refer to this data set as a mixed data set. We develop a ROC approach on the mixed data set to rank candidate genes for the biomarker development for the colorectal cancer screening. It turns out that the correlation between two ranks in terms of ROC and t statistics based on the top 50 genes of ROC rank is less than 0.6. This result indicates that employing a right approach of ranking candidate genes for the biomarker development is important for the allocation of resources.

Image saliency detection based on geodesic-like and boundary contrast maps

  • Guo, Yingchun;Liu, Yi;Ma, Runxin
    • ETRI Journal
    • /
    • v.41 no.6
    • /
    • pp.797-810
    • /
    • 2019
  • Image saliency detection is the basis of perceptual image processing, which is significant to subsequent image processing methods. Most saliency detection methods can detect only a single object with a high-contrast background, but they have no effect on the extraction of a salient object from images with complex low-contrast backgrounds. With the prior knowledge, this paper proposes a method for detecting salient objects by combining the boundary contrast map and the geodesics-like maps. This method can highlight the foreground uniformly and extract the salient objects efficiently in images with low-contrast backgrounds. The classical receiver operating characteristics (ROC) curve, which compares the salient map with the ground truth map, does not reflect the human perception. An ROC curve with distance (distance receiver operating characteristic, DROC) is proposed in this paper, which takes the ROC curve closer to the human subjective perception. Experiments on three benchmark datasets and three low-contrast image datasets, with four evaluation methods including DROC, show that on comparing the eight state-of-the-art approaches, the proposed approach performs well.

Receiver Operating Characteristic (의학적 진단에서 ROC 곡선의 활용)

  • 박선일
    • Journal of the korean veterinary medical association
    • /
    • v.36 no.2
    • /
    • pp.121-134
    • /
    • 2000
  • 의학적 진단에서 검사결과가 연속형으로 측정되는 예는 매우 많다. 예를 들어 ELISA검사, 혈청화학적 검사, 방사선 검사 (이 경우에는 음성, 의양성, 양성등의 척도로 표현될 수 있음) 등에서는 적절한 기준을 설정한 후 이 기준점을 근거로 양성과 음성으로 판정하게 된다. 여기에서 한 가지 문제는 기준점 설정에 있다. 소위 정상 혹은 참고범위 (normal or reference range)가 분명히 있는 경우라고 실제 판정에 있어서는 질별이 없음에도 불구하고 검사결과 질병이 있는 것으로 판정할 오류 (혹은 그 반대)가 분명히 존재한다. 본 논문에서는 이러한 상황에서 접근할 수 있는 한가지 방법인 ROC 곡선에 대하여 설명하고자 한다.

  • PDF

Normal Probability Plots for Normality

  • Lee, Jea-Young;Rhee, Seong-Won
    • Communications for Statistical Applications and Methods
    • /
    • v.6 no.3
    • /
    • pp.687-694
    • /
    • 1999
  • The goodness of fit statistics of normality plots are obtained using the Receiver Operating Characteristic(ROC) method. This work is intended to compare with Shapiro-Wilk W statistic. Wel will use and discuss an accuracy of the test and the best cut-off value which minimizes the sum of the type I and II error probabilities.

  • PDF

Positive and negative predictive values by the TOC curve

  • Hong, Chong Sun;Choi, So Yeon
    • Communications for Statistical Applications and Methods
    • /
    • v.27 no.2
    • /
    • pp.211-224
    • /
    • 2020
  • Sensitivity and specificity are popular measures described by the receiver operating characteristic (ROC) curve. There are also two other measures such as the positive predictive value (PPV) and negative predictive value (NPV); however, the PPV and NPV cannot be represented by the ROC curve. Based on the total operating characteristic (TOC) curve suggested by Pontius and Si (International Journal of Geographical Information Science, 97, 570-583, 2014), explanatory methods are proposed to geometrically describe the PPV and NPV by the TOC curve. It is found that the PPV can be regarded as the slope of the right-angled triangle connecting the origin to a certain point on the TOC curve, while 1 - NPV can be represented as the slope of the right-angled triangle connecting a certain point to the top right corner of the TOC curve. When the neutral zone exists, the PPV and 1-NPV can be described as the slopes of two other right-angled triangles of the TOC curve. Therefore, both the PPV and NPV can be estimated using the TOC curve, whether or not the neutral zone is present.

A Novel System for Detecting Adult Images on the Internet

  • Park, Jae-Yong;Park, Sang-Sung;Shin, Young-Geun;Jang, Dong-Sik
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.4 no.5
    • /
    • pp.910-924
    • /
    • 2010
  • As Internet usage has increased, the risk of adolescents being exposed to adult content and harmful information on the Internet has also risen. To help prevent adolescents accessing this content, a novel detection method for adult images is proposed. The proposed method involves three steps. First, the Image Of Interest (IOI) is extracted from the image background. Second, the IOI is distinguished from the segmented image using a novel weighting mask, and it is determined to be acceptable or unacceptable. Finally, the features (color and texture) of the IOI or original image are compared to a critical value; if they exceed that value then the image is deemed to be an adult image. A Receiver Operating Characteristic (ROC) curve analysis was performed to define this optimal critical value. And, the textural features are identified using a gray level co-occurrence matrix. The proposed method increased the precision level of detection by applying a novel weighting mask and a receiver operating characteristic curve. To demonstrate the effectiveness of the proposed method, 2850 adult and non-adult images were used for experimentation.

A Comparative Study on the Predictive Validity among Pressure Ulcer Risk Assessment Scales (욕창발생위험사정도구의 타당도 비교)

  • 이영희;정인숙;전성숙
    • Journal of Korean Academy of Nursing
    • /
    • v.33 no.2
    • /
    • pp.162-169
    • /
    • 2003
  • Purpose: This study was to compare the predictive validity of Norton Scale(1962), Cubbin & Jackson Scale(1991), and Song & Choi Scale(1991). Method: Data were collected three times per week from 48~72hours after admission based on the four pressure sore risk assessment scales and a skin assessment tool for pressure sore on 112 intensive care unit(ICU) patients in a educational hospital Ulsan during Dec, 11, 2000 to Feb, 10, 2001. Four indices of validity and area under the curve(AUC) of receiver operating characteristic(ROC) were calculated. Result: Based on the cut off point presented by the developer, sensitivity, specificity, positive predictive value, negative predictive value were as follows : Norton Scale : 97%, 18%, 35%, 93% respectively; Cubbin & Jackson Scale : 89%, 61%, 51%, 92%, respectively; and Song & Choi Scale : 100%, 18%, 36%, 100% respectively. Area under the curves(AUC) of receiver operating characteristic(ROC) were Norton Scale .737, Cubbin & Jackson Scale .826, Song & Choi Scale .683. Conclusion: The Cubbin & Jackson Scale was found to be the most valid pressure sore risk assessment tool. Further studies on patients with chronic conditions may be helpful to validate this finding.

Analysis of SEER Glassy Cell Carcinoma Data: Underuse of Radiotherapy and Predicators of Cause Specific Survival

  • Cheung, Rex
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.17 no.1
    • /
    • pp.353-356
    • /
    • 2016
  • Background: This study used receiver operating characteristic curve to analyze Surveillance, Epidemiology and End Results (SEER) for glassy cell carcinoma data to identify predictive models and potential disparities in outcome. Materials and Methods: This study analyzed socio-economic, staging and treatment factors. For risk modeling, each factor was fitted by a generalized linear model to predict the cause specific survival. Area under the receiver operating characteristic curves (ROCs) were computed. Similar strata were combined to construct the most parsimonious models. A random sampling algorithm was used to estimate modeling errors. Risk of glassy cell carcinoma death was computed for the predictors for comparison. Results: There were 79 patients included in this study. The mean follow up time (S.D.) was 37 (32.8) months. Female patients outnumbered males 4:1. The mean (S.D.) age was 54.4 (19.8) years. SEER stage was the most predictive factor of outcome (ROC area of 0.69). The risks of cause specific death were, respectively, 9.4% for localized, 16.7% for regional, 35% for the un-staged/others category, and 60% for distant disease. After optimization, separation between the regional and unstaged/others category was removed with a higher ROC area of 0.72. Several socio-economic factors had small but measurable effects on outcome. Radiotherapy had not been used in 90% of patients with regional disease. Conclusions: Optimized SEER stage was predictive and useful in treatment selection. Underuse of radiotherapy may have contributed to poor outcome.