• Communications for Statistical Applications and Methods
• /
• v.27 no.2
• /
• pp.211-224
• /
• 2020

Sensitivity and specificity are popular measures described by the receiver operating characteristic (ROC) curve. There are also two other measures such as the positive predictive value (PPV) and negative predictive value (NPV); however, the PPV and NPV cannot be represented by the ROC curve. Based on the total operating characteristic (TOC) curve suggested by Pontius and Si (International Journal of Geographical Information Science, 97, 570-583, 2014), explanatory methods are proposed to geometrically describe the PPV and NPV by the TOC curve. It is found that the PPV can be regarded as the slope of the right-angled triangle connecting the origin to a certain point on the TOC curve, while 1 - NPV can be represented as the slope of the right-angled triangle connecting a certain point to the top right corner of the TOC curve. When the neutral zone exists, the PPV and 1-NPV can be described as the slopes of two other right-angled triangles of the TOC curve. Therefore, both the PPV and NPV can be estimated using the TOC curve, whether or not the neutral zone is present.

• Journal of the Korean Data and Information Science Society
• /
• v.16 no.2
• /
• pp.419-428
• /
• 2005

The screening test is increasingly being used for predicting future disease in the person screened and has raised concerns about reliability of the result of its procedure. We propose an improved estimator of the confidence interval for the positive predictive value(PPV) in screening test by simply taking inverse sinh transformation comparing to Gastwirth(1987) estimator and show its efficiency through the simulation study.

• Asian Pacific Journal of Cancer Prevention
• /
• v.16 no.1
• /
• pp.345-349
• /
• 2015

Background: To determine the cut-off values of the preoperative risk of malignancy index (RMI) used in differentiating benign or malignant adnexal masses and to determine their significance in differential diagnosis by comparison of different systems. Materials and Methods: 191 operated women were assessed retrospectively. RMI of 1, 2, 3 and 4; cut-off values for an effective benign or malignant differentiation together with sensitivity, specificity, negative and positive predictive values were calculated. Results: Cut-off value for RMI 1 was found to be 250; there was significant (p<0.001) compatibility at this level with sensitivity of 60%, positive predictive value (PPV) of 75%, specificity of 93%, negative predictive value (NPV) of 88% and an overall compliance rate of 85%. When RMI 2 and 3 was obtained with a cut-off value of 200, there was significant (p<0.001) compatibility at this level for RMI 2 with sensitivity of 67%, PPV of 67%, specificity of 89%, NPV of 89%, histopathologic correlation of 84% while RMI 3 had significant (p<0.001) compatibility at the same level with sensitivity of 63%, PPV of 69%, specificity of 91%, NPV of 88% and a histopathologic correlation of 84%. Significant (p<0.001) compatibility for RMI 4 with a sensitivity of 67%, PPV of 73%, specificity of 92%, NPV of 89% and a histopathologic correlation of 86% was obtained at the cut-off level 400. Conclusions: RMI have a significant predictability in differentiating benign and malignant adnexal masses, thus can effectively be used in clinical practice.

• Annals of Clinical Neurophysiology
• /
• v.24 no.1
• /
• pp.7-16
• /
• 2022

Background: There is inadequate information on the validation of diabetic microvascular complications in the Korean National Health Insurance Service data set. We aimed to validate the diagnostic algorithms regarding the nephropathy, neuropathy, and retinopathy of diabetes. Methods: From various secondary and tertiary medical centers, we selected 6,493 patients aged ≥ 40 years who were diagnosed with diabetic microvascular complications more than once based on codes in the 10th version of the International Classification of Diseases (ICD-10). During 2019 and 2020, we randomly selected the diagnoses of 200 patients, 100 from each of two hospitals. The positive predictive value (PPV), negative predictive value, error rate, sensitivity, and specificity were determined for each diabetic microvascular complication according to the ICD-10 codes, laboratory findings, diagnostic studies, and treatment procedure codes. Results: Among the 200 patients who visited the hospital more than once and had the diagnostic codes of diabetic microvascular complications, 142, 110, and 154 patients were confirmed to have the gold standard of diabetic nephropathy (PPV, 71.0%), diabetic neuropathy (PPV, 55.0%), and diabetic retinopathy (PPV, 77.0%), respectively. The PPV and specificity of diabetic nephropathy (PPV, 71.0-81.4%; specificity, 10.3-53.4%), diabetic neuropathy (PPV, 55.0-81.3%; specificity, 66.7-76.7%) and diabetic retinopathy (PPV, 77.0-96.6%; specificity, 2.2-89.1%) increased after combining them with the laboratory findings, diagnostic studies, and treatment procedures codes. These change trends were observed similarly for both hospitals. Conclusions: Defining diabetic microvascular complications using ICD-10 codes and their related examination codes may be a feasible method for studying diabetic complications.

• The Journal of Advanced Prosthodontics
• /
• v.16 no.4
• /
• pp.221-230
• /
• 2024

PURPOSE. This in vitro study was conducted to investigate the accuracy of intraoral scanner (IOS) for recording maximal intercuspal position (MIP) and border positions of the mandible. MATERIALS AND METHODS. Maxillary and mandibular master casts were articulated in MIP, protrusive, and lateral interocclusal position sequentially on a semi-adjustable articulator. For each articulation relation, sites of occlusal contacts (SOCs) and sites of clearance (SCs) were identified on the master casts with articulating paper (reference sites). IOS was used to take full arch scans and nine virtual interocclusal records (VIRs) for virtual articulation of models. Virtual SOCs and SCs were detected with 3D processing software and compared to those identified with the articulating paper. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated for each articulation relation. RESULTS. For MIP, IOS showed adequate sensitivity and NPV of 100%, and specificity and a PPV of 99%. For protrusive position, the IOS showed a sensitivity and a NPV of 100%, a high PPV of 86%, and a specificity of 83%. For lateral positions, the specificity and the PPV were high (93% and 79%, respectively), but the sensitivity and the NPV were below the clinically acceptable limits (28% and 56%, respectively). CONCLUSION. IOS displayed clinically acceptable accuracy for recording MIP and protrusive border mandibular position. However, IOS had less accuracy for lateral border mandibular position.

• Asian Pacific Journal of Cancer Prevention
• /
• v.15 no.17
• /
• pp.7061-7064
• /
• 2014

Background: To assess the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and accuracy of intraoperative gross examination (IGE) of uterine specimens in determining deep myometrial invasion and cervical invasion compared to final histology. Materials and Methods: The clinical, surgical and histological data of all FIGO stage I-II endometrial cancer (EC) patients who had primary surgery were reviewed. Results of the IGE for myometrial invasion and cervical invasion were compared to the final histology. The sensitivity, specificity, PPV, NPV, and accuracy of the IGE in determining deep myometrial invasion and cervical invasion were calculated. Association between clinico-pathological factors and discrepancy between IGE and final histology in the determination of myometrial invasion was also assessed. A p-value of <0.05 was considered significant. Results: From January 2007 to December 2012, 179 patients diagnosed with clinical stage I-II endometrial cancer underwent surgical staging. The sensitivity and specificity of IGE in detecting deep myometrial invasion were 42.4% and 90.0%, respectively, and the PPV and NPV were 67.6% and 76.1%. The overall accuracy of IGE was 74.3%. The sensitivity and specificity of IGE in identifying cervical invasion were 28.6% and 97.5%, respectively, while the PPV and NPV were 60.0% and 91.1%. The overall accuracy of IGE was 89.4%. Conclusions: The sensitivity of IGE for detecting deep myometrial invasion and cervical invasion in early-stage EC is too low to be used alone. Alternative methods including intraoperative frozen section analysis, preoperative three dimensional ultrasound, and preoperative magnetic resonance imaging should be strongly considered.

• Korean Journal of Radiology
• /
• v.25 no.7
• /
• pp.656-661
• /
• 2024

Evaluating the performance of a binary diagnostic test, including artificial intelligence classification algorithms, involves measuring sensitivity, specificity, positive predictive value, and negative predictive value. Particularly when comparing the performance of two diagnostic tests applied on the same set of patients, these metrics are crucial for identifying the more accurate test. However, comparing predictive values presents statistical challenges because their denominators depend on the test outcomes, unlike the comparison of sensitivities and specificities. This paper reviews existing methods for comparing predictive values and proposes using the permutation test. The permutation test is an intuitive, non-parametric method suitable for datasets with small sample sizes. We demonstrate each method using a dataset from MRI and combined modality of mammography and ultrasound in diagnosing breast cancer.

• Asian Pacific Journal of Cancer Prevention
• /
• v.17 no.5
• /
• pp.2507-2511
• /
• 2016

Purpose: To study the diagnostic accuracies of serum human epididymis protein 4 (HE-4) levels, virtual organ computer-aided analysis (VOCAL) parameters and endometrial volume in endometrial cancer cases. Materials and Methods: One hundred and seven patients (37 with endometrial cancer and 70 with benign endometrial pathology) were included in this study. VOCAL parameters and serum HE-4 levels were compared between the groups. Results: Area under the curve (AUC) values were 0.702, 0.658, 0.706 for vascularization index (VI), the flow index (FI) and the vascularization flow index (VFI), respectively. A cut off value of 0.568 for VI demonstrated 70% sensitivity, 72% specificity, 56% positive predictive value (PPV) and a81% negative predictive value (NPV). A cut off value of 25.8 for showed a senitivith of 70% and a specificity of 58% with aPPV of 46% and NPV of 78%, and with a cut off value of 0.12 for VFI 70%, 69%, 54% and 81%, respectively. The area under the curve for HE-4 was 0.814. A cut off value of 458 pmol/L was predictive of malignancy with 86% sensitivity and 63% specificity. Conclusions: VOCAL parameters and serum HE-4 levels were statistically significantly higher in the endometrial cancer patients. Serum HE-4 levels provided a greater sensitivity compared to power doppler angiography for predicting malignancy or benign endometrial pathology.

• Journal of the Korean Society of Radiology
• /
• v.18 no.5
• /
• pp.551-556
• /
• 2024

This study aims to evaluate the diagnostic concordance and accuracy by comparing thyroid lesions diagnosed with the artificial intelligence-based computer-aided diagnosis (CAD) system, S-Detect^TM, to the results of fine-needle aspiration biopsy(FNAB). A retrospective study was conducted involving 60 patients at N Hospital in Gyeongnam from May 2023 to September 2023. The study used S-Detect^TM to analyze ultrasound findings and malignancy risk of thyroid nodules and compared these findings with FNAB results to determine accuracy. The study assessed the sensitivity, specificity, accuracy, positive predictive value (PPV), and negative predictive value (NPV) of S-Detect^TM and evaluated the diagnostic concordance between the two methods using Kappa analysis. S-Detect^TM demonstrated a sensitivity of 90.5%, specificity of 83.2%, accuracy of 88.3%, PPV of 80.7%, and NPV of 92.7%. The Kappa value for diagnostic agreement between S-Detect^TM and FN AB was 0.719 (p<0.05), indicating a high level of agreement between the methods. Therefore, the CAD system S-Detect^TM proves valuable in distinguishing between malignant and benign thyroid lesions and could reduce unnecessary tissue examinations when used appropriately before thyroid fine-needle aspiration.

• Journal of the Korean Association of Oral and Maxillofacial Surgeons
• /
• v.41 no.2
• /
• pp.66-73
• /
• 2015

Objectives: To assess the validity of the vertical tube-shift method using intraoral periapical radiography (IOPAR) for determining the relationship between the mandibular third molar roots and the inferior alveolar nerve (IAN) canal in comparison with cone-beam computed tomography (CBCT). Materials and Methods: Fifty impacted mandibular third molars were analyzed using the IOPAR vertical tube-shift method and CBCT. The relationship of the IAN canal to the impacted mandibular third molar was recorded as buccal, lingual or in line with the apex and was compared with CBCT findings. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the vertical tube-shift method in depicting the relationship (buccal/lingual/in line with the apex) of the IAN canal to the third molar root apex was calculated. Results: The sensitivity and specificity PPV and NPV of the IOPAR vertical tube-shift technique was found to be highest for a lingual relationship (100%) followed by buccal (94.4%, 92.3%, 97.1%, and 85.7%) and in line with the apex relationship (88.9%, 95.0%, 80.0%, and 97.4%) of the IAN canal with the third molar root apex, respectively. A statistically significant association was observed between the IOPAR vertical tube-shift method and the CBCT with a P-value <0.01. Conclusion: The vertical tube-shift method can be used as an effective diagnostic tool in assessing the relationship of the IAN canal to the third molar root apex with high sensitivity, specificity, PPV, and NPV.