• Asian Pacific Journal of Cancer Prevention
• /
• v.13 no.11
• /
• pp.5517-5523
• /
• 2012

Purpose: To evaluate the diagnostic accuracy of ultrasonograph and fine-needle aspiration cytologic examination (USG-FNAC) in the staging of axillary lymph node metastasis in breast cancer patients.Methods: We conducted an electronic search of the literature addressing the performance of USG-FNAC in diagnosis of axillary lymph node metastasis in databases such as Pubmed, Medline, Embase, Ovid and Cochrane library. We introduced a series of diagnostic test indices to evaluate the performance of USG-FNAC by the random effect model (REM), including sensitivity, specificity, likelihood ratios, and diagnostic odds ratios and area under the curve (AUC). Results: A total of 20 studies including 1371 cases and 1289 controls were identified. The pooled sensitivity was determined to be 0.66 (95% CI 0.64-0.69), specificity 0.98 (95% CI 0.98-0.99), positive likelihood ratio 22.7 (95% CI 15.0-34.49), negative likelihood ratio 0.32 (95% CI 0.25-0.41), diagnostic OR 84.2 (95% CI 53.3-133.0). Due to the marginal threshold effect found in some indices of diagnostic validity, we used a summary SROC curve to aggregate data, and obtained a symmetrical curve with an AUC of 0.942. Conclusion: The results of this meta-analysis indicated that the USG-FNAC techniques have acceptable diagnostic validity indices and can be used for early staging of axillary lymph node in breast cancer patients.

• Korean Journal of Veterinary Research
• /
• v.44 no.4
• /
• pp.669-676
• /
• 2004

To evaluate the diagnostic accuracy of two commercial ELISA tests (Allied- and CSL-ELISA) for the diagnosis of Mycobacterium paratuberculosis in cattle, Meta-analysis using English language papers published during 1990-2001 was performed. Diagnostic odds ratios (DOR) were analyzed using regression analysis together with summary receiver operating characteristic (ROC) curves. The difference in diagnostic performance between the two ELISA systems was evaluated by using linear regression. Publication bias was assessed by funnel plot and linear regression. The pooled sensitivity and specificity were 44% (95% CI, 38 to 51) and 98% (95% CI, 96 to 99) for the random-effect model. The DOR between studies was heterogeneous. The area under the fitted ROC curve (AUC) was 0.72 for the unweighted and 0.77 for the weighted model. Maximum joint sensitivity and specificity for the unweighted and weighted model from their summary ROC curve were 70% and 75%, respectively. Based on the fitted model, at a specificity of 95%, sensitivity was estimated to be 52% for the unweighted and 57% for the weighted model. From the final multivariable model study characteristic, the country was the only significant variable with an explained component variance of 13.3%. There were no significant differences in discriminatory power, sensitivity, and specificity between the two ELISA tests. The overall diagnostic accuracy of two commercial ELISA tests was moderate, as judged by the AUC, maximum joint sensitivity and specificity, and estimates from the fitted model and clinical usefulness of the tests for screening program is limited because of low sensitivity and heterogeneous of DOR. It is, therefore, recommended to use ELISA tests as a parallel testing with other diagnostic tests together to increase test sensitivity in the screening program.

• Korean Journal of Radiology
• /
• v.20 no.1
• /
• pp.158-165
• /
• 2019

Objective: Recent studies demonstrated that core needle biopsy (CNB) can effectively reduce the possibility of inconclusive results and prevent unnecessary diagnostic surgery. However, the effectiveness of CNB in patients with suspicious thyroid nodules has not been fully evaluated. This prospective study aimed to determine the potential of CNB to assess thyroid nodules with suspicious ultrasound (US) features. Materials and Methods: Patients undergoing CNB for thyroid nodules with suspicious features on US were enrolled between May and August 2016. Diagnostic performance and the incidence of non-diagnostic results, inconclusive results, conclusive results, malignancy, unnecessary surgery, and complications were analyzed. Subgroup analysis according to nodule size was performed. The risk factors associated with inconclusive results were evaluated using multivariate logistic regression analysis. Results: A total of 93 patients (102 thyroid nodules) were evaluated. All samples obtained from CNB were adequate for diagnosis. Inconclusive results were seen in 12.7% of cases. The diagnostic accuracy, sensitivity, specificity, positive predictive value, and negative predictive value for diagnosis of malignancy were 93.8%, 100%, 100%, 78.9%, and 95%, respectively. None of the patients underwent unnecessary surgery. The diagnostic performance was not significantly different according to nodule size. On multivariate logistic regression analysis, larger nodule size and shorter needle length were independent risk factors associated with inconclusive results. Conclusion: Samples obtained by CNB were sufficient for diagnosis in all cases and resulted in high diagnostic values and conclusive results in the evaluation of suspicious thyroid nodules. These findings indicated that CNB is a promising diagnostic tool for suspicious thyroid nodules.

• Korean Journal of Radiology
• /
• v.24 no.2
• /
• pp.155-165
• /
• 2023

Objective: Little is known about the effects of using different expert-determined reference standards when evaluating the performance of deep learning-based automatic detection (DLAD) models and their added value to radiologists. We assessed the concordance of expert-determined standards with a clinical gold standard (herein, pathological confirmation) and the effects of different expert-determined reference standards on the estimates of radiologists' diagnostic performance to detect malignant pulmonary nodules on chest radiographs with and without the assistance of a DLAD model. Materials and Methods: This study included chest radiographs from 50 patients with pathologically proven lung cancer and 50 controls. Five expert-determined standards were constructed using the interpretations of 10 experts: individual judgment by the most experienced expert, majority vote, consensus judgments of two and three experts, and a latent class analysis (LCA) model. In separate reader tests, additional 10 radiologists independently interpreted the radiographs and then assisted with the DLAD model. Their diagnostic performance was estimated using the clinical gold standard and various expert-determined standards as the reference standard, and the results were compared using the t test with Bonferroni correction. Results: The LCA model (sensitivity, 72.6%; specificity, 100%) was most similar to the clinical gold standard. When expert-determined standards were used, the sensitivities of radiologists and DLAD model alone were overestimated, and their specificities were underestimated (all p-values < 0.05). DLAD assistance diminished the overestimation of sensitivity but exaggerated the underestimation of specificity (all p-values < 0.001). The DLAD model improved sensitivity and specificity to a greater extent when using the clinical gold standard than when using the expert-determined standards (all p-values < 0.001), except for sensitivity with the LCA model (p = 0.094). Conclusion: The LCA model was most similar to the clinical gold standard for malignant pulmonary nodule detection on chest radiographs. Expert-determined standards caused bias in measuring the diagnostic performance of the artificial intelligence model.

• Proceedings of the Korean Statistical Society Conference
• /
• 2000.11a
• /
• pp.173-179
• /
• 2000

Genetic algorithm(GA) is applied for detecting multiple outliers. GA is a heuristic optimization tool solving for near optimal solution. We compare the performance of GA and the other diagnostic measures commonly used for detecting outliers in regression model. The results show that GA seems to have better performance than the others for the detection of multiple outliers.

• Journal of The Korean Radiological Technologist Association
• /
• v.28 no.1
• /
• pp.120-144
• /
• 2002

Purpose The quality assurance in a computed tomography gives a definition to be all the activity so as to optimize the performance of the device and keep an invariable quality of image, and it is to raise a high diagnostic efficiency to obtain a much info

• Proceedings of the PSK Conference
• /
• 2003.04a
• /
• pp.291.1-291.1
• /
• 2003

The purpose of this study is to provide KFDA's guidance for premarket notification submission and labeling for prescription use drugs of abuse in vitro diagnostic devices. To evaluate in vitro diagnostic devices the following performance characteristics should be described in detail within the submission: analytical sensitivity or minimum detection limit, cutoff concentration, specificity and cross reactivity, interference, precision, method comparison and stability. (omitted)

• Korean Journal of Radiology
• /
• v.24 no.8
• /
• pp.739-751
• /
• 2023

Objective: This systematic review and meta-analysis evaluated the accuracy of preoperative breast magnetic resonance imaging (MRI) features and tumor-to-nipple distance (TND) for diagnosing occult nipple-areolar complex (NAC) involvement in breast cancer. Materials and Methods: The MEDLINE, Embase, and Cochrane databases were searched for articles published until March 20, 2022, excluding studies of patients with clinically evident NAC involvement or those treated with neoadjuvant chemotherapy. Study quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Two reviewers independently evaluated studies that reported the diagnostic performance of MRI imaging features such as continuity to the NAC, unilateral NAC enhancement, non-mass enhancement (NME) type, mass size (> 20 mm), and TND. Summary estimates of the sensitivity and specificity curves and the summary receiver operating characteristic (SROC) curve of the MRI features for NAC involvement were calculated using random-effects models. We also calculated the TND cutoffs required to achieve predetermined specificity values. Results: Fifteen studies (n = 4002 breast lesions) were analyzed. The pooled sensitivity and specificity (with 95% confidence intervals) for NAC involvement diagnosis were 71% (58-81) and 94% (91-96), respectively, for continuity to the NAC; 58% (45-70) and 97% (95-99), respectively, for unilateral NAC enhancement; 55% (46-64) and 83% (75-88), respectively, for NME type; and 88% (68-96) and 58% (40-75), respectively, for mass size (> 20 mm). TND had an area under the SROC curve of 0.799 for NAC involvement. A TND of 11.5 mm achieved a predetermined specificity of 85% with a sensitivity of 64%, and a TND of 12.3 mm yielded a predetermined specificity of 83% with a sensitivity of 65%. Conclusion: Continuity to the NAC and unilateral NAC enhancement may help predict occult NAC involvement in breast cancer. To achieve the desired diagnostic performance with TND, a suitable cutoff value should be considered.

• Korean Journal of Radiology
• /
• v.22 no.12
• /
• pp.2026-2033
• /
• 2021

Objective: The aim of this study was to compare the diagnostic performances of digital tomosynthesis (DTS) and conventional radiography in detecting osteonecrosis of the femoral head (ONFH) using computed tomography (CT), as the reference standard and evaluate the diagnostic reproducibility of DTS. Materials and Methods: Forty-five patients (24 male and 21 female; age range, 25-77 years) with clinically suspected ONFH underwent anteroposterior radiography, DTS, and CT. Two musculoskeletal radiologists independently evaluated the presence and type of ONFH. The diagnostic performance of radiography and DTS in detecting the presence of ONFH and determining the types of ONFH were evaluated. The interobserver and intraobserver reliabilities of each imaging modality were analyzed using Cohen's kappa. Results: DTS had higher sensitivity (89.4%-100% vs. 74.5%-76.6%) and specificity (97.3%-100% vs. 78.4%-83.8%) for ONFH detection than radiography. DTS showed higher performance than radiography in identifying the subtypes of ONFH with statistical significance in one reader (type 1, 100% vs. 30.8%, p = 0.004; type II, 97.1% vs. 73.5%, p = 0.008). The interobserver agreement was excellent for DTS and moderate for radiography (kappa of 0.86 vs. 0.57, respectively). The intraobserver agreement for DTS was higher than that of radiography (kappa of 0.96 vs. 0.69, respectively). Conclusion: DTS showed higher diagnostic performance and reproducibility than radiography in detecting ONFH. DTS may be used as a first-line diagnostic modality instead of radiography for patients suspected of having ONFH.

• Korean Journal of Radiology
• /
• v.23 no.12
• /
• pp.1290-1300
• /
• 2022

Objective: "Diagnostic yield," also referred to as the detection rate, is a parameter positioned between diagnostic accuracy and diagnosis-related patient outcomes in research studies that assess diagnostic tests. Unfamiliarity with the term may lead to incorrect usage and delivery of information. Herein, we evaluate the level of proper use of the term "diagnostic yield" and its related parameters in articles published in Radiology and Korean Journal of Radiology (KJR). Materials and Methods: Potentially relevant articles published since 2012 in these journals were identified using MEDLINE and PubMed Central databases. The initial search yielded 239 articles. We evaluated whether the correct definition and study setting of "diagnostic yield" or "detection rate" were used and whether the articles also reported companion parameters for false-positive results. We calculated the proportion of articles that correctly used these parameters and evaluated whether the proportion increased with time (2012-2016 vs. 2017-2022). Results: Among 39 eligible articles (19 from Radiology and 20 from KJR), 17 (43.6%; 11 from Radiology and 6 from KJR) correctly defined "diagnostic yield" or "detection rate." The remaining 22 articles used "diagnostic yield" or "detection rate" with incorrect meanings such as "diagnostic performance" or "sensitivity." The proportion of correctly used diagnostic terms was higher in the studies published in Radiology than in those published in KJR (57.9% vs. 30.0%). The proportion improved with time in Radiology (33.3% vs. 80.0%), whereas no improvement was observed in KJR over time (33.3% vs. 27.3%). The proportion of studies reporting companion parameters was similar between journals (72.7% vs. 66.7%), and no considerable improvement was observed over time. Conclusion: Overall, a minority of articles accurately used "diagnostic yield" or "detection rate." Incorrect usage of the terms was more frequent without improvement over time in KJR than in Radiology. Therefore, improvements are required in the use and reporting of these parameters.