• Title/Summary/Keyword: Characteristic curve

Search Result 1,498, Processing Time 0.025 seconds

Deep Learning-Assisted Diagnosis of Pediatric Skull Fractures on Plain Radiographs

  • Jae Won Choi;Yeon Jin Cho;Ji Young Ha;Yun Young Lee;Seok Young Koh;June Young Seo;Young Hun Choi;Jung-Eun Cheon;Ji Hoon Phi;Injoon Kim;Jaekwang Yang;Woo Sun Kim
    • Korean Journal of Radiology
    • /
    • v.23 no.3
    • /
    • pp.343-354
    • /
    • 2022
  • Objective: To develop and evaluate a deep learning-based artificial intelligence (AI) model for detecting skull fractures on plain radiographs in children. Materials and Methods: This retrospective multi-center study consisted of a development dataset acquired from two hospitals (n = 149 and 264) and an external test set (n = 95) from a third hospital. Datasets included children with head trauma who underwent both skull radiography and cranial computed tomography (CT). The development dataset was split into training, tuning, and internal test sets in a ratio of 7:1:2. The reference standard for skull fracture was cranial CT. Two radiology residents, a pediatric radiologist, and two emergency physicians participated in a two-session observer study on an external test set with and without AI assistance. We obtained the area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity along with their 95% confidence intervals (CIs). Results: The AI model showed an AUROC of 0.922 (95% CI, 0.842-0.969) in the internal test set and 0.870 (95% CI, 0.785-0.930) in the external test set. The model had a sensitivity of 81.1% (95% CI, 64.8%-92.0%) and specificity of 91.3% (95% CI, 79.2%-97.6%) for the internal test set and 78.9% (95% CI, 54.4%-93.9%) and 88.2% (95% CI, 78.7%-94.4%), respectively, for the external test set. With the model's assistance, significant AUROC improvement was observed in radiology residents (pooled results) and emergency physicians (pooled results) with the difference from reading without AI assistance of 0.094 (95% CI, 0.020-0.168; p = 0.012) and 0.069 (95% CI, 0.002-0.136; p = 0.043), respectively, but not in the pediatric radiologist with the difference of 0.008 (95% CI, -0.074-0.090; p = 0.850). Conclusion: A deep learning-based AI model improved the performance of inexperienced radiologists and emergency physicians in diagnosing pediatric skull fractures on plain radiographs.

Use of Artificial Intelligence for Reducing Unnecessary Recalls at Screening Mammography: A Simulation Study

  • Yeon Soo Kim;Myoung-jin Jang;Su Hyun Lee;Soo-Yeon Kim;Su Min Ha;Bo Ra Kwon;Woo Kyung Moon;Jung Min Chang
    • Korean Journal of Radiology
    • /
    • v.23 no.12
    • /
    • pp.1241-1250
    • /
    • 2022
  • Objective: To conduct a simulation study to determine whether artificial intelligence (AI)-aided mammography reading can reduce unnecessary recalls while maintaining cancer detection ability in women recalled after mammography screening. Materials and Methods: A retrospective reader study was performed by screening mammographies of 793 women (mean age ± standard deviation, 50 ± 9 years) recalled to obtain supplemental mammographic views regarding screening mammography-detected abnormalities between January 2016 and December 2019 at two screening centers. Initial screening mammography examinations were interpreted by three dedicated breast radiologists sequentially, case by case, with and without AI aid, in a single session. The area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and recall rate for breast cancer diagnosis were obtained and compared between the two reading modes. Results: Fifty-four mammograms with cancer (35 invasive cancers and 19 ductal carcinomas in situ) and 739 mammograms with benign or negative findings were included. The reader-averaged AUC improved after AI aid, from 0.79 (95% confidence interval [CI], 0.74-0.85) to 0.89 (95% CI, 0.85-0.94) (p < 0.001). The reader-averaged specificities before and after AI aid were 41.9% (95% CI, 39.3%-44.5%) and 53.9% (95% CI, 50.9%-56.9%), respectively (p < 0.001). The reader-averaged sensitivity was not statistically different between AI-unaided and AI-aided readings: 89.5% (95% CI, 83.1%-95.9%) vs. 92.6% (95% CI, 86.2%-99.0%) (p = 0.053), although the sensitivities of the least experienced radiologists before and after AI aid were 79.6% (43 of 54 [95% CI, 66.5%-89.4%]) and 90.7% (49 of 54 [95% CI, 79.7%-96.9%]), respectively (p = 0.031). With AI aid, the reader-averaged recall rate decreased by from 60.4% (95% CI, 57.8%-62.9%) to 49.5% (95% CI, 46.5%-52.4%) (p < 0.001). Conclusion: AI-aided reading reduced the number of recalls and improved the diagnostic performance in our simulation using women initially recalled for supplemental mammographic views after mammography screening.

99mTc-3PRGD2 SPECT/CT Imaging for Diagnosing Lymph Node Metastasis of Primary Malignant Lung Tumors

  • Liming Xiao;Shupeng Yu;Weina Xu;Yishan Sun;Jun Xin
    • Korean Journal of Radiology
    • /
    • v.24 no.11
    • /
    • pp.1142-1150
    • /
    • 2023
  • Objective: To evaluate 99mtechnetium-three polyethylene glycol spacers-arginine-glycine-aspartic acid (99mTc-3PRGD2) single-photon emission computed tomography (SPECT)/computed tomography (CT) imaging for diagnosing lymph node metastasis of primary malignant lung neoplasms. Materials and Methods: We prospectively enrolled 26 patients with primary malignant lung tumors who underwent 99mTc-3PRGD2 SPECT/CT and 18F-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)/CT imaging. Both imaging methods were analyzed in qualitative (visual dichotomous and 5-point grades for lymph nodes and lung tumors, respectively) and semiquantitative (maximum tissue-to-background radioactive count) manners for the lymph nodes and lung tumors. The performance of the differentiation of lymph nodes with and without metastasis was determined at the per-lymph node station and per-patient levels using histopathological results as the reference standard. Results: Total 42 stations had metastatic lymph nodes and 136 stations had benign lymph nodes. The differences between metastatic and benign lymph nodes in the visual qualitative and semiquantitative analyses of 99mTc-3PRGD2 SPECT/CT and 18F-FDG PET/CT were statistically significant (all P < 0.001). The area under the receiver operating characteristic curve (AUC) in the semi-quantitative analysis of 99mTc-3PRGD2 SPECT/CT was 0.908 (95% confidence interval [CI], 0.851-0.966), and the sensitivity, specificity, positive predictive value, and negative predictive value were 0.86 (36/42), 0.88 (120/136), 0.69 (36/52), and 0.95 (120/126), respectively. Among the 26 patients (including two patients each with two lung tumors), 15 had pathologically confirmed lymph node metastasis. The difference between primary lung lesions in patients with and without lymph node metastasis was statistically significant only in the semi-quantitative analysis of 99mTc-3PRGD2 SPECT/CT (P = 0.007), with an AUC of 0.807 (95% CI, 0.641-0.974). Conclusion: 99mTc-3PRGD2 SPECT/CT imaging may notably perform in the direct diagnosis of lymph node metastasis of primary malignant lung tumors and indirectly predict the presence of lymph node metastasis through uptake in the primary lesions.

Comparison of miR-106b, miR-191, and miR-30d expression dynamics in milk with regard to its composition in Holstein and Ayrshire cows

  • Marina V. Pozovnikova;Viktoria B. Leibova;Olga V. Tulinova;Elena A. Romanova;Artem P. Dysin;Natalia V. Dementieva;Anastasiia I. Azovtseva;Sergey E. Sedykh
    • Animal Bioscience
    • /
    • v.37 no.6
    • /
    • pp.965-981
    • /
    • 2024
  • Objective: Milk composition varies considerably and depends on paratypical, genetic, and epigenetic factors. MiRNAs belong to the class of small non-coding RNAs; they are one of the key tools of epigenetic control because of their ability to regulate gene expression at the post-transcriptional level. We compared the relative expression levels of miR-106b, miR-191, and miR-30d in milk to demonstrate the relationship between the content of these miRNAs with protein and fat components of milk in Holstein and Ayrshire cattle. Methods: Milk fat, protein, and casein contents were determined in the obtained samples, as well as the content of the main fatty acids (g/100 g milk), including: saturated acids, such as myristic (C14:0), palmitic (C16:0), and stearic (C18:0) acids; monounsaturated acids, including oleic (C18:1) acid; as well as long-, medium- and short-chain, polyunsaturated, and trans fatty acids. Real-time stem-loop one-tube reverse transcription polymerase chain reaction with TaqMan probes was used to measure the miRNA expression levels. Results: The miRNA expression levels in milk samples were found to be decreased in the first two months in Holstein breed, and in the first four months in Ayrshire breed. Correlation analysis did not reveal any dependence between changes in the expression level of miRNA and milk fat content, but showed a multidirectional relationship with individual milk fatty acids. Positive associations between the expression levels of miR-106b and miR-30d and protein and casein content were found in the Ayrshire breed. Receiver operating characteristic curve analysis showed that miR-106b and miR-30d expression levels can cause changes in fatty acid and protein composition of milk in Ayrshire cows, whereas miR-106b expression level determines the fatty acid composition in Holsteins. Conclusion: The data obtained in this study showed that miR-106b, miR-191, and miR-30d expression levels in milk samples have peculiarities associated with breed affiliation and the lactation period.

Comparison of One- and Two-Region of Interest Strain Elastography Measurements in the Differential Diagnosis of Breast Masses

  • Hee Jeong Park;Sun Mi Kim;Bo La Yun;Mijung Jang;Bohyoung Kim;Soo Hyun Lee;Hye Shin Ahn
    • Korean Journal of Radiology
    • /
    • v.21 no.4
    • /
    • pp.431-441
    • /
    • 2020
  • Objective: To compare the diagnostic performance and interobserver variability of strain ratio obtained from one or two regions of interest (ROI) on breast elastography. Materials and Methods: From April to May 2016, 140 breast masses in 140 patients who underwent conventional ultrasonography (US) with strain elastography followed by US-guided biopsy were evaluated. Three experienced breast radiologists reviewed recorded US and elastography images, measured strain ratios, and categorized them according to the American College of Radiology breast imaging reporting and data system lexicon. Strain ratio was obtained using the 1-ROI method (one ROI drawn on the target mass), and the 2-ROI method (one ROI in the target mass and another in reference fat tissue). The diagnostic performance of the three radiologists among datasets and optimal cut-off values for strain ratios were evaluated. Interobserver variability of strain ratio for each ROI method was assessed using intraclass correlation coefficient values, Bland-Altman plots, and coefficients of variation. Results: Compared to US alone, US combined with the strain ratio measured using either ROI method significantly improved specificity, positive predictive value, accuracy, and area under the receiver operating characteristic curve (AUC) (all p values < 0.05). Strain ratio obtained using the 1-ROI method showed higher interobserver agreement between the three radiologists without a significant difference in AUC for differentiating breast cancer when the optimal strain ratio cut-off value was used, compared with the 2-ROI method (AUC: 0.788 vs. 0.783, 0.693 vs. 0.715, and 0.691 vs. 0.686, respectively, all p values > 0.05). Conclusion: Strain ratios obtained using the 1-ROI method showed higher interobserver agreement without a significant difference in AUC, compared to those obtained using the 2-ROI method. Considering that the 1-ROI method can reduce performers' efforts, it could have an important role in improving the diagnostic performance of breast US by enabling consistent management of breast lesions.

Differentiation between Clear Cell Sarcoma of the Kidney and Wilms' Tumor with CT

  • Choeum Kang;Hyun Joo Shin;Haesung Yoon;Jung Woo Han;Chuhl Joo Lyu;Mi-Jung Lee
    • Korean Journal of Radiology
    • /
    • v.22 no.7
    • /
    • pp.1185-1193
    • /
    • 2021
  • Objective: Clear cell sarcoma of the kidney (CCSK) is the second-most common but extremely rare primary renal malignancy in children after Wilms' tumor. The aims of this study were to evaluate the imaging features that could distinguish between CCSK and Wilms' tumor and to assess the features with diagnostic value for identifying CCSK. Materials and Methods: We reviewed the initial contrast-enhanced abdominal-pelvic CT scans of children with CCSK and Wilms' tumor between 2010 to 2019. Fifty-eight children (32 males and 26 females; age, 0.3-10 years), 7 with CCSK, and 51 with Wilms' tumor, were included. The maximum tumor diameter, presence of engorged perinephric vessels, maximum density of the tumor (Tmax) of the enhancing solid portion, paraspinal muscle, contralateral renal vein density, and density ratios (Tmax/muscle and Tmax/vein) were analyzed on the renal parenchymal phase of contrast-enhanced CT. Fisher's exact tests and Mann-Whitney U tests were conducted to analyze the categorical and continuous variables, respectively. Logistic regression and receiver operating characteristic curve analyses were also performed. Results: The age, sex, and tumor diameter did not differ between the two groups. Engorged perinephric vessels were more common in patients in the CCSK group (71% [5/7] vs. 16% [8/51], p = 0.005). Tmax (median, 148.0 vs. 111.0 Hounsfield unit, p = 0.004), Tmax/muscle (median, 2.64 vs. 1.67, p = 0.002), and Tmax/vein (median, 0.94 vs. 0.59, p = 0.002) were higher in the CCSK compared to the Wilms' group. Multiple logistic regression revealed that engorged vessels (odds ratio 13.615; 95% confidence interval [CI], 1.770-104.730) and Tmax/muscle (odds ratio 5.881; 95% CI, 1.337-25.871) were significant predictors of CCSK. The cutoff values of Tmax/muscle (86% sensitivity, 77% specificity) and Tmax/vein (71% sensitivity, 86% specificity) for the diagnosis of CCSK were 1.97 and 0.76, respectively. Conclusion: Perinephric vessel engorgement and greater tumor enhancement (Tmax/muscle > 1.97 or Tmax/vein > 0.76) are helpful for differentiating between CCSK and Wilms' tumor in children aged below 10 years.

Machine Learning-Based Prediction of COVID-19 Severity and Progression to Critical Illness Using CT Imaging and Clinical Data

  • Subhanik Purkayastha;Yanhe Xiao;Zhicheng Jiao;Rujapa Thepumnoeysuk;Kasey Halsey;Jing Wu;Thi My Linh Tran;Ben Hsieh;Ji Whae Choi;Dongcui Wang;Martin Vallieres;Robin Wang;Scott Collins;Xue Feng;Michael Feldman;Paul J. Zhang;Michael Atalay;Ronnie Sebro;Li Yang;Yong Fan;Wei-hua Liao;Harrison X. Bai
    • Korean Journal of Radiology
    • /
    • v.22 no.7
    • /
    • pp.1213-1224
    • /
    • 2021
  • Objective: To develop a machine learning (ML) pipeline based on radiomics to predict Coronavirus Disease 2019 (COVID-19) severity and the future deterioration to critical illness using CT and clinical variables. Materials and Methods: Clinical data were collected from 981 patients from a multi-institutional international cohort with real-time polymerase chain reaction-confirmed COVID-19. Radiomics features were extracted from chest CT of the patients. The data of the cohort were randomly divided into training, validation, and test sets using a 7:1:2 ratio. A ML pipeline consisting of a model to predict severity and time-to-event model to predict progression to critical illness were trained on radiomics features and clinical variables. The receiver operating characteristic area under the curve (ROC-AUC), concordance index (C-index), and time-dependent ROC-AUC were calculated to determine model performance, which was compared with consensus CT severity scores obtained by visual interpretation by radiologists. Results: Among 981 patients with confirmed COVID-19, 274 patients developed critical illness. Radiomics features and clinical variables resulted in the best performance for the prediction of disease severity with a highest test ROC-AUC of 0.76 compared with 0.70 (0.76 vs. 0.70, p = 0.023) for visual CT severity score and clinical variables. The progression prediction model achieved a test C-index of 0.868 when it was based on the combination of CT radiomics and clinical variables compared with 0.767 when based on CT radiomics features alone (p < 0.001), 0.847 when based on clinical variables alone (p = 0.110), and 0.860 when based on the combination of visual CT severity scores and clinical variables (p = 0.549). Furthermore, the model based on the combination of CT radiomics and clinical variables achieved time-dependent ROC-AUCs of 0.897, 0.933, and 0.927 for the prediction of progression risks at 3, 5 and 7 days, respectively. Conclusion: CT radiomics features combined with clinical variables were predictive of COVID-19 severity and progression to critical illness with fairly high accuracy.

Prediction of Patient Management in COVID-19 Using Deep Learning-Based Fully Automated Extraction of Cardiothoracic CT Metrics and Laboratory Findings

  • Thomas Weikert;Saikiran Rapaka;Sasa Grbic;Thomas Re;Shikha Chaganti;David J. Winkel;Constantin Anastasopoulos;Tilo Niemann;Benedikt J. Wiggli;Jens Bremerich;Raphael Twerenbold;Gregor Sommer;Dorin Comaniciu;Alexander W. Sauter
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.994-1004
    • /
    • 2021
  • Objective: To extract pulmonary and cardiovascular metrics from chest CTs of patients with coronavirus disease 2019 (COVID-19) using a fully automated deep learning-based approach and assess their potential to predict patient management. Materials and Methods: All initial chest CTs of patients who tested positive for severe acute respiratory syndrome coronavirus 2 at our emergency department between March 25 and April 25, 2020, were identified (n = 120). Three patient management groups were defined: group 1 (outpatient), group 2 (general ward), and group 3 (intensive care unit [ICU]). Multiple pulmonary and cardiovascular metrics were extracted from the chest CT images using deep learning. Additionally, six laboratory findings indicating inflammation and cellular damage were considered. Differences in CT metrics, laboratory findings, and demographics between the patient management groups were assessed. The potential of these parameters to predict patients' needs for intensive care (yes/no) was analyzed using logistic regression and receiver operating characteristic curves. Internal and external validity were assessed using 109 independent chest CT scans. Results: While demographic parameters alone (sex and age) were not sufficient to predict ICU management status, both CT metrics alone (including both pulmonary and cardiovascular metrics; area under the curve [AUC] = 0.88; 95% confidence interval [CI] = 0.79-0.97) and laboratory findings alone (C-reactive protein, lactate dehydrogenase, white blood cell count, and albumin; AUC = 0.86; 95% CI = 0.77-0.94) were good classifiers. Excellent performance was achieved by a combination of demographic parameters, CT metrics, and laboratory findings (AUC = 0.91; 95% CI = 0.85-0.98). Application of a model that combined both pulmonary CT metrics and demographic parameters on a dataset from another hospital indicated its external validity (AUC = 0.77; 95% CI = 0.66-0.88). Conclusion: Chest CT of patients with COVID-19 contains valuable information that can be accessed using automated image analysis. These metrics are useful for the prediction of patient management.

Two-Dimensional Shear Wave Elastography Predicts Liver Fibrosis in Jaundiced Infants with Suspected Biliary Atresia: A Prospective Study

  • Huadong Chen;Luyao Zhou;Bing Liao;Qinghua Cao;Hong Jiang;Wenying Zhou;Guotao Wang;Xiaoyan Xie
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.959-969
    • /
    • 2021
  • Objective: This study aimed to evaluate the role of preoperative two-dimensional (2D) shear wave elastography (SWE) in assessing the stages of liver fibrosis in patients with suspected biliary atresia (BA) and compared its diagnostic performance with those of serum fibrosis biomarkers. Materials and Methods: This study was approved by the ethical committee, and written informed parental consent was obtained. Two hundred and sixteen patients were prospectively enrolled between January 2012 and October 2018. The 2D SWE measurements of 69 patients have been previously reported. 2D SWE measurements, serum fibrosis biomarkers, including fibrotic markers and biochemical test results, and liver histology parameters were obtained. 2D SWE values, serum biomarkers including, aspartate aminotransferase to platelet ratio index (APRi), and other serum fibrotic markers were correlated with the stages of liver fibrosis by METAVIR. Receiver operating characteristic (ROC) curves and area under the ROC (AUROC) curve analyses were used. Results: The correlation coefficient of 2D SWE value in correlation with the stages of liver fibrosis was 0.789 (p < 0.001). The cut-off values of 2D SWE were calculated as 9.1 kPa for F1, 11.6 kPa for F2, 13.0 kPa for F3, and 15.7 kPa for F4. The AUROCs of 2D SWE in the determination of the stages of liver fibrosis ranged from 0.869 to 0.941. The sensitivity and negative predictive value of 2D SWE in the diagnosis of ≥ F3 was 93.4% and 96.0%, respectively. The diagnostic performance of 2D SWE was superior to that of APRi and other serum fibrotic markers in predicting severe fibrosis and cirrhosis (all p < 0.005) and other serum biomarkers. Multivariate analysis showed that the 2D SWE value was the only statistically significant parameter for predicting liver fibrosis. Conclusion: 2D SWE is a more effective non-invasive tool for predicting the stage of liver fibrosis in patients with suspected BA, compared with serum fibrosis biomarkers.

Development and Validation of a Simple Index Based on Non-Enhanced CT and Clinical Factors for Prediction of Non-Alcoholic Fatty Liver Disease

  • Yura Ahn;Sung-Cheol Yun;Seung Soo Lee;Jung Hee Son;Sora Jo;Jieun Byun;Yu Sub Sung;Ho Sung Kim;Eun Sil Yu
    • Korean Journal of Radiology
    • /
    • v.21 no.4
    • /
    • pp.413-421
    • /
    • 2020
  • Objective: A widely applicable, non-invasive screening method for non-alcoholic fatty liver disease (NAFLD) is needed. We aimed to develop and validate an index combining computed tomography (CT) and routine clinical data for screening for NAFLD in a large cohort of adults with pathologically proven NAFLD. Materials and Methods: This retrospective study included 2218 living liver donors who had undergone liver biopsy and CT within a span of 3 days. Donors were randomized 2:1 into development and test cohorts. CTL-S was measured by subtracting splenic attenuation from hepatic attenuation on non-enhanced CT. Multivariable logistic regression analysis of the development cohort was utilized to develop a clinical-CT index predicting pathologically proven NAFLD. The diagnostic performance was evaluated by analyzing the areas under the receiver operating characteristic curve (AUC). The cutoffs for the clinical-CT index were determined for 90% sensitivity and 90% specificity in the development cohort, and their diagnostic performance was evaluated in the test cohort. Results: The clinical-CT index included CTL-S, body mass index, and aspartate transaminase and triglyceride concentrations. In the test cohort, the clinical-CT index (AUC, 0.81) outperformed CTL-S (0.74; p < 0.001) and clinical indices (0.73-0.75; p < 0.001) in diagnosing NAFLD. A cutoff of ≥ 46 had a sensitivity of 89% and a specificity of 41%, whereas a cutoff of ≥ 56.5 had a sensitivity of 57% and a specificity of 89%. Conclusion: The clinical-CT index is more accurate than CTL-S and clinical indices alone for the diagnosis of NAFLD and may be clinically useful in screening for NAFLD.