• 제목/요약/키워드: area under ROC(AUROC)

검색결과 9건 처리시간 0.019초

Bone Suppression on Chest Radiographs for Pulmonary Nodule Detection: Comparison between a Generative Adversarial Network and Dual-Energy Subtraction

  • Kyungsoo Bae;Dong Yul Oh;Il Dong Yun;Kyung Nyeo Jeon
    • Korean Journal of Radiology
    • /
    • 제23권1호
    • /
    • pp.139-149
    • /
    • 2022
  • Objective: To compare the effects of bone suppression imaging using deep learning (BSp-DL) based on a generative adversarial network (GAN) and bone subtraction imaging using a dual energy technique (BSt-DE) on radiologists' performance for pulmonary nodule detection on chest radiographs (CXRs). Materials and Methods: A total of 111 adults, including 49 patients with 83 pulmonary nodules, who underwent both CXR using the dual energy technique and chest CT, were enrolled. Using CT as a reference, two independent radiologists evaluated CXR images for the presence or absence of pulmonary nodules in three reading sessions (standard CXR, BSt-DE CXR, and BSp-DL CXR). Person-wise and nodule-wise performances were assessed using receiver-operating characteristic (ROC) and alternative free-response ROC (AFROC) curve analyses, respectively. Subgroup analyses based on nodule size, location, and the presence of overlapping bones were performed. Results: BSt-DE with an area under the AFROC curve (AUAFROC) of 0.996 and 0.976 for readers 1 and 2, respectively, and BSp-DL with AUAFROC of 0.981 and 0.958, respectively, showed better nodule-wise performance than standard CXR (AUAFROC of 0.907 and 0.808, respectively; p ≤ 0.005). In the person-wise analysis, BSp-DL with an area under the ROC curve (AUROC) of 0.984 and 0.931 for readers 1 and 2, respectively, showed better performance than standard CXR (AUROC of 0.915 and 0.798, respectively; p ≤ 0.011) and comparable performance to BSt-DE (AUROC of 0.988 and 0.974; p ≥ 0.064). BSt-DE and BSp-DL were superior to standard CXR for detecting nodules overlapping with bones (p < 0.017) or in the upper/middle lung zone (p < 0.017). BSt-DE was superior (p < 0.017) to BSp-DL in detecting peripheral and sub-centimeter nodules. Conclusion: BSp-DL (GAN-based bone suppression) showed comparable performance to BSt-DE and can improve radiologists' performance in detecting pulmonary nodules on CXRs. Nevertheless, for better delineation of small and peripheral nodules, further technical improvements are required.

신용평가모형에서 타당성검증 통계량들의 판단기준 (Criterion of Test Statistics for Validation in Credit Rating Model)

  • 박용석;홍종선;임한승
    • Communications for Statistical Applications and Methods
    • /
    • 제16권2호
    • /
    • pp.239-347
    • /
    • 2009
  • 신용평가모형의 판별력에 대한 검정방법으로 콜모고로프-스미르노프, 평균차이, AUROC, AR등과 같은 통계량이 널리 사용되고 있다. 이러한 통계량들의 판단기준은 정규분포 가정 하에서 평균차이를 기준으로 설정되었다. 본 연구에서는 모의 실험을 통해서 표본크기, 불량률 그리고 제II종 오류율을 고려하는 대안적인 판단기준을 제 안하고 현재 적용되고 있는 판단기준과 비교해본다. 또한 판별력 정도에 따른 각 통계량들의 의미를 10단계로 정의하고 모의 실험 결과와 현재 적용되고 있는 판단기준을 비교해 본다.

Accuracy of various imaging methods for detecting misfit at the tooth-restoration interface in posterior teeth

  • Francio, Luciano Andrei;Silva, Fernanda Evangelista;Valerio, Claudia Scigliano;Cardoso, Claudia Assuncao e Alves;Jansen, Wellington Correa;Manzi, Flavio Ricardo
    • Imaging Science in Dentistry
    • /
    • 제48권2호
    • /
    • pp.87-96
    • /
    • 2018
  • Purpose: The present study aimed to evaluate which of the following imaging methods best assessed misfit at the tooth-restoration interface: (1) bitewing radiographs, both conventional and digital, performed using a photostimulable phosphor plate (PSP) and a charge-coupled device (CCD) system; (2) panoramic radiographs, both conventional and digital; and (3) cone-beam computed tomography (CBCT). Materials and Methods: Forty healthy human molars with class I cavities were selected and divided into 4 groups according to the restoration that was applied: composite resin, composite resin with liner material to simulate misfit, dental amalgam, and dental amalgam with liner material to simulate misfit. Radiography and tomography were performed using the various imaging methods, and the resulting images were analyzed by 2 calibrated radiologists. The true presence or absence of misfit corresponding to an area of radiolucency in regions subjacent to the esthetic and metal restorations was validated with microscopy. The data were analyzed using a receiver operating characteristic (ROC) curve, and the scores were compared using the Cohen kappa coefficient. Results: For bitewing images, the digital systems (CCD and PSP) showed a higher area under the ROC curve (AUROC) for the evaluation of resin restorations, while the conventional images exhibited a larger AUROC for the evaluation of amalgam restorations. Conventional and digital panoramic radiographs did not yield good results for the evaluation of resin and amalgam restorations (P<.05). CBCT images exhibited good results for resin restorations(P>.05), but showed no discriminatory ability for amalgam restorations(P<.05). Conclusion: Bitewing radiographs (conventional or digital) should be the method of choice when assessing dental restoration misfit.

Combination of 18F-Fluorodeoxyglucose PET/CT Radiomics and Clinical Features for Predicting Epidermal Growth Factor Receptor Mutations in Lung Adenocarcinoma

  • Shen Li;Yadi Li;Min Zhao;Pengyuan Wang;Jun Xin
    • Korean Journal of Radiology
    • /
    • 제23권9호
    • /
    • pp.921-930
    • /
    • 2022
  • Objective: To identify epidermal growth factor receptor (EGFR) mutations in lung adenocarcinoma based on 18F-fluorodeoxyglucose (FDG) PET/CT radiomics and clinical features and to distinguish EGFR exon 19 deletion (19 del) and exon 21 L858R missense (21 L858R) mutations using FDG PET/CT radiomics. Materials and Methods: We retrospectively analyzed 179 patients with lung adenocarcinoma. They were randomly assigned to training (n = 125) and testing (n = 54) cohorts in a 7:3 ratio. A total of 2632 radiomics features were extracted from the tumor region of interest from the PET (1316) and CT (1316) images. Six PET/CT radiomics features that remained after the feature selection step were used to calculate the radiomics model score (rad-score). Subsequently, a combined clinical and radiomics model was constructed based on sex, smoking history, tumor diameter, and rad-score. The performance of the combined model in identifying EGFR mutations was assessed using a receiver operating characteristic (ROC) curve. Furthermore, in a subsample of 99 patients, a PET/CT radiomics model for distinguishing 19 del and 21 L858R EGFR mutational subtypes was established, and its performance was evaluated. Results: The area under the ROC curve (AUROC) and accuracy of the combined clinical and PET/CT radiomics models were 0.882 and 81.6%, respectively, in the training cohort and 0.837 and 74.1%, respectively, in the testing cohort. The AUROC and accuracy of the radiomics model for distinguishing between 19 del and 21 L858R EGFR mutational subtypes were 0.708 and 66.7%, respectively, in the training cohort and 0.652 and 56.7%, respectively, in the testing cohort. Conclusion: The combined clinical and PET/CT radiomics model could identify the EGFR mutational status in lung adenocarcinoma with moderate accuracy. However, distinguishing between EGFR 19 del and 21 L858R mutational subtypes was more challenging using PET/CT radiomics.

전립선암 환자의 뼈 전이에 대한 $^{18}F$-Fluoride PET/CT의 유용성 (Usefulness of $^{18}F$-Fluoride PET/CT in Bone Metastasis of Prostate Cancer)

  • 박민수;김정열;박훈희;강천구;임한상;김재삼;이창호
    • 핵의학기술
    • /
    • 제13권3호
    • /
    • pp.24-30
    • /
    • 2009
  • 국내의 암 발생 변화 추이를 고려해보면, 현재 남성에게 발생하는 전립선암의 비중이 나날이 증가하고 있다. 전립선 암의 경우 림프절이나 뼈에 전이가 되면 90% 이상 사망에 이른다. 따라서 최근 핵의학 분야에서는 전립선 암의 뼈 전이를 보다 정확하게 진단하기 위해 여러 영상기법과 방사성 의약품의 개발이 진행, 소개되고 있다. 본 연구에서는 전립선 암세포의 뼈 전이에 대한 보다 정밀한 영상을 획득하여 진단능을 향상시키는 $^{18}F$-Fluoride PET/CT의 유용성을 알아보고자 한다. 본 연구는 총 33명의 전립선암으로 진단된 환자로서, 평균 $67.8{\pm}10.2$세의 남자를 대상으로 하였다. 동일한 환자에게 각각 전신 뼈 검사(Whole Body Bone Scan; WBBS)와 뼈 양전자 방출 컴퓨터 단층 촬영(18F-Fluoride Positron Emission Tomography/Computed Tomography; $^{18}F$-Fluoride PET/CT)을 시행하였으며, 각 검사에서 나타난 병변을 확인하여 ROC곡선(Receiver Operating Characteristic Curve)을 통해 AUROC (The Area Under an ROC)분석하였다. 또한 두 검사의 민감도와 특이도, 양성예측률과 음성예측률 그리고 두 검사의 정확도를 비교 분석하였다. 총 33명 중 22명의 환자(66.6%)에게서 뼈 전이가 있었으며, $^{18}F$-Fluoride PET/CT에서 모두 우수한 결과치가 나타났다. WBBS의 민감도는 63.6%, 특이도는 81.8%였고, $^{18}F$-Fluoride PET/CT에서는 민감도 100%, 특이도 90.9%로 나타났으며, AUROC를 비교한 결과 WBBS에서 0.778, $^{18}F$-Fluoride PET/CT는 0.942로 분석되었다. $^{18}F$-Fluoride PET/CT는 WBBS에 비하여 높은 민감도와 특이도를 보였으며, 3D 영상 구현으로 암세포의 뼈에 대한 전이성 병소를 더욱 정확하고 명확하게 발견할 수 있었다. 또한 WBBS의 장시간 검사에 비하여 $^{18}F$-Fluoride PET/CT는 상대적으로 단시간에 뼈의 생리적인 변화에 대한 정확한 영상을 얻을 수 있어 환자의 불편함을 최소화 할 수 있었다. 고가 검사비용에 대한 부담을 줄일 수 있다면 $^{18}F$-Fluoride PET/CT를 통해 더욱 정확한 영상을 제공하여 임상에서의 진단능을 향상 시킬 수 있을 것으로 사료된다.

  • PDF

Prognostic Accuracy of the Quick Sequential Organ Failure Assessment for Outcomes Among Patients with Trauma in the Emergency Department: A Comparison with the Modified Early Warning Score, Revised Trauma Score, and Injury Severity Score

  • Kang, Min Woo;Ko, Seo Young;Song, Sung Wook;Kim, Woo Jeong;Kang, Young Joon;Kang, Kyeong Won;Park, Hyun Soo;Park, Chang Bae;Kang, Jeong Ho;Bu, Ji Hwan;Lee, Sung Kgun
    • Journal of Trauma and Injury
    • /
    • 제34권1호
    • /
    • pp.3-12
    • /
    • 2021
  • Purpose: To evaluate the severity of trauma, many scoring systems and predictive models have been presented. The quick Sequential Organ Failure Assessment (qSOFA) is a simple scoring system based on vital signs, and we expect it to be easier to apply to trauma patients than other trauma assessment tools. Methods: This study was a cross-sectional study of trauma patients who visited the emergency department of Jeju National University Hospital. We excluded patients under the age of 18 years and unknown outcomes. We calculated the qSOFA, the Modified Early Warning Score (mEWS), Revised Trauma Score (RTS), and Injury Severity Score (ISS) based on patients' initial vital signs and assessments performed in the emergency department (ED). The primary outcome was mortality within 14 days of trauma. We analyzed qSOFA scores using multivariate logistic regression analysis and compared the predictive accuracy of these scoring systems using the area under the receiver operating characteristic curve (AUROC). Results: In total, 27,764 patients were analyzed. In the multivariate logistic regression analysis of the qSOFA, the adjusted odds ratios with 95% confidence interval (CI) for mortality relative to a qSOFA score of 0 were 27.82 (13.63-56.79) for a qSOFA score of 1, 373.31 (183.47-759.57) for a qSOFA score of 2, and 494.07 (143.75-1698.15) for a qSOFA score of 3. In the receiver operating characteristic (ROC) curve analysis for the qSOFA, mEWS, ISS, and RTS in predicting the outcomes, for mortality, the AUROC for the qSOFA (AUROC [95% CI]; 0.912 [0.871-0.952]) was significantly greater than those for the ISS (0.700 [0.608-0.793]) and RTS (0.160 [0.108-0.211]). Conclusions: The qSOFA was useful for predicting the prognosis of trauma patients evaluated in the ED.

Development and Validation of a Model Using Radiomics Features from an Apparent Diffusion Coefficient Map to Diagnose Local Tumor Recurrence in Patients Treated for Head and Neck Squamous Cell Carcinoma

  • Minjae Kim;Jeong Hyun Lee;Leehi Joo;Boryeong Jeong;Seonok Kim;Sungwon Ham;Jihye Yun;NamKug Kim;Sae Rom Chung;Young Jun Choi;Jung Hwan Baek;Ji Ye Lee;Ji-hoon Kim
    • Korean Journal of Radiology
    • /
    • 제23권11호
    • /
    • pp.1078-1088
    • /
    • 2022
  • Objective: To develop and validate a model using radiomics features from apparent diffusion coefficient (ADC) map to diagnose local tumor recurrence in head and neck squamous cell carcinoma (HNSCC). Materials and Methods: This retrospective study included 285 patients (mean age ± standard deviation, 62 ± 12 years; 220 male, 77.2%), including 215 for training (n = 161) and internal validation (n = 54) and 70 others for external validation, with newly developed contrast-enhancing lesions at the primary cancer site on the surveillance MRI following definitive treatment of HNSCC between January 2014 and October 2019. Of the 215 and 70 patients, 127 and 34, respectively, had local tumor recurrence. Radiomics models using radiomics scores were created separately for T2-weighted imaging (T2WI), contrast-enhanced T1-weighted imaging (CE-T1WI), and ADC maps using non-zero coefficients from the least absolute shrinkage and selection operator in the training set. Receiver operating characteristic (ROC) analysis was used to evaluate the diagnostic performance of each radiomics score and known clinical parameter (age, sex, and clinical stage) in the internal and external validation sets. Results: Five radiomics features from T2WI, six from CE-T1WI, and nine from ADC maps were selected and used to develop the respective radiomics models. The area under ROC curve (AUROC) of ADC radiomics score was 0.76 (95% confidence interval [CI], 0.62-0.89) and 0.77 (95% CI, 0.65-0.88) in the internal and external validation sets, respectively. These were significantly higher than the AUROC values of T2WI (0.53 [95% CI, 0.40-0.67], p = 0.006), CE-T1WI (0.53 [95% CI, 0.40-0.67], p = 0.012), and clinical parameters (0.53 [95% CI, 0.39-0.67], p = 0.021) in the external validation set. Conclusion: The radiomics model using ADC maps exhibited higher diagnostic performance than those of the radiomics models using T2WI or CE-T1WI and clinical parameters in the diagnosis of local tumor recurrence in HNSCC following definitive treatment.

초음파를 이용한 간 섬유화 스캔 검사의 융합 탄성도 측정 평가 (Evaluation of convergence Elasticity of Liver Fibroscan used measurement with Ultrasonography)

  • 김민정;한만석;장재욱
    • 한국융합학회논문지
    • /
    • 제8권5호
    • /
    • pp.79-85
    • /
    • 2017
  • 본 연구는 만성 B형 바이러스성 감염 환자의 간 기능 혈액 검사 수치와 간 섬유화 스캔 검사(FibroScan(R))의 비교 분석을 통한 간 섬유화 스캔 검사의 임상적, 기기적 융합 유용성을 평가하고자 하였다. 2015년 7월 1일부터 2016년 2월 28일까지 대전시 B내과에 내원한 만성 B형 바이러스성 감염 환자 75명의 간 섬유화 스캔 검사 결과와 간 기능 혈액검사 수치를 분석 하고 ROC곡선을 작성하였다. 알라닌 아미노전이요소, 아스파르테이트 아미노전이요소 수치가 각각 0.572, 0.502로 섬유화 수치와 가장 높은 상관관계를 보였다(p<0.000). 감마지티피, 총 빌리루빈, 알칼리성 인산분해효소 수치도 비교적 유의한 상관관계를 보였으나 알파태아단백과 총 단백정량은 통계적으로 유의하지 않았다. 또한 알부민(-0.449)과 혈소판치(-0.373)도 섬유화 수치와 상관관계가 없었다(p<0.000). 간 섬유화 정도가 높은 등급일수록 ROC 곡선의 정확도가 증가하였으며 F4의 간 경변 단계에서 가장 큰 AUROC값을 나타냈다. 따라서 간 섬유화 스캔 검사는 만성 간질환 환자의 간 기능 수치인 알라닌 아미노전이요소, 아스파르테이트 아미노전이요소 수치와 유의한 상관관계를 보여 간의 염증 검사 및 만성 간질환 진단에 매우 유용한 것으로 판단된다.

Two-Dimensional Shear Wave Elastography Predicts Liver Fibrosis in Jaundiced Infants with Suspected Biliary Atresia: A Prospective Study

  • Huadong Chen;Luyao Zhou;Bing Liao;Qinghua Cao;Hong Jiang;Wenying Zhou;Guotao Wang;Xiaoyan Xie
    • Korean Journal of Radiology
    • /
    • 제22권6호
    • /
    • pp.959-969
    • /
    • 2021
  • Objective: This study aimed to evaluate the role of preoperative two-dimensional (2D) shear wave elastography (SWE) in assessing the stages of liver fibrosis in patients with suspected biliary atresia (BA) and compared its diagnostic performance with those of serum fibrosis biomarkers. Materials and Methods: This study was approved by the ethical committee, and written informed parental consent was obtained. Two hundred and sixteen patients were prospectively enrolled between January 2012 and October 2018. The 2D SWE measurements of 69 patients have been previously reported. 2D SWE measurements, serum fibrosis biomarkers, including fibrotic markers and biochemical test results, and liver histology parameters were obtained. 2D SWE values, serum biomarkers including, aspartate aminotransferase to platelet ratio index (APRi), and other serum fibrotic markers were correlated with the stages of liver fibrosis by METAVIR. Receiver operating characteristic (ROC) curves and area under the ROC (AUROC) curve analyses were used. Results: The correlation coefficient of 2D SWE value in correlation with the stages of liver fibrosis was 0.789 (p < 0.001). The cut-off values of 2D SWE were calculated as 9.1 kPa for F1, 11.6 kPa for F2, 13.0 kPa for F3, and 15.7 kPa for F4. The AUROCs of 2D SWE in the determination of the stages of liver fibrosis ranged from 0.869 to 0.941. The sensitivity and negative predictive value of 2D SWE in the diagnosis of ≥ F3 was 93.4% and 96.0%, respectively. The diagnostic performance of 2D SWE was superior to that of APRi and other serum fibrotic markers in predicting severe fibrosis and cirrhosis (all p < 0.005) and other serum biomarkers. Multivariate analysis showed that the 2D SWE value was the only statistically significant parameter for predicting liver fibrosis. Conclusion: 2D SWE is a more effective non-invasive tool for predicting the stage of liver fibrosis in patients with suspected BA, compared with serum fibrosis biomarkers.