• Title/Summary/Keyword: Diagnostic radiology, observer performance

Search Result 10, Processing Time 0.023 seconds

Effect of LCD monitor type and observer experience on diagnostic performance in soft-copy interpretations of the maxillary sinus on panoramic radiographs

  • Kim, Tae-Young;Choi, Jin-Woo;Lee, Sam-Sun;Huh, Kyung-Hoe;Yi, Won-Jin;Heo, Min-Suk;Choi, Soon-Chul
    • Imaging Science in Dentistry
    • /
    • v.41 no.1
    • /
    • pp.11-16
    • /
    • 2011
  • Purpose : The aim of this study was to evaluate the effect of liquid crystal display (LCD) monitor type and observer experience on the diagnostic performance in soft-copy interpretations of maxillary sinus inflammatory lesions on panoramic radiographs. Materials and Methods : Ninety maxillary sinuses on panoramic images were grouped into negative and positive groups according to the presence of inflammatory lesions, using CT for confirmation. Monochrome and color LCDs were used. Six observers participated and ROC analysis was performed to evaluate the diagnostic performance. The reading time, fatigue score, and inter-/intra-observer agreements were assessed. Results : The interpretation of maxillary sinus inflammatory lesions was affected by the LCD monitor type used and by the experience of the observer. The reading time was not significantly different, however the fatigue score was significantly different between two LCD monitors. Inter-observer agreement was relatively good in experienced observers, while the intra-observer agreement for all observers was good with monochrome LCD but not with color LCD. Conclusion : The less experienced observers showed lowered diagnostic ability with a general color LCD.

Effects of 1 year of training on the performance of ultrasonographic image interpretation: A preliminary evaluation using images of Sjogren syndrome patients

  • Kise, Yoshitaka;Moystad, Anne;Bjornland, Tore;Shimizu, Mayumi;Ariji, Yoshiko;Kuwada, Chiaki;Nishiyama, Masako;Funakoshi, Takuma;Yoshiura, Kazunori;Ariji, Eiichiro
    • Imaging Science in Dentistry
    • /
    • v.51 no.2
    • /
    • pp.129-136
    • /
    • 2021
  • Purpose: This study investigated the effects of 1 year of training on imaging diagnosis, using static ultrasonography (US) salivary gland images of Sjögren syndrome patients. Materials and Methods: This study involved 3 inexperienced radiologists with different levels of experience, who received training 1 or 2 days a week under the supervision of experienced radiologists. The training program included collecting patient histories and performing physical and imaging examinations for various maxillofacial diseases. The 3 radiologists (observers A, B, and C) evaluated 400 static US images of salivary glands twice at a 1-year interval. To compare their performance, 2 experienced radiologists evaluated the same images. Diagnostic performance was compared between the 2 evaluations using the area under the receiver operating characteristic curve (AUC). Results: Observer A, who was participating in the training program for the second year, exhibited no significant difference in AUC between the first and second evaluations, with results consistently comparable to those of experienced radiologists. After 1 year of training, observer B showed significantly higher AUCs than before training. The diagnostic performance of observer B reached the level of experienced radiologists for parotid gland assessment, but differed for submandibular gland assessment. For observer C, who did not complete the training, there was no significant difference in the AUC between the first and second evaluations, both of which showed significant differences from those of the experienced radiologists. Conclusion: These preliminary results suggest that the training program effectively helped inexperienced radiologists reach the level of experienced radiologists for US examinations.

Diagnostic performance of dental students in identifying mandibular condyle fractures by panoramic radiography and the usefulness of reference images

  • Cho, Bong-Hae
    • Imaging Science in Dentistry
    • /
    • v.41 no.2
    • /
    • pp.53-57
    • /
    • 2011
  • Purpose : The purpose of this study was to evaluate the diagnostic performance of dental students in detection of mandibular condyle fractures and the effectiveness of reference panoramic images. Materials and Methods : Forty-six undergraduates evaluated 25 panoramic radiographs for condylar fractures and the data were analyzed through receiver operating characteristic (ROC) analysis. After a month, they were divided into two homogeneous groups based on the first results and re-evaluated the images with (group A) or without (group B) reference images. Eight reference images included indications showing either typical condylar fractures or anatomic structures which could be confused with fractures. Paired t-test was used for statistical analysis of the difference between the first and the second evaluations for each group, and student�fs t-test was used between the two groups in the second evaluation. The intra- and inter-observer agreements were evaluated with Kappa statistics. Results : Intra- and inter-observer agreements were substantial (k=0.66) and moderate (k=0.53), respectively. The area under the ROC curve (Az) in the first evaluation was 0.802. In the second evaluation, it was increased to 0.823 for group A and 0.814 for group B. The difference between the first and second evaluations for group A was statistically significant (p<0.05), however there was no statistically significant difference between the two groups in the second evaluation. Conclusion : Providing reference images to less experienced clinicians would be a good way to improve the diagnostic ability in detecting condylar fracture.

Comparison of the diagnostic performance of panoramic and occlusal radiographs in detecting submandibular sialoliths

  • Kim, Jun Ho;Aoki, Eduardo Massaharu;Cortes, Arthur Rodriguez Gonzalez;Abdala-Junior, Reinaldo;Asaumi, Junichi;Arita, Emiko Saito
    • Imaging Science in Dentistry
    • /
    • v.46 no.2
    • /
    • pp.87-92
    • /
    • 2016
  • Purpose: The aim of this study was to assess and compare the diagnostic performance of panoramic and occlusal radiographs in detecting submandibular sialoliths. Materials and Methods: A total of 40 patients (20 cases and 20 controls) were included in this retrospective study. Cases were defined as subjects with a submandibular sialolith confirmed by computed tomography (CT), whereas controls did not have any submandibular calcifications. Three observers with different expertise levels assessed panoramic and occlusal radiographs of all subjects for the presence of sialoliths. Intraobserver and interobserver agreement were assessed using the kappa test. Sensitivity, specificity, accuracy, positive and negative predictive values, and the diagnostic odds ratio of panoramic and occlusal radiographs in screening for submandibular sialoliths were calculated for each observer. Results: The sensitivity and specificity values for occlusal and panoramic radiographs all ranged from 80% to 100%. The lowest values of sensitivity and specificity observed among the observers were 82.6% and 80%, respectively (P=0.001). Intraobserver and interobserver agreement were higher for occlusal radiographs than for panoramic radiographs, although panoramic radiographs demonstrated a higher overall accuracy. Conclusion: Both panoramic and occlusal radiographic techniques displayed satisfactory diagnostic performance and should be considered before using a CT scan to detect submandibular sialoliths.

Comparative Study between ZOOMit and Conventional Intravoxel Incoherent Motion MRI for Assessing Parotid Gland Abnormalities in Patients with Early- or Mid-Stage Sjögren's Syndrome

  • Qing-Qing Zhou;Wei Zhang;Yu-Sheng Yu;Hong-Yan Li;Liang Wei;Xue-Song Li;Zhen-Zhen He;Hong Zhang
    • Korean Journal of Radiology
    • /
    • v.23 no.4
    • /
    • pp.455-465
    • /
    • 2022
  • Objective: To compare the reproducibility and performance of quantitative metrics between ZOOMit and conventional intravoxel incoherent motion (IVIM) magnetic resonance imaging (MRI) in the diagnosis of early- and mid-stage Sjögren's syndrome (SS). Materials and Methods: Twenty-two patients (mean age ± standard deviation, 52.0 ± 10.8 years; male:female, 2:20) with early- or mid-stage SS and 20 healthy controls (46.9 ± 14.6 years; male:female, 7:13) were prospectively enrolled in our study. ZOOMit IVIM and conventional IVIM MRI were performed simultaneously in all individuals using a 3T scanner. Quantitative IVIM parameters - including tissue diffusivity (D), pseudodiffusion coefficient (D*), and perfusion fraction (f) - inter- and intra-observer reproducibility in measuring these parameters, and their ability to distinguish patients with SS from healthy individuals were assessed and compared between ZOOMit IVIM and conventional IVIM methods, appropriately. MR gland nodular grade (MRG) was also examined. Results: Inter- and intra-observer reproducibility was better with ZOOMit imaging than with conventional IVIM imaging (ZOOMit vs. conventional, intraclass correlation coefficient of 0.897-0.941 vs. 0.667-0.782 for inter-observer reproducibility and 0.891-0.968 vs. 0.814-0.853 for intra-observer reproducibility). Significant differences in ZOOMit f, ZOOMit D*, D*, conventional D*, and MRG between patients with SS and healthy individuals (all p < 0.05) were observed. ZOOMit D* outperformed conventional D* in diagnosing early- and mid-stage SS (area under receiver operating curve, 0.867 and 0.658, respectively; p = 0.002). The combination of ZOOMit D*, MRG, and ZOOMit f as a new diagnostic index for SS, increased diagnostic area under the curve to 0.961, which was higher than that of any single parameter (all p < 0.01). Conclusion: Considering its better reproducibility and performance, ZOOMit IVIM may be preferred over conventional IVIM MRI, and may subsequently improve the ability to diagnose early- and mid-stage SS.

Diagnostic performance of stitched and non-stitched cross-sectional cone-beam computed tomography images of a non-displaced fracture of ovine mandibular bone

  • Farzane Ostovarrad;Sadra Masali Markiyeh;Zahra Dalili Kajan
    • Imaging Science in Dentistry
    • /
    • v.53 no.4
    • /
    • pp.375-381
    • /
    • 2023
  • Purpose: This study assessed the diagnostic performance of stitched and non-stitched cross-sectional cone-beam computed tomography (CBCT) images of non-displaced ovine mandibular fractures. Materials and Methods: In this ex vivo study, non-displaced fractures were artificially created in 10 ovine mandibles (20 hemi-mandibles) using a hammer. The control group comprised 8 hemi-mandibles. The non-displaced fracture lines were oblique or vertical, <0.5 mm wide, 10-20 mm long, and only in the buccal or lingual cortex. Fracture lines in the ramus and posterior mandible were created to be at the interface or borders of the 2 stitched images. CBCT images were obtained from the specimens with an 80 mm×80 mm field of view before and after fracture induction. OnDemand software (Cybermed, Seoul, Korea) was used for stitching the CBCT images. Four observers evaluated 56 (28 stitched and 28 non-stitched) images to detect fracture lines. The diagnostic performance of stitched and non-stitched images was assessed by calculating the area under the receiver operating characteristic curve (AUC). Sensitivity and specificity values were also calculated (alpha=0.05). Results: The AUC was calculated to be 0.862 and 0.825 for the stitched and non-stitched images, respectively (P=0.747). The sensitivity and specificity were 90% and 75% for the non-stitched images and 85% and 87% for the stitched images, respectively. The inter-observer reliability was shown by a Fleiss kappa coefficient of 0.79, indicating good agreement. Conclusion: No significant difference was found in the diagnostic performance of stitched and non-stitched cross-sectional CBCT images of non-displaced fractures of the ovine mandible.

Interpretation of Receiver Operating Characteristics (ROC) (ROC(receiver operating characteristics) 해석)

  • Kim Jae-Duk
    • Imaging Science in Dentistry
    • /
    • v.30 no.3
    • /
    • pp.155-158
    • /
    • 2000
  • The purpose of this paper is to explain the making procedure and the usage of receiver operating characteristic (ROC) curve for interpretation of radiographic images. The conventional radiograms obtained after the creation of the lesions in the acrylic plates and were enhanced in color. The observer were informed of which tooth to examine, the 'a priori' probability of a lesion present and the approximate diameter of the lesions. The two groups of films were interpreted separately by the same observer using the same rating scale. The following rating scale was used: A; definitely no lesion, B; probably no lesion, C; not sure, D; probably a lesion, and E; definitely a lesion. In analysis, for each observer the diagnostic results in terms of true positive (TP) and false positive (FP) decisions were plotted on a graph. The lowest point on the graph represents the TP and FP when only decisions designated as E according to the rating scale are included. The next point shows the TP and FP values when diagnoses designated as D are added and so forth. By connecting such plot points, a receiver operating characteristic (ROC) curves is obtained. The area under the curve represents the diagnostic accuracy resulting from a diagnostic performance at pure chance level and a value of 1.0 at perfect performance. This method has been known as an useful method to detect the minute difference for each radiographic technic, each observer and for the different lesion depths.

  • PDF

Diagnostic Performance of Digital Breast Tomosynthesis with the Two-Dimensional Synthesized Mammogram for Suspicious Breast Microcalcifications Compared to Full-Field Digital Mammography in Stereotactic Breast Biopsy (정위적 유방 조직검사 시 미세석회화 의심 병변에서의 디지털 유방단층영상합성법과 전역 디지털 유방촬영술의 진단능 비교)

  • Jiwon Shin;Ok Hee Woo;Hye Seon Shin;Sung Eun Song;Kyu Ran Cho;Bo Kyoung Seo
    • Journal of the Korean Society of Radiology
    • /
    • v.83 no.5
    • /
    • pp.1090-1103
    • /
    • 2022
  • Purpose To evaluate the diagnostic performance of digital breast tomosynthesis (DBT) with the two-dimensional synthesized mammogram (2DSM), compared to full-field digital mammography (FFDM), for suspicious microcalcifications in the breast ahead of stereotactic biopsy and to assess the diagnostic image visibility of the images. Materials and Methods This retrospective study involved 189 patients with microcalcifications, which were histopathologically verified by stereotactic breast biopsy, who underwent DBT with 2DSM and FFDM between January 8, 2015, and January 20, 2020. Two radiologists assessed all cases of microcalcifications based on Breast Imaging Reporting and Data System (BI-RADS) independently. They were blinded to the histopathologic outcome and additionally evaluated lesion visibility using a fivepoint scoring scale. Results Overall, the inter-observer agreement was excellent (0.9559). Under the setting of category 4A as negative due to the low possibility of malignancy and to avoid the dilution of malignancy criteria in our study, McNemar tests confirmed no significant difference between the performances of the two modalities in detecting microcalcifications with a high potential for malignancy (4B, 4C, or 5; p = 0.1573); however, the tests showed a significant difference between their performances in detecting microcalcifications with a high potential for benignancy (4A; p = 0.0009). DBT with 2DSM demonstrated superior visibility and diagnostic performance than FFDM in dense breasts. Conclusion DBT with 2DSM is superior to FFDM in terms of total diagnostic accuracy and lesion visibility for benign microcalcifications in dense breasts. This study suggests a promising role for DBT with 2DSM as an accommodating tool for stereotactic biopsy in female with dense breasts and suspicious breast microcalcifications.

Assessment of solid components of borderline ovarian tumor and stage I carcinoma: added value of combined diffusion- and perfusion-weighted magnetic resonance imaging

  • Kim, See Hyung
    • Journal of Yeungnam Medical Science
    • /
    • v.36 no.3
    • /
    • pp.231-240
    • /
    • 2019
  • Background: We sought to determine the value of combining diffusion-weighted (DW) and perfusion-weighted (PW) sequences with a conventional magnetic resonance (MR) sequence to assess solid components of borderline ovarian tumors (BOTs) and stage I carcinomas. Methods: Conventional, DW, and PW sequences in the tumor imaging studies of 70 patients (BOTs, n=38; stage I carcinomas, n=32) who underwent surgery with pathologic correlation were assessed. Two independent radiologists calculated the parameters apparent diffusion coefficient (ADC), $K^{trans}$ (vessel permeability), and $V_e$ (cell density) for the solid components. The distribution on conventional MR sequence and mean, standard deviation, and 95% confidence interval of each DW and PW parameter were calculated. The inter-observer agreement among the two radiologists was assessed. Area under the receiver operating characteristic curve (AUC) and multivariate logistic regression were performed to compare the effectiveness of DW and PW sequences for average values and to characterize the diagnostic performance of combined DW and PW sequences. Results: There were excellent agreements for DW and PW parameters between radiologists. The distributions of ADC, $K^{trans}$, and $V_e$ values were significantly different between BOTs and stage I carcinomas, yielding AUCs of 0.58 and 0.68, 0.78 and 0.82, and 0.70 and 0.72, respectively, with ADC yielding the lowest diagnostic performance. The AUCs of the DW, PW, and combined PW and DW sequences were $0.71{\pm}0.05$, $0.80{\pm}0.05$, and $0.85{\pm}0.05$, respectively. Conclusion: Combining PW and DW sequences to a conventional sequence potentially improves the diagnostic accuracy in the differentiation of BOTs and stage I carcinomas.

Differentiation between Glioblastoma and Primary Central Nervous System Lymphoma Using Dynamic Susceptibility Contrast-Enhanced Perfusion MR Imaging: Comparison Study of the Manual versus Semiautomatic Segmentation Method

  • Kim, Ye Eun;Choi, Seung Hong;Lee, Soon Tae;Kim, Tae Min;Park, Chul-Kee;Park, Sung-Hye;Kim, Il Han
    • Investigative Magnetic Resonance Imaging
    • /
    • v.21 no.1
    • /
    • pp.9-19
    • /
    • 2017
  • Background: Normalized cerebral blood volume (nCBV) can be measured using manual or semiautomatic segmentation method. However, the difference in diagnostic performance on brain tumor differentiation between differently measured nCBV has not been evaluated. Purpose: To compare the diagnostic performance of manually obtained nCBV to that of semiautomatically obtained nCBV on glioblastoma (GBM) and primary central nervous system lymphoma (PCNSL) differentiation. Materials and Methods: Histopathologically confirmed forty GBM and eleven PCNSL patients underwent 3T MR imaging with dynamic susceptibility contrast-enhanced perfusion MR imaging before any treatment or biopsy. Based on the contrast-enhanced T1-weighted imaging, the mean nCBV (mCBV) was measured using the manual method (manual mCBV), random regions of interest (ROIs) placement by the observer, or the semiautomatic segmentation method (semiautomatic mCBV). The volume of enhancing portion of the tumor was also measured during semiautomatic segmentation process. T-test, ROC curve analysis, Fisher's exact test and multivariate regression analysis were performed to compare the value and evaluate the diagnostic performance of each parameter. Results: GBM showed a higher enhancing volume (P = 0.0307), a higher manual mCBV (P = 0.018) and a higher semiautomatic mCBV (P = 0.0111) than that of the PCNSL. Semiautomatic mCBV had the highest value (0.815) for the area under the curve (AUC), however, the AUCs of the three parameters were not significantly different from each other. The semiautomatic mCBV was the best independent predictor for the GBM and PCNSL differential diagnosis according to the stepwise multiple regression analysis. Conclusion: We found that the semiautomatic mCBV could be a better predictor than the manual mCBV for the GBM and PCNSL differentiation. We believe that the semiautomatic segmentation method can contribute to the advancement of perfusion based brain tumor evaluation.