• Title/Summary/Keyword: Reproducibility evaluation

Search Result 344, Processing Time 0.026 seconds

Using CART to Evaluate Performance of Tree Model (CART를 이용한 Tree Model의 성능평가)

  • Jung, Yong Gyu;Kwon, Na Yeon;Lee, Young Ho
    • Journal of Service Research and Studies
    • /
    • v.3 no.1
    • /
    • pp.9-16
    • /
    • 2013
  • Data analysis is the universal classification techniques, which requires a lot of effort. It can be easily analyzed to understand the results. Decision tree which is developed by Breiman can be the most representative methods. There are two core contents in decision tree. One of the core content is to divide dimensional space of the independent variables repeatedly, Another is pruning using the data for evaluation. In classification problem, the response variables are categorical variables. It should be repeatedly splitting the dimension of the variable space into a multidimensional rectangular non overlapping share. Where the continuous variables, binary, or a scale of sequences, etc. varies. In this paper, we obtain the coefficients of precision, reproducibility and accuracy of the classification tree to classify and evaluate the performance of the new cases, and through experiments to evaluate.

  • PDF

Effectiveness Evaluation of Scanogram Using Longbone Detector (Longbone 검출기를 이용한 Scanogram의 유효성 평가)

  • Jang, Su-han;Heo, Ji-eun
    • Journal of radiological science and technology
    • /
    • v.43 no.4
    • /
    • pp.235-242
    • /
    • 2020
  • Scanogram is that combine several practical images into one image to observation. So it is an important consideration in many clinical situation such as iliac measurement, leg alignment measurement and Scoliosis. Currently, scanogram examinations are mainly conducted for children and elderly patients. In this study, in order to apply the longbone detector to children or elderly patients who are difficult to cooperate with, we compared the longbone detector from D equipment with the G equipment discovery 656 Puls equipment in reproducibility of images, distribution of irradiation dose, scattering dose, irradiation time and image acquisition time. D equipment took more than twice as much time as G equipment. The scattered dose generated about 50% more G equipment than D equipment. In the whole spine scanogram and the measurement length of the lower leg, D equipment was also measured longer than G equipment. However, both methods did not show much difference from the CT scanogram, so there was no problem in measurement. The height of the thyroid radiation dose of G equipment was produced more radiation than D equipment. However, the longbone detector deviated from the x-ray center line relative to the tube rotation method, and was measured lower by the directionality of the measuring instrument, so that the error could not be corrected. In the conclusion of study, using the longbone detector is excellent for applying to children or elderly patients to reduce scattering dose. However, using CR may be useful to normal patients. Because, the image quality may deteriorate due to an imbalance of dose difference in thickness depending on the body part. So, it is useful to using a compensation filter or tube rotation method when we take a whole spine scanogram.

Inter- and Intra-Observer Variability of the Volume of Cervical Ossification of the Posterior Longitudinal Ligament Using Medical Image Processing Software

  • Shin, Dong Ah;Ji, Gyu Yeul;Oh, Chang Hyun;Kim, Keung Nyun;Yoon, Do Heum;Shin, Hyunchul
    • Journal of Korean Neurosurgical Society
    • /
    • v.60 no.4
    • /
    • pp.441-447
    • /
    • 2017
  • Objective : Computed tomography (CT)-based method of three dimensional (3D) analysis ($MIMICS^{(R)}$, Materialise, Leuven, Belgium) is reported as very useful software for evaluation of OPLL, but its reliability and reproducibility are obscure. This study was conducted to evaluate the accuracy of $MIMICS^{(R)}$ system, and inter- and intra-observer reliability in the measurement of OPLL. Methods : Three neurosurgeons independently analyzed the randomly selected 10 OPLL cases with medical image processing software ($MIMICS^{(R)}$) which create 3D model with Digital Imaging and Communication in Medicine (DICOM) data from CT images after brief explanation was given to examiners before the image construction steps. To assess the reliability of inter- and intra-examiner intraclass correlation coefficient (ICC), 3 examiners measured 4 parameters (volume, length, width, and length) in 10 cases 2 times with 1-week interval. Results : The inter-examiner ICCs among 3 examiners were 0.996 (95% confidence interval [CI], 0.987-0.999) for volume measurement, 0.973 (95% CI, 0.907-0.978) for thickness, 0.969 (95% CI, 0.895-0.993) for width, and 0.995 (95% CI, 0.983-0.999) for length. The intra-examiner ICCs were 0.994 (range, 0.991-0.996) for volume, 0.996 (range, 0.944-0.998) for length, 0.930 (range, 0.873-0.947) for width, and 0.987 (range, 0.985-0.995) for length. Conclusion : The medical image processing software ($MIMICS^{(R)}$) provided detailed quantification OPLL volume with minimal error of inter- and intra-observer reliability in the measurement of OPLL.

A benchmark experiment for analogue modeling of extensional basin formation and evaluation of applicability of centrifuge test (인장 분지 형성을 구현하기 위한 상사 모델링 벤치마크 실험 및 원심모형실험의 적용성 평가)

  • Lee, Sung-Bok;Park, Heon-Joon
    • Journal of the Geological Society of Korea
    • /
    • v.54 no.6
    • /
    • pp.605-614
    • /
    • 2018
  • For physical experiments like analogue modeling that designed for studying geological deformation, reproducibility of the deformation is important to guarantee the reliability of the experiment. In this study, the normal fault generated by extensional stress is benchmarked using a sand box model. The scaling factors for the modeling test are considered and the experiments are conducted by setting the appropriate material, extensional stress, and boundary condition in the same way as in a benchmark experiment. In addition, a large centrifuge facility is used to vary the centrifugal acceleration and extension rate in the same sized model to account for the scaling factors of the physical quantity during extensional behavior. At 1 g benchmark condition and a centrifugal field at 10 g, a constant rate of the extensional stress is implemented and the topographic evolution is reliably measured. In this study, the reliability and applicability of large centrifuge model tests are evaluated for formulating experiments designed to study geological deformation.

Reliability of the EOS Imaging System for Assessment of the Spinal and Pelvic Alignment in the Sagittal Plane

  • Kim, Sang Bum;Heo, Youn Moo;Hwang, Cheol Mog;Kim, Tae Gyun;Hong, Jee Young;Won, You Gun;Ham, Chang Uk;Min, Young Ki;Yi, Jin Woong
    • Clinics in Orthopedic Surgery
    • /
    • v.10 no.4
    • /
    • pp.500-507
    • /
    • 2018
  • Background: The sagittal alignment of the spine and pelvis is not only closely related to the overall posture of the body but also to the evaluation and treatment of spine disease. In the last few years, the EOS imaging system, a new low-dose radiation X-ray device, became available for sagittal alignment assessment. However, there has been little research on the reliability of EOS. The purpose of this study was to evaluate the intrarater and interrater reliability of EOS for the sagittal alignment assessment of the spine and pelvis. Methods: Records of 46 patients were selected from the EOS recording system between November 2016 and April 2017. The exclusion criteria were congenital spinal anomaly and deformity, and previous history of spine and pelvis operation. Sagittal parameters of the spine and pelvis were measured by three examiners three times each using both manual and EOS methods. Means comparison t-test, Pearson bivariate correlation analysis, and reliability analysis by intraclass correlation coefficients (ICCs) for intrarater and interrater reliability were performed using R package "irr." Results: We found excellent intrarater and interrater reliability of EOS measurements. For intrarater reliability, the ICC ranged from 0.898 to 0.982. For interrater reliability, the ICC ranged from 0.794 to 0.837. We used a paired t-test to compare the values measured by manual and EOS methods: there was no statistically significant difference between the two methods. Correlation analysis also showed a statistically significant positive correlation. Conclusions: EOS showed excellent reliability for assessment of the sagittal alignment of the spine and pelvis.

Development of the Cultural Competence Scale for Registered Nurses (CCS-RN) (간호사의 문화간호역량 측정도구의 개발)

  • Kim, Kyung Won;Kim, Sun-Hee;Kim, Young Hee;Kim, Hyun Kyoung;Park, Hae Sook;Lee, Sun Hee;Jeong, Geum Hee
    • Research in Community and Public Health Nursing
    • /
    • v.30 no.3
    • /
    • pp.281-294
    • /
    • 2019
  • Purpose: This study is to develop the Cultural Competence Scale for Registered Nurses (CCS-RN) and to examine its validity and reliability. Methods: The item pool was generated based on related scales, a wide review of the literature, and in-depth interviews with nurses according to Purnell's cultural competence model. Content validity was verified by nursing experts. Construct validity using exploratory factor analysis, convergent validity using correlation coefficients, discriminant validity, internal consistency reliability, and test-retest reliability were examined. Results: The CCS-RN consists of a 35-item/7-factor solution with 54.1% of the total variance explained. The convergent validity of CCS-RN was supported. Cronbach's ${\alpha}$ was .94 for the total scale and ranged from .77 to .90 for the seven factors. Test-retest reliability was moderate. Conclusion: The evaluation of the psychometric properties of the CCS-RN shows that this scale is expected to be a valid and reliable measure of cultural competence among nurses. This scale may be useful for assessing nurses' own cultural competence and thus contribute to strengthening cultural competence.

Quantitative T2 Mapping of Articular Cartilage of the Glenohumeral Joint at 3.0T in Rotator Cuff Disease Patients: the Evaluation of Degenerative Change of Cartilage

  • Lee, Kyung Ryeol;Ko, Su Yeon;Choi, Guk Myung
    • Investigative Magnetic Resonance Imaging
    • /
    • v.23 no.3
    • /
    • pp.228-240
    • /
    • 2019
  • Purpose: The aim of this study is to evaluate the T2 value of the articular cartilage of the glenohumeral joint in rotator cuff disease displayed on 3.0T MRI and to apply it in clinical practice. Materials and Methods: This study involved sixty-two patients who underwent shoulder MRI containing T2 mapping. The mean T2 value was measured by placing a free hand ROI over the glenoid or humeral cartilage from the bone-cartilage interface to the articular surface on three consecutive, oblique coronal images. The drawn ROI was subsequently divided into superior and inferior segments. The assessed mean T2 values of the articular cartilage of the glenohumeral joint were compared and evaluated based on the degree of rotator cuff tear, the degree of fatty atrophy of the rotator cuff, and the acromiohumeral distance. Results: ICC values between two readers indicated moderate or good reproducibility. The mean T2 value for the articular cartilage of the glenoid and humeral head cartilage failed to show any significant difference based on the degree of rotator cuff tear. However, the mean T2 values of articular cartilage, based on fatty atrophy, tended to be higher in fatty atrophy 3 or fatty atrophy 4 groups while some subregions displayed significantly higher mean T2 values. There was no correlation between the acromiohumeral distance and the mean T2 values of the articular cartilage of the glenoid and humeral head. Conclusion: T2 mapping of the glenohumeral joint failed to show any significant difference in quantitative analysis of the degenerative change of the articular cartilage based on the degree of rotator cuff tear. However, it also offers quantitative information on the degenerative change of cartilage of the glenohumeral joint in patients with rotator cuff tear and severe fatty atrophy of the rotator cuff.

Evaluation of a multi-stage convolutional neural network-based fully automated landmark identification system using cone-beam computed tomography-synthesized posteroanterior cephalometric images

  • Kim, Min-Jung;Liu, Yi;Oh, Song Hee;Ahn, Hyo-Won;Kim, Seong-Hun;Nelson, Gerald
    • The korean journal of orthodontics
    • /
    • v.51 no.2
    • /
    • pp.77-85
    • /
    • 2021
  • Objective: To evaluate the accuracy of a multi-stage convolutional neural network (CNN) model-based automated identification system for posteroanterior (PA) cephalometric landmarks. Methods: The multi-stage CNN model was implemented with a personal computer. A total of 430 PA-cephalograms synthesized from cone-beam computed tomography scans (CBCT-PA) were selected as samples. Twenty-three landmarks used for Tweemac analysis were manually identified on all CBCT-PA images by a single examiner. Intra-examiner reproducibility was confirmed by repeating the identification on 85 randomly selected images, which were subsequently set as test data, with a two-week interval before training. For initial learning stage of the multi-stage CNN model, the data from 345 of 430 CBCT-PA images were used, after which the multi-stage CNN model was tested with previous 85 images. The first manual identification on these 85 images was set as a truth ground. The mean radial error (MRE) and successful detection rate (SDR) were calculated to evaluate the errors in manual identification and artificial intelligence (AI) prediction. Results: The AI showed an average MRE of 2.23 ± 2.02 mm with an SDR of 60.88% for errors of 2 mm or lower. However, in a comparison of the repetitive task, the AI predicted landmarks at the same position, while the MRE for the repeated manual identification was 1.31 ± 0.94 mm. Conclusions: Automated identification for CBCT-synthesized PA cephalometric landmarks did not sufficiently achieve the clinically favorable error range of less than 2 mm. However, AI landmark identification on PA cephalograms showed better consistency than manual identification.

Evaluation of Compaction Quality using High-resolution Terrain Factor and Soil Moisture (고해상 지형정보와 토양수분을 활용한 다짐도 평가)

  • Kim, Sung-Wook;Go, Daehong;Lee, Yeong-Jae;Choi, Eun-Kyeong;Kim, Jin-Young;Kim, Ji-Sun;Cho, Jin-Woo
    • Journal of Environmental Science International
    • /
    • v.31 no.10
    • /
    • pp.869-881
    • /
    • 2022
  • In this study, a field study was conducted to investigate the relationship between high-resolution remote images and the volumetric moisture, and the number of compaction. Changes in the shape of the surface and soil moisture content were observed and correlated with the number of compactions using roller equipment. As the compaction is repeated, the surface is flattened and the terrain curvature decreases and converges to zero. In particular, the tangential curvature changes as the number of compactions increase. Due to soil compaction, the vegetation index changed from a positive to a negative value, and most of the test site area was homogenized with a negative index. This suggests a decrease in porosity and an increase in volumetric water content associated with increasing soil compaction. Soil moisture, measured using a frequency domain reflectometry(FDR) sensor, tends to increase proportionately with the number of vibration compactions, but the correlation between the number of compactions and soil moisture is unclear. This study suggests that while it is necessary to consider the reproducibility of the experiments performed, the compaction quality of the soil can be evaluated using high-resolution terrain factors and soil moisture.

Prevalence and co-infection status of three pathogenic porcine circoviruses (PCV2, PCV3, and PCV4) by a newly established triplex real-time polymerase chain reaction assay

  • Kim, Hye-Ryung;Park, Jonghyun;Kim, Won-Il;Lyoo, Young S.;Park, Choi-Kyu
    • Korean Journal of Veterinary Service
    • /
    • v.45 no.2
    • /
    • pp.87-99
    • /
    • 2022
  • A novel porcine circovirus 4 (PCV4) was recently emerged in Chinese and Korean pig herds, which provided epidemiological situation where three pathogenic PCVs, PCV2, PCV3, and newly emerged PCV4, could co-infect pig herds in these countries. In this study, a new triplex quantitative real-time polymerase chain reaction (tqPCR) method was developed for the rapid and differential detection of these viruses. The assay specifically amplified each viral capsid gene, whereas no other porcine pathogenic genes were detected. The detection limit of the assay was below 10 copies/µL and the assay showed high repeatability and reproducibility. In the clinical evaluation using 1476 clinical samples from 198 Korean pig farms, the detection rates of PCV2, PCV3 and PCV4 by the tqPCR assay were 13.8%, 25.4%, and 3.8%, respectively, which were 100% agreement with those of previously reported monoplex qPCR assays for PCV2, PCV3, and PCV4, with a κ value (95% CI) of 1 (1.00~1.00). The prevalence of PCV2, PCV3, and PCV4 at the farm levels were 46.5%, 63.6%, and 19.7%, respectively. The co-infection analysis for tested pig farms showed that single infection rates for PCV2, PCV3, and PCV4 were 28.8%, 44.4%, and 9.6%, respectively, the dual infection rates of PCV2 and PCV3, PCV2 and PCV4, and PCV3 and PCV4 were 12.6%, 3.5%, and 5.1%, respectively, and the triple infection rate for PCV2, PCV3, and PCV4 was 1.5%. These results demonstrate that three pathogenic PCVs are widely spread, and their co-infections are common in Korean pig herds, and the newly developed tqPCR assay will be useful for etiological and epidemiological studies of these pathogenic PCVs.