• Title/Summary/Keyword: Consistency in Assessment

Search Result 337, Processing Time 0.02 seconds

Development of Korean Intensive Care Delirium Screening Tool (KICDST) (중환자 섬망 선별도구 개발)

  • Nam, Ae-Ri-Na;Park, Jee-Won
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.1
    • /
    • pp.149-158
    • /
    • 2016
  • Purpose: This study was done to develop of the Korean intensive care delirium screening tool (KICDST). Methods: The KICDST was developed in 5 steps: Configuration of conceptual frame, development of preliminary tool, pilot study, reliability and validity test, development of final KICDST. Reliability tests were done using degree of agreement between evaluators and internal consistency. For validity tests, CVI (Content Validity Index), ROC (Receiver Operating Characteristics) analysis, known group technique and factor analysis were used. Results: In the reliability test, the degree of agreement between evaluators showed .80~1.00 and the internal consistency was KR-20=.84. The CVI was .83~1.00. In ROC analysis, the AUC (Area Under the ROC Curve) was .98. Assessment score was 4 points. The values for sensitivity, specificity, correct classification rate, positive predictive value, and negative predictive value were found to be 95.0%, 93.7%, 94.4%, 95.0% and 93.7%, respectively. In the known group technique, the average delirium screening tool score of the non-delirium group was $1.25{\pm}0.99$ while that of delirium group was $5.07{\pm}1.89$ (t= - 16.33, p <.001). The factors were classified into 3 factors (cognitive change, symptom fluctuation, psychomotor retardation), which explained 67.4% of total variance. Conclusion: Findings show that the KICDST has high sensitivity and specificity. Therefore, this screening tool is recommended for early identification of delirium in intensive care patients.

Decision Methodology for LNG Plant FEED Evaluation using Analytic Hierarchy Process (LNG 플랜트 프로젝트의 기본설계 평가방법에 관한 연구)

  • Park, Jong-Hwa;Cho, Dae-Myeong
    • Journal of the Korean Institute of Gas
    • /
    • v.20 no.3
    • /
    • pp.52-58
    • /
    • 2016
  • In this study, evaluation method for LNG plant FEED is suggested and its validity is confirmed using a well-known decision making technique of Analytic Hierarchy Process (AHP). It is a pairwise comparison technique which can be used when multiple options must be considered for a single decision making problem. In order to develop an objective decision methodology, various decision parameters, sub-parameters as well as the concept of scale of assessment were introduced, and its consistency among these parameters was also checked by calculating the consistency index (C.I.). The methodology suggested in this article will contribute in evaluation of LNG plant FEED with less bias and subjectivity associated with the decision making procedure.

Examining Psychometric Properties of the Brief Symptom Inventory(BSI-18) in Korean People with Mental Disorders (정신장애인에 대한 Brief Symptom Inventory-18의 신뢰도와 타당도에 관한 연구)

  • Hoe, Maanse;Lee, Soonhee
    • Korean Journal of Social Welfare
    • /
    • v.66 no.3
    • /
    • pp.253-276
    • /
    • 2014
  • The purpose of the present study was to examine psychometric properties of the BSI-18 in Korean adults with mental disorders. This study examined internal consistency, test-retest reliability, convergent validity, and a factor structure of the BSI. The sample consisted of 180 adults with mental disorders, who enrolled in mental hospitals and in a day hospital. Data was analysed using reliability analysis, correlation analysis, and confirmatory factor analysis. Major findings were as follows. The Korean version of the BSI showed good internal consistency and test-retest reliability, as well as excellent convergent validity. The original three-factor structure of the BSI-18, proposed by Derogatis, 2001, fitted to the data. These findings indicate that the BSI-18 is a reliable and valid measure as a psychiatric assessment tool and a treatment outcome measure.

  • PDF

The Reliability of the Pediatric Functional Muscle Testing in Children with Developmental Delay

  • Seo, Hye-Jung;Kim, Joong-Hwi
    • The Journal of Korean Physical Therapy
    • /
    • v.27 no.4
    • /
    • pp.183-189
    • /
    • 2015
  • Purpose: The aim of this study was to examine the test-retest and inter-rater reliability of the pediatric functional muscle testing (PFMT) when applied to children with developmental delay. Methods: Sixteen children with developmental delay (seven females, nine males) participated in this study. For the inter-rater reliability, each was scored on the PMFT by two pediatric physical therapists with more than 8 years of clinical experience on the same day. For assessment of the test-retest reliability, one therapist tested the children again within 10 days. The second measurement was performed by taking a first measurement in video. Intraclass correlation coefficient (ICC) was calculated to determine the test-retest and inter-rater reliability of the PFMT, and Chronbach's alpha was used to measure internal consistency. Results: The results of this study were as follows: 1) The test-retest ICC of the score of the infant action month and the right side of the PFMT was from 0.53 to 1.00 and from 0.63 to 0.99, respectively. 2) The inter-rater ICC of the score of the infant action month and the right side of the PFMT was from 0.66 to 1.00 and from 0.64 to 1.00, respectively. 3) Chronbach's alpha was 0.93. The internal consistency indicated excellent. Conclusion: In conclusion, this study showed that the test-retest and inter-rater reliability of the PFMT was relatively high, except for a few items. Therefore, it can be suggested that the PFMT will be a useful tool for measurement of muscle strength for children with developmental delay if it be some modifications.

Effect of different voxel sizes on the accuracy of CBCT measurements of trabecular bone microstructure: A comparative micro-CT study

  • Tayman, Mahmure Ayse;Kamburoglu, Kivanc;Ocak, Mert;Ozen, Dogukan
    • Imaging Science in Dentistry
    • /
    • v.52 no.2
    • /
    • pp.171-179
    • /
    • 2022
  • Purpose: The aim of this study was to assess the accuracy of cone-beam computed tomographic (CBCT) images obtained using different voxel sizes in measuring trabecular bone microstructure in comparison to micro-CT. Materials and Methods: Twelve human skull bones containing posterior-mandibular alveolar bone regions were analyzed. CBCT images were obtained at voxel sizes of 0.075mm(high: HI) and 0.2mm(standard: Std), while microCT imaging used voxel sizes of 0.06 mm (HI) and 0.12 mm (Std). Analyses were performed using CTAn software with the standardized automatic global threshold method. Intraclass correlation coefficients were used to evaluate the consistency and agreement of paired measurements for bone volume (BV), percent bone volume (BV/TV), bone surface (BS), trabecular thickness (TbTh), trabecular separation (TbSp), trabecular number (TbN), trabecular pattern factor(TbPf), and structure model index (SMI). Results: When compared to micro-CT, CBCT images had higher BV, BV/TV, and TbTh values, while micro-CT images had lower BS, TbSp, TbN, TbPf, and SMI values (P<0.05). The BV, BV/BT, TbTh, and TbSp variables were higher with Std voxels, whereas the BS, TbPf, and SMI variables were higher with HI voxels for both imaging methods. For each imaging modality and voxel size evaluated, BV, BS, and TbTh were significantly different(P<0.05). TbN, TbPf, and SMI showed statistically significant differences between imaging methods(P<0.05). The consistency and absolute agreement between micro-CT and CBCT were excellent for all variables. Conclusion: This study demonstrated the potential of high-resolution CBCT imaging for quantitative bone morphometry assessment.

A Preliminary Study on the Test of Oral Reading and Comprehension Skill for Lower Level Elementary School Children (구어적 읽기 이해력 검사의 타당화를 위한 예비연구 : 초등학교 저학년을 중심으로)

  • Park, Chan-Hwa;Kim, Myung-Soon
    • Korean Journal of Child Studies
    • /
    • v.30 no.1
    • /
    • pp.59-75
    • /
    • 2009
  • The purpose of this study was to verify the validity and reliability for the Test of Oral Reading and Comprehension Skill (Gardner, 2000) for Korean lower level elementary school children. Subjects were 122 first to third grade students, tested individually. The vocabulary and comprehension sub-tests of K-WISC III and the reading comprehension test of Basic Academic Skills Assessment (Kim, 2000) were used to verify concurrent validity. Internal reliability was determined by internal consistency coefficients. Results verified concurrent validity. Test scores differed significantly by grade level. Test reliability was also confirmed. In conclusion, the Oral Reading and Comprehension Skill Test (Gardner, 2000) is reliable and valid for examination of reading comprehension skills for Korean lower level elementary school children.

  • PDF

A Validation Study for the Korean Version of Chronic Obstructive Pulmonary Disease Assessment Test (CAT)

  • Hwang, Yong Il;Jung, Ki-Suck;Lim, Seong-Yong;Lee, Yil-Seob;Kwon, Nam-Hee
    • Tuberculosis and Respiratory Diseases
    • /
    • v.74 no.6
    • /
    • pp.256-263
    • /
    • 2013
  • Background: Health status measure is not only important for clinical research studies but also for clinical practices of chronic obstructive pulmonary disease (COPD) patients. The objective of this study is to evaluate the validity of the Korean Version of COPD Assessment Test (CAT) in primary care clinics as well as in referral hospitals. Methods: Smokers or ex-smokers, aged 40 years or older, with a smoking history of >10 pack-years; and a COPD diagnosis in the past 6 months or more, were recruited from 4 primary care clinics and 2 referral hospitals. Demographic, medical, and spirometry data was collected from patients who completed the CAT and St. George Respiratory Questionnaire (SGRQ), and had their dyspnea been assessed. The primary endpoint was the correlation between of the Korean version of CAT with SGRQ in patients with COPD. Results: A total 100 patients were enrolled. The mean age and smoking amounts were $69.2{\pm}8.4$ years and $40.6{\pm}22.3$ pack-years, respectively. Sixty-seven percent of the patients reported at least one exacerbation in the past year. The mean CAT score was $16.9{\pm}8.0$. The internal consistency assessed by Cronbach's alpha was 0.85. The CAT score was positively correlated with the SGRQ score (r=0.76, p<0.0001) and each component of SGRQ: symptoms, activity and impacts; r=0.68, r=0.61, and r=0.72, respectively (all p<0.0001). These positive correlations were preserved in the different groups (r=0.86, p<0.0001 in primary care clinic group; r=0.69, p<0.0001 in hospital group). The CAT score was also positively correlated to the Medical Research Council dyspnoea scale (r=0.46, p<0.0001). Conclusion: The Korean version of CAT had good internal consistency and showed good correlations with SGRQ. It can be used for assessing the impacts of COPD on the patient's health including primary care setting.

Validity and Reliability Test of the Korean Version of the Oncology Patients' Perception of the Quality of Nursing Care Scale (한국어판 '암 환자가 인식하는 간호의 질 측정도구'의 타당도와 신뢰도)

  • Kang, Jiyoung;Kang, Heiyoung;Kim, Nanyeon;Lee, Mijung;Kim, Youjine;Kim, Juhyeon;Yeo, Sujeong;Seo, Yunye;Suh, Eunyoung
    • Korean Journal of Adult Nursing
    • /
    • v.28 no.2
    • /
    • pp.191-201
    • /
    • 2016
  • Purpose: The purpose of this methodological study was to examine the validity and reliability of a translated Korean version of The Oncology Patients' Perception of the Quality of Nursing Care Scale. Methods: The translated scale was pilot tested and then administered to 360 patients with cancer. Exploratory and confirmatory factor analyses were utilized to assess the factor structure. Internal consistency reliability was determined using coefficient ${\alpha}$. Results: Two of the 40 items were deleted with a principal component method of exploratory factor analysis because they did not meet the factor-loading criterion. The 38 items were again analyzed and, four factors were validated (KMO=.96, Bartlett ${\chi}^2=10809.81$, df=780, p<.001). The four factors accounted for 60.9% of the variance. Factor loadings of the scale on the four subscales ranged from .65 to .91. The scale showed reliable internal consistency with a Cronbach's ${\alpha}$, total 38 items (${\alpha}=.96$) in four subscales: individualization (18 items, ${\alpha}=.96$), proficiency (10, .91), responsiveness (7, .90), and coordination (3, .80). Conclusion: The findings of this study demonstrate that the scale has satisfactory construct validity and reliability to measure quality of cancer nursing care from the patient's perspective in Korea.

Psychometric Evaluation of the Korean Social Support Questionnaire (한국 사회적지지 측정도구 개발)

  • Oh, Ka-Sil;Oh, Kyong-Ok;Lee, Sook-Ja;Kim, Jeong-Ah;Jeong, Chu-Ja;Kim, Hye-Ryoung;Jun, Hoa-Yun;Kang, Jung-Hee
    • Journal of Korean Academy of Nursing
    • /
    • v.38 no.6
    • /
    • pp.881-890
    • /
    • 2008
  • Purpose: Research related to social support in Korea has been hampered by paucity of measurement tools reflecting Korean culture. The aim of the study was to develop Korean social support questionnaire (KSSQ) based on the Korean social support pyramid and to test psychometric properties of the KSSQ. Methods: The questionnaire was administered to 701 subjects and 658 college students. Psychometric analyses included factor analyses, expert validity, criterion-related validity, internal consistency, and test-retest reliability. Results: A principal components analysis support for construct validity, eliciting a three factor solution accounting for 65.46% of variance in scores. Concurrent and discriminant validity supported criterion-related validity. Internal consistency of reliability was support with Cronbach's alpha of .97-.98 for the entire scale. Test-retest reliability was .76. Conclusion: This initial testing of KSSQ to measure Korean social support demonstrates evidence of reliability and validity. Assessment of known-group validity and norm establishment of KSSQ are suggested to provide further sound psychometric properties and practical measurement tools.

Review of International Cases for Managing Input Data in Safety Assessment for High-Level Radioactive Waste Deep Disposal Facilities (고준위방사성폐기물 심층처분시설 안전성평가 입력자료 관리를 위한 해외사례 분석)

  • Mi Kyung Kang;Hana Park;Sunju Park;Hae Sik Jeong;Woon Sang Yoon;Jeonghwan Lee
    • Economic and Environmental Geology
    • /
    • v.56 no.6
    • /
    • pp.887-897
    • /
    • 2023
  • Leading waste disposal countries, such as Sweden, Switzerland, and the United Kingdom, conduct safety assessments across all stages of High-Level Radioactive Waste Deep Geological Disposal Facilities-from planning and site selection to construction, operation, closure, and post-closure management. As safety assessments are repeatedly performed at each stage, generating vast amounts of diverse data over extended periods, it is essential to construct a database for safety assessment and establish a data management system. In this study, the safety assessment data management systems of leading countries, were analyzed, categorizing them into 1) input and reference data for safety assessments, 2) guidelines for data management, 3) organizational structures for data management, and 4) computer systems for data management. While each country exhibited differences in specific aspects, commonalities included the classification of safety assessment input data based on disposal system components, the establishment of organizations to supply, use, and manage this data, and the implementation of quality management systems guided by instructions and manuals. These cases highlight the importance of data management systems and document management systems for securing the safety and enhancing the reliability of High-Level Radioactive Waste Disposal Facilities. To achieve this, the classification of input data that can be flexibly and effectively utilized, ensuring the consistency and traceability of input data, and establishing a quality management system for input data and document management are necessary.