• Title/Summary/Keyword: item validity

Search Result 832, Processing Time 0.023 seconds

Item Analysis using Classical Test Theory and Item Response Theory, Validity and Reliability of the Korean version of a Pressure Ulcer Prevention Knowledge (한국어판 욕창예방지식도구의 고전검사이론과 문항반응이론을 적용한 문항분석, 타당도와 신뢰도)

  • Kang, Myung Ja;Kim, Myoung Soo
    • Journal of Korean Biological Nursing Science
    • /
    • v.20 no.1
    • /
    • pp.11-19
    • /
    • 2018
  • Purpose: The purposes of this study were to perform items analysis using the classical test theory (CTT) and the item response theory (IRT), and to establish the validity and reliability of the Korean version of pressure ulcer prevention knowledge. Methods: The 26-item pressure ulcer prevention knowledge instrument was translated into Korean, and the item analysis of the 22 items having an adequate content validity index (CVI), was conducted. A total of 240 registered nurses in 2 university hospitals completed the questionnaire. Each item was analyzed applying CTT and IRT according to 2-parameter logistic model. Response alternatives quality, item difficulty and item discrimination were evaluated. For testing validity and reliability, Pearson correlation coefficient and Kuder Richardson-20 (KR-20) were used. Results: Scale CVI was .90 (Item-CVI range= .75-1.00). The total correct answer rate for this study population was relatively low as 52.5%. The quality of response alternatives was found to be relatively good (range= .02-.83). The item difficulty of the questions ranged form .10 to .86 according to CTT and -12.19 to 29.92 according to the IRT. This instrument had 12-low, 2-medium and 8-high item difficulty applying IRT. The values for the item discrimination ranged .04-.57 applying CTT and .00-1.47 applying IRT. And overall internal consistency (KR-20) was .62 and stability (test-retest) was .82. Conclusion: The instrument had relatively weak construct validity, item discrimination according to the IRT. Therefore, the cautious usage of a Korean version of this instrument would be recommended for discrimination because there are so many attractive response alternatives and low internal consistency.

The Reliability and Validity of the Health-Related Hardiness Scale in a Sample of Korean Nursing Students (간호학생을 대상으로한 건강관련 강인성 도구(HRHS)의 신뢰도와 타당도 검증 및 수정)

  • Lee, Mi-Ra
    • Research in Community and Public Health Nursing
    • /
    • v.11 no.1
    • /
    • pp.199-208
    • /
    • 2000
  • The purpose of this study is to test the psychometric properties of the Korean version of the Health-Related Hardiness Scale(HRHS) in a sample of Korean nursing students. The korean version of HRHS was administered to 234 nursing students including 135 college students and 99 university students. The Korean version of HRHS was measured on a 6 Likert scale, assessing three factors of HRHS : control, commitment, and challenge. Internal consistency was used to test the instrument's reliability. The internal consistency of the scale was measured using a coefficient alpha. The coefficient alpha was .69(control), .49(commitment). and .69(challenge), Item analysis and confirmatory factor analysis (CFA) were used to test the instrument's construct validity. The item analysis identified that there were 13 items. which were lower than the .25 item-total correlation. CFA revealed that the scale's fadoral validity was not proper by showing unfit indices(RMSEA .07. stand, RMR .09. GFI .71). According to the findings of this study, the reliability and construct validity of the Korean version of HRHS is not satisfactory in the sample of nursing students. As a result. the researcher modified the scale through item analysis and repetitive CFA process, and proposed the revised 25-item Korean version of HRHS for nursing students. The revised scale's reliability(control .74, commitment .73. challenge .77) and factorial validity were within acceptable levels. The item analysis identified that there was no item, which is lower than the .25 item-total correlation. CFA revealed that the scale's factoral validity was proper by showing fit indices(RMSEA .08 stand. RMR .08. GFI .80).

  • PDF

Development of a Teacher Rating Scale of Childcare Adaptation for Infants and Toddlers (교사용 영아 어린이집 적응 척도 개발)

  • Shin, Nary;Yun, Hyun Jeong
    • Korean Journal of Child Studies
    • /
    • v.37 no.6
    • /
    • pp.35-56
    • /
    • 2016
  • Objective: This study aimed to develop and validate the Childcare Adaptation Scale for Infants and Toddlers (CASIT), which is rated by teachers of Korean children. Methods: The participants consisted of 326 childcare teachers working with infants (ages 0-2 years). Content validity, discriminant validity, convergent validity, concurrent validity, internal consistency, inter-rater reliability, and item discrimination were examined using PASW 18.0 and AMOS 19.0. Results: The results of an exploratory factor analysis identified the 29-item scale and six dimensions of the scale, including group life adaptation, negative behaviors, positive affect, regular routines, activity/interest, and peer interaction. Convergent validity was examined via confirmatory factor analysis, average variation extracted (AVE), and construct reliability, and acceptable evidences of convergent validity was established. The scales were shown to be highly consistent internally and among raters. Also, the mean between the upper group and lower group of each item regarding item discrimination showed a significant difference. Conclusion: It was concluded that the CASIT, which is a quick and convenient tool for teachers to use, is a valid and reliable instrument.

Reliability and Validity of The Korean Version Scale of Impact of Weight on Quality of Life in $Kids^{(C)}$ (한국어 버전 청소년의 체중 관련 삶의 질 측정도구의 신뢰도와 타당도 검증)

  • Kim, Jeoung-Hyun;Chun, Sungsoo;Choi, Han-Sik
    • The Journal of Korean Society for School & Community Health Education
    • /
    • v.15 no.3
    • /
    • pp.105-125
    • /
    • 2014
  • Background: The purpose of this study was to evaluate reliability and validity of a 27-item Korean Version of the Impact of Weight on Quality of Life in adolescents ($IWQOL-Kids^{(C)}$: Korean Version). Methods: This instrument was administered to 872 adolescents (mean z-BMI: 2.61, mean $age{\pm}SD$: $13.9{\pm}1.2$, male: 51.9%). Reliability was tested by internal consistency method and item analysis, validity test was performed by index of content validity, exploratory factor analysis, confirmatory factor analysis and concurrent validity. Sensitivity was tested by ANOVA and t-test. Analyses were performed using SPSS and Amos 18.0. Results: By an exploratory factor analysis, 4 factors were extracted; 'Body esteem' consisted of 9 items with 35.9% of variance (social life: 6 items, 10.23%, physical comfort: 6 items, 8.21%, family relations: 6 items, 7.0%). Four factors explained 61.34% of total variance. Internal consistency coefficients ranged from .766 to .929 for scales on 27 items and equal to .920 for total score for both the 26-item and 27-item tools. A confirmatory factor analysis was conducted for the convergent validity and discriminant validity. The standardized factor loadings to test the convergent validity showed more than .5(C.R<1.965) on all paths after deletion of item PC1 (avoid stairs). The average variances extracted were more than .50 and the construct reliabilities were more than .70. The average variances extracted were stronger than the squares of correlation coefficient of inter-latent variables. Conclusions: These results support that the $IWQOL-Kids^{(C)}$: Korean Version with a 26-item is a reliable and valid tool in Korean obese adolescents.

  • PDF

Developing the Parent Play Interaction Observation Scale (PPIOS) for Toddlers (부모-영아 놀이 상호작용 관찰척도 개발을 위한 연구)

  • JiYeon Kim;MyoungSoon Kim;ShinHee Lee;JeongWon Park
    • Korean Journal of Childcare and Education
    • /
    • v.19 no.6
    • /
    • pp.39-54
    • /
    • 2023
  • Objective: This study aimed to develop a parent play interaction observation scale (PPIOS-Toddler) and analyze it in terms of item discrimination, reliability, and validity. Methods: The subjects of the study were 97 toddlers and mothers. This scale consisted of three categories, six domains and 22 items on a 5-point scale. For the item discrimination of the observation scale, an independent standard t-test was conducted to analyze the significant difference in average between the upper and lower groups for each item. The reliability of the observation scale was calculated by Cronbach's α, the intra-item agreement, and the validity was examined through content validity, the correlation between subdomains and total scores, and official validity using PICCOLO. Results: In item discrimination analysis, all items exhibited differences between upper and lower groups. The overall internal agreement for the observation scale was 0.95, with factor-specific internal agreement ranging from 0.83 to 0.95. The observation scale demonstrated notable correlations between total scores and sub-factors (0.45 to 0.93) and significant correlations with PICCOLO total scores (0.66 to 0.86). Conclusion/Implications: The study successfully verified the item discrimination, reliability, and validity of the Parent Play Interaction Observation Scale (PPIOS-Toddler).

Reliability and Validity on Oswestry Low Back Pain Disability Index(OLBPDI) in Patients with Low Back Pain (일부 요통환자를 대상으로 한 OLBPDI의 신뢰도 및 타당도)

  • Yi, Seung-Ju;Kim, Jin-Seop
    • Journal of Korean Physical Therapy Science
    • /
    • v.18 no.3
    • /
    • pp.53-61
    • /
    • 2011
  • Purpose : his study was to analyze the reliability and validity on Oswestry Low Back Pain Disability Index (OLBPDI) in patients with low back pain. Methods : The sample consisted of 211 patients who had received treatments at the physical therapy units of 3 medical institutions from February to December 2008 in Andong city. Questionnaires on the OLBPDI were recruited by 6 physical therapists. The internal structure and reliability of the scales were evaluated by means of item-internal consistency(Cronbach's alpha coefficient:${\alpha}$), item-discriminant validity, Pearson's relation coefficient. Results : An average of patients's age was 41.1 years. The range of OLBPDI subscales were .93~.94 in Cronbach's ${\alpha}$. The internal consistency reliability of total item-each item were also internally consistent with Cronbach's ${\alpha}$ range of .94~.95(Pearson's correlation coefficient range: .62~.89). However, high correlation were obtained among 10 items(.67~.83), therefore the item-discriminant validity was a little low. Conclusion: In conclusion, the results reported here confirm the reliability of the OLBPDI scales in patients with low back pain. The collection of information on the level of disability due to low back pain using this instrument was acceptable to patients. A further prospective multi-center study will be necessary to prove the reliability and validity.

  • PDF

Development of a lesbian, gay, bisexual, and transgender cultural competence scale for nurses in South Korea: a methodological study

  • Min Kyung Kim;Hye Young Kim
    • Women's Health Nursing
    • /
    • v.30 no.2
    • /
    • pp.107-116
    • /
    • 2024
  • Purpose: This study was conducted to develop a cultural competence scale for nurses regarding the lesbian, gay, bisexual, and transgender (LGBT) community and to test its validity and reliability. Methods: The study adhered to the 8-step process outlined by DeVellis, with an initial set of 25 items derived through a literature review and individual interviews. Following an expert validity assessment, 24 items were validated. Subsequently, a preliminary survey was conducted among 23 nurses with experience caring for LGBT patients. Data were then collected from a final sample of 322 nurses using the 24 items. Item analysis, item-total score correlation, examination of construct and convergent validity, and reliability testing were performed. Results: The item-level content validity index exceeded .80, and the explanatory power of the construct validity was 63.63%. The factor loadings varied between 0.57 and 0.80. The scale comprised five factors: cultural skills, with seven items; cultural awareness, with five items; cultural encounters, with three items; cultural pursuit, with three items; and cultural knowledge, with three items; totaling 21 items. Convergent validity demonstrated a high correlation, affirming the scale's validity. Internal consistency analysis yielded an overall reliability coefficient of 0.97, signifying very high reliability. Each item is scored from 1 to 6 (total score range, 21-126), with higher scores reflecting greater cultural competence in LGBT care. Conclusion: This scale facilitates the measurement of LGBT cultural competence among nurses. Therefore, its use should provide foundational data to support LGBT-focused nursing education programs.

Psychometric Properties and Item Evaluation of Korean Version of Night Eating Questionnaire (KNEQ) (한국어판 야식증후군 측정도구의 신뢰도, 타당도 및 문항반응이론에 의한 문항분석)

  • Kim, Beomjong;Kim, Inja;Choi, Heejung
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.1
    • /
    • pp.109-117
    • /
    • 2016
  • Purpose: The aim of this study was to develop a Korean version of Night Eating Questionnaire (KNEQ) and test its psychometric properties and evaluate items according to item response theory. Methods: The 14-item NEQ as a measure of severity of the night eating syndrome was translated into Korean, and then this KNEQ was evaluated. A total of 1171 participants aged 20 to 50 completed the KNEQ on the Internet. To test reliability and validity, Cronbach's alpha, correlation, simple regression, and factor analysis were used. Each item was analyzed according to Rasch-Andrich rating scale model and item difficulty, discrimination, infit/outfit, and point measure correlation were evaluated. Results: Construct validity was evident. Cronbach's alpha was .78. The items of evening hyperphagia and nocturnal ingestion showed high ability in discriminating people with night eating syndrome, while items of morning anorexia and mood/sleep provided relatively little information. The results of item analysis showed that item2 and item7 needed to be revised to improve the reliability of KNEQ. Conclusion: KNEQ is an appropriate instrument to measure severity of night eating syndrome with good validity and reliability. However, further studies are needed to find cut-off scores to screen persons with night eating syndrome.

Psychometric Properties of the Alzheimer's Disease Knowledge Scale-Korean Version (한국어판 알츠하이머병 지식 측정도구의 신뢰도와 타당도)

  • Kim, Eun Joo;Jung, Ji-Young
    • Journal of Korean Academy of Nursing
    • /
    • v.45 no.1
    • /
    • pp.107-117
    • /
    • 2015
  • Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

Reliability and Validity of Stroke Impact Scale 3.0 (뇌졸중 영향 척도 3.0의 신뢰도와 타당도)

  • Park, Eun-Young;Choi, Yoo-Im;Kim, Eun-Joo
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.8
    • /
    • pp.293-302
    • /
    • 2019
  • The purpose of this study was to examine the reliability and validity of Stroke Impact Scale 3.0 (SIS 3.0). Here, the SIS 3.0 was completed by 154 stroke patients (mean = 62.7; standard deviation [SD] = 9.43). Construct validity was verified by analyzing the correlation between SIS 3.0 sub-domains, and convergent validity was investigated by analyzing the correlation between the Modified Barthel Index (MBI) and the Mini-Mental State Examination-Korean (K-MMSE) version. The characteristics of each item were analyzed by internal consistency and item discrimination based on the classical item theory. Construct and convergent validity were verified through this study. Although the item i included in the emotion domain showed low item discrimination, all but this item showed high discrimination. Internal consistency was also high in all sub-domains.