• Title/Summary/Keyword: Validity assessment

Search Result 1,139, Processing Time 0.03 seconds

A Comparative Study on the Predictive Validity among Pressure Ulcer Risk Assessment Scales (욕창발생위험사정도구의 타당도 비교)

  • 이영희;정인숙;전성숙
    • Journal of Korean Academy of Nursing
    • /
    • v.33 no.2
    • /
    • pp.162-169
    • /
    • 2003
  • Purpose: This study was to compare the predictive validity of Norton Scale(1962), Cubbin & Jackson Scale(1991), and Song & Choi Scale(1991). Method: Data were collected three times per week from 48~72hours after admission based on the four pressure sore risk assessment scales and a skin assessment tool for pressure sore on 112 intensive care unit(ICU) patients in a educational hospital Ulsan during Dec, 11, 2000 to Feb, 10, 2001. Four indices of validity and area under the curve(AUC) of receiver operating characteristic(ROC) were calculated. Result: Based on the cut off point presented by the developer, sensitivity, specificity, positive predictive value, negative predictive value were as follows : Norton Scale : 97%, 18%, 35%, 93% respectively; Cubbin & Jackson Scale : 89%, 61%, 51%, 92%, respectively; and Song & Choi Scale : 100%, 18%, 36%, 100% respectively. Area under the curves(AUC) of receiver operating characteristic(ROC) were Norton Scale .737, Cubbin & Jackson Scale .826, Song & Choi Scale .683. Conclusion: The Cubbin & Jackson Scale was found to be the most valid pressure sore risk assessment tool. Further studies on patients with chronic conditions may be helpful to validate this finding.

Reliability and Validity of the Postural Assessment Scale for Stroke in Chronic Stroke Patients (만성뇌졸중 환자의 Postural Assessment Scale for Stroke의 신뢰도와 타당도)

  • An, Seung-Heon;Lee, Je-Hoon
    • The Journal of Korean Physical Therapy
    • /
    • v.21 no.1
    • /
    • pp.9-17
    • /
    • 2009
  • Purpose: The purpose of this study was to determine reliability and validity of the Postural Assessment Scale for Stroke Patients (PASS) in chronic stroke patients. Methods: A total of 43 stroke patients, who had a stroke more than 6 months previously, participated in the study. Reliability was determined by the intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method and Cronbach's alpha by internal consistency. Validity was examined by correlation the PASS scores to the Berg Balance Scale (BBS), Trunk Control Test (TCT), and Fugl-Meyer Balance (FM-B) score. Results: The intra-rater reliability and the Absolute reliability of the PASS was good ICC$_{3,1}$=0.97 (95%CI 0.95$\sim$0.99) and excellent SEM=1.01 respectively. Cronbach's alpha value for PASS was found to be 0.94. There were significant correlations between the PASS and BBS, TCT, FM-B (r=0.65-0.96, p<0.01). Conclusion: The PASS provide reliable and valid instrument of the postural control assessment for chronic stroke patients.

  • PDF

The Development of the Observation Assessment Criteria concerning the Manipulative skills in Elementary School Science (초등학교 과학실험 기구 조작 기능에 대한 관찰 평가 준거 개발 - 초등학교 화학 단원을 중심으로 -)

  • 최행숙;백성혜
    • Journal of Korean Elementary Science Education
    • /
    • v.18 no.1
    • /
    • pp.65-73
    • /
    • 1999
  • The purpose of this study is tile development of tile observation Assessment criteria that is used to assess manipulative skills in elementary science. The procedures of developing observation Assessment criteria are as follows. First, we investigated the actual condition about science process skills assessment with tile questionnaire. Second, we selected 7 experimental apparatus through the analysis of the science textbooks. The selected experimental apparatus are dropper, alcohol lamp, thermometer, test tube, filtering device, able balance, graduated cylinder Third, the observation Assessment criteria arc developed through tile analysis of the related experimental textbooks, the demonstrations, and the questionnaire, Forth, tile validity is verified by science education specialists and graduate students who major in science education. Fifth, the first jilter-rater agreement is investigated in the result of the field with observation criteria of which the validity was verified. The second inter-rater agreement is investigated through the revision and the addition of the criteria with the low agreement. In result, the jilter-rater agreement ranged from 0.86 to 0.98. One of the major problems in observation assessment is the rater's subjective viewpoint. So, this research shows a more specified scale and criteria for the assessment. This suggests that the observation Assessment criteria developed in tile study satisfies the high reliability and validity requirements. Considering the results, this criteria call be used effectively for assessing manipulative skills of elementary school students.

  • PDF

Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education (시뮬레이션 교육에서 간호학생의 의사소통능력 측정도구의 신뢰도와 타당도 검증)

  • Yang, Hee Mo;Hwang, Seon Young
    • Korean Journal of Adult Nursing
    • /
    • v.28 no.1
    • /
    • pp.95-105
    • /
    • 2016
  • Purpose: This study was conducted to test whether Health Communication Assessment Tool (HCAT) developed by Campbell et al. in 2013 can be applied to assess Korean nursing students' communication skills in simulation education. Methods: The content validity of the Korean version of HCAT (K-HCAT) was evaluated through expert's assessment and a principal component analysis was conducted for testing construct validity. The convergent validity was tested by measuring relationship between the K-HCAT and those of existing communication assessment tool for standardized patient instruction. The evaluation was done by surveying 154 senior students from four different nursing colleges. Results: The K-HCAT was condensed into 15 items from the original 22 HCAT items. Four factors were extracted from the principal component analysis; factor loadings ranged from .50 to .83; cumulative explained variance was 62.65%. Four factors were entitled as 'relationship building', 'empowering', 'empathy/response', and 'education/feedback'. Cronbach's ${\alpha}$ for sub-dimensions ranged from .73 to .84. An evaluation of convergent validity showed that the scores of the K-HCAT were moderately correlated with those of an assessment tool for standardized patient instruction. Conclusion: The K-HCAT can be used as an effective tool for assessing nursing students' communication skills in various kinds of simulation educations Further research is needed to test the consistency of the K-HCAT.

Nursing needs assessment scale for women with infertility: development and validation (난임 여성의 간호 요구 측정 도구 개발 및 타당도 검정)

  • Park, Jummi;Shin, Nayeon;Lee, Kyungmi
    • Women's Health Nursing
    • /
    • v.26 no.2
    • /
    • pp.141-150
    • /
    • 2020
  • Purpose: High-quality nursing care must be provided for women with infertility, and their nursing needs must be identified. Although scales have been developed to assess infertility-related stress, quality of life, and psychosocial status, there is a lack of scales that assess the nursing needs of women with infertility. The purpose of this study was to develop a needs assessment scale for nursing care in women with infertility and to verify its reliability and validity. Methods: The 250 subjects in this study were women with infertility recruited from four hospitals. The scale was developed following the framework of DeVellis, through a literature review, in-depth interviews, development of preliminary items, verification of content validity, development of secondary items, verification of construct validity, and extraction of the final items. Date were analyzed using item analysis, factor analysis, confirmatory factor analysis, Pearson correlation coefficients, and Cronbach's alpha. Reliability was tested using Cronbach's alpha, and validity was evaluated using item analysis, exploratory factor analysis, and criterion validity. Results: The final version of the nursing needs assessment scale for woman with infertility consisted of 18 items. Four factors (physical and psychological nursing needs, needs for information regarding treatment, needs for infertility-related understanding and concern, and supportive needs) explained 66.0% of the total variance. Cronbach's alpha was .92 for the overall instrument and ranged from .88 to .91 for the subscales. Conclusion: These results suggest that this needs assessment scale for nursing care in women with infertility demonstrated acceptable validity and reliability and contained items suitable for assessing the level of nursing care needed by women with infertility.

Convergent and Discriminant Validity of the Toddler Behavior Assessment Questionnaire in Korean Children (걸음마기 아동 기질척도의 타당도 연구)

  • Park, Seong Yeon;Rubin, Kenneth H.
    • Korean Journal of Child Studies
    • /
    • v.28 no.5
    • /
    • pp.55-72
    • /
    • 2007
  • Replication of the factor structure of the TBAQ(Toddler Behavior Assessment Questionnaire Goldsmith, 1988) in Korean 2-year-old children was examined by Multitrait Multimethod matrix of observed and reported child behavior. Participants included 113 toddlers and their mothers. Three factors comprising 63 items were identified and labeled as easy, difficult and fearful. On the Child Behavior Checklist(Achenbach & Edelbrock, 1983) difficult temperament was positively related to externalizing while fearful temperament was positively related to internalizing problems. Observation of inhibited child behavior in both unfamiliar social and nonsocial situations demonstrated a positive relationship to observed inhibition of fearful temperament. Easy temperament correlated negatively with both social inhibition and internal behavior problems. Results supported construct validity of TBAQ factors for Korean 2-year-old children.

  • PDF

Development and Validation of the New Version of Spirituality Assessment Scale (영성 측정도구 개발과 평가)

  • Ko, Il-Sun;Choi, Soyoung;Kim, Jin Sook
    • Journal of Korean Academy of Nursing
    • /
    • v.50 no.1
    • /
    • pp.132-146
    • /
    • 2020
  • Purpose: The purpose of this study was to develop a new version of Spirituality Assessment Scale (N-SAS) and verify its reliability and validity. Methods: The total of 59 preliminary items for the N-SAS were selected through a literature review, two rounds of experts' content validation, cognitive interviews, and pre-tests. Verification of its reliability and validity was divided into two phases. In Phase I, questionnaires were collected from 219 adults. Reliability was tested using Cronbach's alpha, validity with item analysis, and exploratory factor analysis. In Phase II, questionnaires developed based on the results of Phase I were collected from 225 adults. Reliability was tested using Cronbach's alpha, validity with confirmatory factor analysis, and criterion validity. Results: The final version of the N-SAS comprised two dimensions (vertical and horizontal), four domains (relationship with God; meaning of life and self-integration; self-transcendence; and relationship with others, neighborhoods, and nature), and 44 items were identified. Total Cronbach's α was .97; those of each subscale ranged from .79 to .98. N-SAS scores were positively correlated with the scores of Howden's Spiritual Assessment Scale (r=.81, p<.001). Conclusion: Findings suggest that the N-SAS can be used to measure spirituality in adults. The use of N-SAS is expected to facilitate perceiving patient's spiritual needs and providing spiritual care.

Development of Health Assessment Tool for Middle-aged Adults in Long-term Care Settings (중년기 요양 환자의 건강사정도구 개발)

  • Park, Yoon-Jin;Kim, Nam Cho
    • The Korean Journal of Rehabilitation Nursing
    • /
    • v.20 no.1
    • /
    • pp.1-11
    • /
    • 2017
  • Purpose: This was a methodological study to develop a valid and reliable health assessment tool for middle-aged adults in long-term care settings (HATMAL). Methods: At the first stage of this study, initial 56-items HATMAL were derived via literature review, survey for needs assessment, and focus group interviews with experts. At the second stage, 54 items HATMAL were finalized via content validity test with 5 experts and a pilot study with 30 nurses. At the third stage, validity and reliability tests were conducted with 100 middle-aged patients in a long-term care hospital. Data were analyzed by factor analysis using SPSS 18.0 program. Results: Exploratory factor analysis resulted in 3 factors; functional assessment, symptom assessment, and comfort assessment. These 3 factors explained 83.8% of total variance and construct validity was confirmed. Test-retest reliability was .67 for appetite changes, .76 for regulating for behavior problems, and 1.0 for other items. Conclusion: Results indicate that HATMAL is valid and reliable to assess the health for middle-aged patients in long-term care settings. This study would contribute to provide more effective personalized treatment and care for middle-aged patients in long-term care settings considering their own characteristics.

Issues Related to the Objectivity of Student Assessment in Medical Education (의학교육 학생평가의 객관성에 대한 쟁점)

  • Min, Kyung-Seok;Yang, Kil-Seok
    • Korean Medical Education Review
    • /
    • v.15 no.3
    • /
    • pp.105-111
    • /
    • 2013
  • This paper addressed various issues related to the objectivity of student assessment in medical education. The objectivity of assessment was related to all the steps of test development, administration, and results reporting in terms of reliability and validity. Specifically, the objectivity of item formats, representativeness of test content, standardization of test administration, consistency of scoring procedures, and appropriateness of reporting test results were discussed by comparing performance assessment with traditional paper-and-pencil tests. The conclusions were derived from current measurement theories such as standards-based assessment, evidencebased design, and outcome-based assessment. Further, based on Shepard's propositions (2006), the objectivity of student assessment could be achieved by improving the concordance between educational objectives and assessment components such as item types, test contents, and test administration, scoring, and reporting.

Development of Program Outcome Self-Assessment Tool in Korean Nursing Baccalaureate Education (간호학 프로그램 학습성과 간접측정 도구개발)

  • Kim, Hyun-Kyoung
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.21 no.2
    • /
    • pp.215-226
    • /
    • 2015
  • Purpose: This study aimed to develop a self-assessment tool to evaluate program outcomes of nursing students in Korean nursing undergraduate education. Methods: The instrument development process consisted of literature review, focus group interviews, and item validation. A total of 117 items were analyzed through content validity testing. Data was gathered from 302 nursing students in Korea and analyzed using SPSS 21.0. Results: To construct validity, principal component analysis and Varimax rotation were used, and 12 factors, with a cumulative explanatory variance of 69.16%, were determined from 79 items. For internal consistency and reliability, Cronbach's ${\alpha}$ was .91. The half-split reliability results were .84 and .85, and the ROC curve showed an optimal cutpoint at 227. A five-point Likert scale was used for scoring. Conclusion: This instrument was found to have fair validity and reliability as a self-assessment tool for nursing student learning outcomes. Therefore, it can be used to evaluate program outcomes indirectly in nursing schools.