• Title/Summary/Keyword: validity

Search Result 15,876, Processing Time 0.042 seconds

A Study on the Validity and Reliability of Performance Assessment in Home Economics (가정과 수행평가의 타당성과 신뢰성 연구 - 경남 농촌지역의 소인수 학급을 대상으로 -)

  • 윤성희;유태명
    • Journal of the Korean Home Economics Association
    • /
    • v.39 no.10
    • /
    • pp.169-186
    • /
    • 2001
  • The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

  • PDF

Reliability and Validity of Patient Self-reported Daily Questionnaire on Oral Mucositis in Acute Leukemic Patients under Chemotherapy (화학요법을 받는 급성백혈병 환자 자가보고형 구강점막염 사정도구의 신뢰도와 타당도 분석)

  • Choi, So-Eun;Kim, Hee-Seung
    • Journal of Korean Biological Nursing Science
    • /
    • v.12 no.3
    • /
    • pp.148-156
    • /
    • 2010
  • Purpose: Oral mucositis (OM) is a serious consequence of chemotherapy that cancer patients must undergo. The objectives of this study were to find out reliability and validity of patients self-reported daily questionnaires on OM, and the impact OM makes on daily functions. Method: To test the reliability of oral mucositis daily questionnaire (OMDQ), internal consistency of the instrument (Cronbach's ${\alpha}$ and correlation between items) and test-retest reliability were analyzed. Criterion validity and discriminative validity were evaluated using WHO, oral assessment guide, and Nicolatou assessment tool. Forty-eight acute leukemic patients under chemotherapy were enrolled in this study. Result: The Cronbach's ${\alpha}$ coefficient indicated sufficient internal consistency. Correlations of Mouth and throat soreness (MTS) and MTSActivity Limitations (MTS-AL) were statistically significant. MTS and MTS-AL scores on consecutive days were highly correlated (days13,14=.84-.96; test-retest reliability). OMDQ scale had high criterion validity and discriminative validity. Patients with more severe WHO OM grades had higher MTS mean scores. Conclusion: Oral mucositis in acute leukemic patients under going chemotherapy can be easily quantified by patient self-administered OMDQ with reliability and validity.

Development of a Wellness Index for Workers (근로자를 위한 웰니스지표 개발)

  • Choi, Moon-Jong;Son, Chang-Sik;Kim, Jinsu;Ha, Yeongmi
    • Journal of Korean Academy of Nursing
    • /
    • v.46 no.1
    • /
    • pp.69-78
    • /
    • 2016
  • Purpose: The purpose of this study was to develop a wellness index for workers (WIW) and examine the validity and reliability of the WIW for assessing workers' wellness. Methods: The developmental process for the instrument included construction of a conceptual framework based on a wellness model, generation of initial items, verification of content validity, preliminary study, extraction of final items, and psychometric testing. Content validity was verified by 4 experts from occupational health nursing and wellness disciplines. The construct validity, convergent validity and discriminant validity were examined with confirmatory factor analysis. The reliability was examined with Cronbach's alpha. The participants were 494 workers from two workplaces. Results: Eighteen items were selected for the final scale, and the results of the confirmatory factor analysis supported a five-factor model of wellness with acceptable model fit, and factors named as physical emotional social intellectual occupational wellness. The convergent and discriminant validity were also supported. The Cronbach's alpha coefficient was .91. Conclusion: The results indicate that the WIW is a valid and reliable instrument to comprehensively assess workers' wellness, and to provide basic directions for developing workplace wellness program.

Reliability and Validity of the Clinical Competency Scale for Nursing Students (간호대학생의 임상수행능력 측정도구의 신뢰도와 타당도)

  • Kim, Bo Young;Chae, Myeong Jeong;Choi, Yun Ok
    • Research in Community and Public Health Nursing
    • /
    • v.29 no.2
    • /
    • pp.220-230
    • /
    • 2018
  • Purpose: This study was conducted to evaluate clinical competency of nursing students and to examine the validity and reliability of the scale. Methods: The Clinical Competency Scale was formed through modification of Lee's Clinical Competency Scale that was originally developed in 1990. The Clinical Competency Scale was applied to 203 nursing students. Construct validity, item convergent and discriminant validity, concurrent validity, and internal consistency reliability of the scale were evaluated. Results: Exploratory factor analysis supported the construct validity with a five factor solution; that explained 63.6% of the total variance. Concurrent validity was demonstrated with the Nursing Competence Scale (r=.78, p<.001). Cronbach's ${\alpha}$ coefficient for the scale was .96. Conclusion: The results of this study suggest that the Clinical Competency Scale has relatively acceptable reliability and validity and can be used in clinical research to assess clinical competency for nursing students.

Review on Reliability and Validity of Questionnaire of Pattern Identification in Traditional Chinese Medicine -Using China National Knowledge Infrastructure- (중의 변증 설문도구의 신뢰도 및 타당도 고찰 -China National Knowledge Infrastructure를 이용하여-)

  • Yeo, Min Kyung;Dong, Sang Oak;Lee, Young Seop;Jang, Eun Su
    • Journal of Physiology & Pathology in Korean Medicine
    • /
    • v.29 no.3
    • /
    • pp.246-255
    • /
    • 2015
  • The purpose of this study is to investigate the reliability and validity of the questionnaire of pattern identification (PI) in traditional chinese medicine (TCM), through the systematic review of china national knowledge infrastructure (CNKI) database. We searched the articles related with reliability and validity of the questionnaire of PI and published from January 1994 to December 2013. Seventeen questionnaires were analyzed in this study. The twelve (70.6%) questionnaires were developed on the base of specific disease, and five (29.4%) ones were developed on the base of non-specific disease. Three of PI questionnaires showed low inter-item consistency reliability. Exploratory factor analysis of construct validity, content validity, and criterion validity analysis were commonly used on the assessment of validity, but none of them was analysed at the same study. There was only one questionnaire of the ischemic stroke that examined the sensitivity and specificity of both training and test groups in spite of the absence of a gold standard.

Development of the Patient Caring Communication Scale (환자 돌봄 의사소통 측정 도구 개발)

  • Heo, Myoung Lyun;Im, Sook Bin
    • Journal of Korean Academy of Nursing
    • /
    • v.49 no.1
    • /
    • pp.80-91
    • /
    • 2019
  • Purpose: This study attempted to develop a scale that measures the level of patients' recognition of the nurses' care, based on Watson's caring theory, and confirmed its reliability and validity. Methods: The items were developed through a literature review and an expert content validity test. The questionnaires were administered to 285 inpatients of internal medicine and surgical units at two general hospitals. Construct validity was tested using exploratory and confirmatory factor analysis, and reliability was tested using Cronbach's alpha. Results: This process resulted in a preliminary scale composed of 34 items; We used item analysis and five exploratory factor analyses, and consequently selected 14 items composed of three factors (respect, genuineness, and relationality). The confirmatory factor analysis verified the model fit and convergent and discriminant validity of the final items; criterion validity was confirmed with the positive correlation with the measurement scale of the patient-perceived quality of nursing. The overall scale reliability had a Cronbach's alpha of .92, which indicated internal consistency and reliability. Conclusion: The developed scale showed content, construct, and criterion validity, and reliability, as well as convergent validity for each item and discriminant validity between the factors. This makes it suitable for use in a diverse range of future studies on nurse communication using structural equation models.

Psychometric properties of an instrument 2: structural validity, internal consistency, and cross-cultural validity/measurement invariance (측정도구의 심리계량적 속성 2: 구조타당도, 내적일관성 및 교차문화타당도/측정동일성)

  • Lee, Eun-Hyun
    • Women's Health Nursing
    • /
    • v.27 no.2
    • /
    • pp.69-74
    • /
    • 2021
  • Structural validity, internal consistency, and cross-cultural validity/measurement invariance are psychometric properties of the internal structure of an instrument. In psychometric studies published in Korean nursing journals, structural validity has mainly been assessed using confirmatory factor analysis. Cross-cultural validity/measurement invariance has rarely been evaluated. It is recommended for Korean nursing researchers to evaluate the internal structure of instruments using a greater variety of methods, such as item response theory, Rasch analysis, multi-group confirmatory factor analysis, and differential item functioning.

Validity and Reliability of the Korean Version of Advance Directives Attitude Scale for Nurses (한국어판 사전연명의료의향에 대한 간호사 태도 도구의 타당도와 신뢰도)

  • Kim, Kyeongtae;Park, Youngry
    • Journal of Korean Critical Care Nursing
    • /
    • v.15 no.2
    • /
    • pp.64-76
    • /
    • 2022
  • Purpose : This study aimed to verify the validity and reliability of the Korean version of the nurses' attitude scale toward advance directives of patients. Methods : We translated and back-translated the original tool consisting of 20 questions and tested and verified its content validity. Questions for which its content validity has been verified, a preliminary investigation was conducted among 20 nurses working in ICU, followed by the actual investigation. Data were analyzed using SPSS version 24.0 for Windows and Mac and AMOS version 24.0. To verify the validity, an item analysis was conducted for all 398 samples, and then an exploratory factor analysis for 200 samples that were randomly selected, followed by a confirmatory factor analysis for the remaining 198 samples. Results : Korean version of advance directives attitude scale (K-ADAS) consisting of 14 questions - 7 questions on 'patient rights,' 4 questions on 'role of a nurse,' and 3 questions on 'ethical judgment' - was verified its validity and reliability. Conclusion : In this study, the validity and reliability of the K-ADAS have been verified. We expect the verified tool to be useful in various fields that measuring the nurses' attitude toward advance directives of patients.

THE VALIDITY OF HEALTH ASSESSMENTS: RESOLVING SOME RECENT DIFFERENCES

  • Hyland Michael E.
    • 대한예방의학회:학술대회논문집
    • /
    • 1994.02b
    • /
    • pp.137-141
    • /
    • 1994
  • The purpose of this paper is to examine what is meant by a ralid measure of health. Guyatt, Kirshner and Jaeschke propose that health tests should be designed so as to have one of several kinds of validity: 'longitudinal construct validity' for those which are used for longitudinal research designs, and 'cross-sectional construct validity' for those which are used for cross-sectional designs. Williams and Naylor argue that this approach to test classification and validation confuses what a test purports to measure with the purpose for which it is used, and that some tests have multiple uses. A review of the meanings of validity in the psychologica test literature shows that both sets of authors use the term validity in an idiosyncratic way. Although the use of a test (evaluated by content validity) should not be conflated with whether the test actually measures a specified construct (evaluated by construct validity);' if health is actually made up of several constructs (as suggested in Hyland's interactional model) then there may be an association between types of construct and types of purpose. Evidence is reviewed that people make several, independent judgements about their health: cognitive perceptions of health problems are likely to be more sensitive to change in a longitudinal research design. whereas emotional evaluations of health provide less bias in cross-sectional designs. Thus. a classification of health measures in terms of the purpose of the test may parallel a classification in terms of what tests purport to measure.

  • PDF

Validity and Reliability of a Korean Version of Yale Food Addiction Scale for Children (YFAS-C) (한국판 청소년용 음식중독도구의 타당도와 신뢰도)

  • Kim, Jung Ho;Song, Ji Hyun;Kim, Ran;Jang, Mi Young;Hong, Hyon Joo;Kim, Hyun Ji;Shin, Sung Hee
    • Journal of Korean Academy of Nursing
    • /
    • v.49 no.1
    • /
    • pp.59-68
    • /
    • 2019
  • Purpose: This study evaluated the psychometric properties of the Korean version of Yale Food Addiction Scale for Children (YFAS-C). Methods: Participants were 419 young adolescent students (11~15 years old). The content validity of the expert group was calculated as the content validity index (CVI) after the translation and reverse translation process of the 25 items of the YFAS-C. The multitrait-multimethod matrix (MTMM) method was used to verify the construct validity; the generalized linear model (GLM) was used to evaluate the concurrent and incremental validity. Reliability was calculated as Kuder-Richardson-20 (KR-20) and Spearman-Brown coefficients. Results: The CVI of the 25 items was greater than the item-level CVI .80 and the scale-level CVI .90. The Korean version of YFAS-C had verified convergent validity in emotional eating and external eating and discriminant validity in restrained eating. In addition, it had verified concurrent validity in emotional eating and external eating. Finally the incremental validity of the Korean version of YFAS-C was statistically significant on BMI. Reliability was KR-20 ${\alpha}=.69$ and the Spearman-Brown coefficient was .64. Conclusion: The Korean version of YFAS-C is a valid and reliable scale for measuring the severity of food addiction; it can be a useful scale for preventing obesity by predicting food addiction early.