• Title/Summary/Keyword: statistical validity test

Search Result 279, Processing Time 0.026 seconds

A Comparison of Landscape Evaluation between the Internet and Slide Method (인터넷과 슬라이드를 이용한 경관평가방법의 비교)

  • Huh, Joon
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.29 no.5
    • /
    • pp.20-27
    • /
    • 2001
  • The purpose of this study is to investigate and compare the validity and the reliability of the visual simulation method using the internet. For this. the evaluation of the artificial and natural landscape through the medium of color slides are compared with the internet survey. Data is analysed through the comparison of t-test between the two media by landscape type, and spatial image is analysed by factor analysis algorithm. Principle component analysis using Varimax Method is applied for extraction and factor rotation respectively. The results of this study can be summarized as follows; There are no statistical differences between the two methods with artificial and natural landscape in the total data that included second tests. Factors covering the spatial image are found to be \`aesthetic\`, \`spatial shape\`, and \`familiarity\`. Total variance is obtained as 66.4%. There are no statistical differences between the two methods in 2/3 of the cases. In the case of far view of artificial landscape, the results of the t-test show that the two methods are exactly the same. Especially in the case of the artificial far landscape shows no difference of all factors between two methods. There are no differences between first and second tests of the same media and the same landscape type. And it shows the reliability of this method. These results suggest that the probability that the internet can be used as a medium of landscape evaluation and gathering information on anyone\`s landscape image. Simulation techniques with the internet survey method should be further developed for practical application.

  • PDF

Use and Misuse of Statistical Methods in the Journal of Korean Academy of Nursing Administration (간호행정학회지 게재논문의 통계학적 방법 사용과 오류)

  • Song, Kijun
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.19 no.1
    • /
    • pp.146-154
    • /
    • 2013
  • Purpose: To do nursing research effectively requires an understanding of fundamental principles of statistical methods. In this article, some key statistical methods which are commonly used in nursing research are identified and summarized. Methods: Ninety-two original articles from the Journal of Korean Academy of Nursing Administration were reviewed. Statistical methods were classified and summarized for usage in research and occurrence of common errors. Results: Among the original articles reviewed, 58 statistical usages contained errors. Most errors were found in linear regression analysis, Pearson correlation analysis, and chi-square test. From the detection of statistical errors in usage, suggestions for appropriate statistical methods were made. Conclusion: In order to improve validity of original articles in the Journal of Korean Academy of Nursing Administration, clearly stated statistical usage and close editorial attention to statistical methods are needed. Understanding statistical methods is part of the process that researchers must use to determine both quality and usefulness of the research. Research findings will be used to guide nursing practice and reduce uncertainty in decision making. However, to understand how to interpret research results, it is important to be able to understand basic statistical concepts. Researchers should also choose statistical methods that match their purposes.

Visualization in the assessment of construct validity (구성타당도 평가를 위한 시각화방법)

  • Noh, Hohsuk;Song, Ji Na;Cho, Hyeyoon
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.2
    • /
    • pp.381-388
    • /
    • 2016
  • It is common to quantify the concept of interest in the social and human sciences to test a research hypothesis. In such a case, it is strongly recommended to investigate if the procedure is appropriately designed and implemented according the research purpose since the quantification procedure highly affects the result of statistical analysis. In this work, we propose a visualization tool which enables us to check the construct validity of a measurement tool (such a questionnaire) in a concise and convenient way based on a penalized factor analysis model. We illustrate our method with numerical simulation and real data analysis.

Development of a Reward Scale for Hospital Nurses (병원간호사의 보상 측정도구 개발)

  • Kim, Sun Hee;Kim, Eun-Young
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.5
    • /
    • pp.525-537
    • /
    • 2023
  • Purpose: This study aimed to develop and test a reward scale for hospital nurses. Methods: The initial items were identified through a literature review and focus group interviews with ten hospital nurses. The content validity of the items was evaluated by ten experts. Fifty-one items were derived from the pilot survey. Four hundred eighty-eight nurses participated in the study: 248 for exploratory factor analysis (EFA) and 240 confirmatory factor analysis (CFA). Data were analyzed using item analysis, EFA, CFA, convergent validity, known-group validity, and internal consistency using IBM SPSS Statistics 29.0 and IBM SPSS AMOS 29.0. Results: The final scale consisted of 31 items and eight factors (decent wage, opportunity to grow and develop, support for special situations, various benefits, flexibility of work, job-related achievement, reflecting career and performance, and recognition), which explained 67.3% of the total variance. The eight-subscale model was validated by CFA. Convergent validity was evaluated by analyzing correlation with intention to leave (r = - .63, p < .001) and job satisfaction (r = .54, p < .001). The known-group validity was evaluated by comparing the reward scales according to age, clinical career, income level and hospital type. The scale was found to be reliable with a Cronbach's α of .89. Conclusion: Both the validity and reliability of the reward scale for hospital nurses are verified, which can enhance the understanding of the range of rewards and may assist nurse managers in establishing an effective reward system.

Assessing the Validity of the Preclinical Objective Structured Clinical Examination Using Messick's Validity Framework (Messick의 타당도 틀을 활용한 임상실습 전 실기시험의 타당도 평가)

  • Lee, Hye-Yoon;Yune, So-Jung;Lee, Sang-Yeoup;Im, Sunju
    • Korean Medical Education Review
    • /
    • v.23 no.3
    • /
    • pp.185-193
    • /
    • 2021
  • Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.

A Validation Study on the Home Observation for Measurement of the Environment in Elementary Children (가정환경검사(HOME)의 타당화 연구)

  • Lee, Ju-Lie
    • Journal of Families and Better Life
    • /
    • v.10 no.1 s.19
    • /
    • pp.1-13
    • /
    • 1992
  • The purpose of this study was to validate the Elementary HOME(Home Observation for Measurement of the Environment) with korean elementary children. Subjects were 536 mothers 1st-5th graders in the elementary schools in the Seoul. Pearson's r, pearcentage(%), phi($\phi$/), Cronbach's $\alpha$/ ware conducted for the statistical analysis. The major findings were as follows. 1) The item pass rate(percentage) were ranged 16~98. 2) The discriminant coefficients($\phi$/) of the item were ranged 0.06~0.58. 3) The reliability coefficients of the scale were that the split-falf was 0.84, and Cronbach's $\alpha$/ was 0.88. Considering the length of the scale, these reliability estimates appear to be at an acceptable level 4) The factor analysis and the correlations between HOME and SES indices and children's school schievement to test construct validity were conducted to test construct validity. Eight factors were extracted from the factor analysis and coefficients(r) were ranged 0.16~0.45 and -0.08~0.37.

  • PDF

Verification on Validity of Teacher Efficacy Scale in Home Economics Teachers (가정과교사의 교사 효능감 측정도구 타당도 검증)

  • Kim Yu-Jeong
    • Journal of Korean Home Economics Education Association
    • /
    • v.17 no.2
    • /
    • pp.129-143
    • /
    • 2005
  • The purpose of this study was to verify the validity of Ohio State Teacher Efficacy Scale(OSTES: Tschannen-Moran, 2000) when used with Korean home economics teachers. To achieve this purposes, the surveys with 263 secondary school home economics teachers was conducted by the prime investigator. Statistical procedures included descriptive statistics, factor analysis, internal consistency. Cronbach's a was calculated to test the reliability of items and their internal consistency and Exploratory Factor Analysis(EFA) was conducted to test the structure of each factors with principal analysis and varimax rotation. Confirmatory Factor Analysis(CFA) was conducted to test the factor validity of this scale with AMOS program. The reliability test result of 20 items appeared Cronbach's a=.86. The factor analysis on teacher efficacy with 263 survey of secondary school home economics teachers produced 5 factors including efficacy in classroom management. efficacy in needs assistance, efficacy in instructional strategies, efficacy in environmental assistance and efficacy in teaming assistance. The validity of teacher efficacy scale was moderately verified by the confirmatory factor analyses(GFI=.87, AGFI=.84. CFI=.86. PNFI=.72, RMR=.05. RMSEA=.07). The results lend a support to the teacher efficacy scale as a valid instrument.

  • PDF

The Reliability and Validity of the Korean Version of the 5C Psychological Antecedents of Vaccination Scale (한국어판 예방접종에 대한 심리적 소인 측정도구의 신뢰도와 타당도 검증)

  • Bae, SuYeon;Kim, HeeJu
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.3
    • /
    • pp.324-339
    • /
    • 2023
  • Purpose: This study aimed to valuate the reliability and validity of the Korean version of the 5C Psychological Antecedents of Vaccination (K-5C) scale. Methods: The English version of the 5C scale was translated into Korean, following the World Health Organization guidelines. Data were collected from 316 community-dwelling adults. Content validity was evaluated using the content validity index, while construct validity was evaluated through confirmatory factor analysis. Convergent validity was examined by assessing the correlation with vaccination attitude, and concurrent validity was evaluated by examining the association with coronavirus disease 2019 (COVID-19) vaccination status. Internal consistency and test-retest reliability were also evaluated. Results: Content validity results indicated an item-level content validity index ranging from .83 to 1, and scale-level content validity index, averaging method was .95. Confirmatory factor analysis supported the fit of the measurement model, comprising a five-factor structure with a 15-item questionnaire (RMSEA = .05, SRMR = .05, CFI = .97, TLI = .96). Convergent validity was acceptable with a significant correlation between each sub-scale of the 5C scale and vaccination attitude. In concurrent validity evaluation, confidence, constraints, and collective responsibility of the 5C scale were significant independent predictors of the current COVID-19 vaccination status. Cronbach's alpha for each subscale ranged from .78 to .88, and the intraclass correlation coefficient for each subscale ranged from .67 to .89. Conclusion: The Korean version of the 5C scale is a valid and reliable tool to assess the psychological antecedents of vaccination among Korean adults.

The Development of Motivation Scale in the Visual Artistic Giftedness of the Elementary School Children (학동기 미술영재성 동기요인 검사도구 개발)

  • 이용애
    • Journal of Gifted/Talented Education
    • /
    • v.13 no.2
    • /
    • pp.23-41
    • /
    • 2003
  • The purpose of this study was to develop the instruments which can measure motivation as a component of Visual Artistic Giftedness with in elementary school period. This study prescribed the variable factors of measurement after abstract and classify the characteristics of Visual Artistic Giftedness through literature studies. And it produced instruments those are finally composed of 27 items through the preliminary test. They were evaluated in terms of content validity, construct validity, and reliability by implementing them to 679 elementary school children from the first to sixth grades. Statistical analyses were carried out to verify the validities and reliability. Content validity was found to be satisfactory by experts' evaluation on the test items. Construct validity was also found to be satisfactory through factor analyses which showed the four factors which the identification instruments were intended to measure such as, interest/ attitude/ taste, endurance/ concentration, curiosity/ imagination! sensitiveness, aesthetic. Concurrent validity was also found to be satisfactory with high coeffients of Barron- Welsh which were calculated as .76 in motivation. In conclusion, the instruments about motivation of Visual Artistic Giftedness during elementary school period developed by this study are highly reliable on its reliability and validity.

Reliability and Validity of the Assessment Tool for Measuring Communication Skills in Nursing Simulation Education (시뮬레이션 교육에서 간호학생의 의사소통능력 측정도구의 신뢰도와 타당도 검증)

  • Yang, Hee Mo;Hwang, Seon Young
    • Korean Journal of Adult Nursing
    • /
    • v.28 no.1
    • /
    • pp.95-105
    • /
    • 2016
  • Purpose: This study was conducted to test whether Health Communication Assessment Tool (HCAT) developed by Campbell et al. in 2013 can be applied to assess Korean nursing students' communication skills in simulation education. Methods: The content validity of the Korean version of HCAT (K-HCAT) was evaluated through expert's assessment and a principal component analysis was conducted for testing construct validity. The convergent validity was tested by measuring relationship between the K-HCAT and those of existing communication assessment tool for standardized patient instruction. The evaluation was done by surveying 154 senior students from four different nursing colleges. Results: The K-HCAT was condensed into 15 items from the original 22 HCAT items. Four factors were extracted from the principal component analysis; factor loadings ranged from .50 to .83; cumulative explained variance was 62.65%. Four factors were entitled as 'relationship building', 'empowering', 'empathy/response', and 'education/feedback'. Cronbach's ${\alpha}$ for sub-dimensions ranged from .73 to .84. An evaluation of convergent validity showed that the scores of the K-HCAT were moderately correlated with those of an assessment tool for standardized patient instruction. Conclusion: The K-HCAT can be used as an effective tool for assessing nursing students' communication skills in various kinds of simulation educations Further research is needed to test the consistency of the K-HCAT.