• Journal of The Korean Association For Science Education
• /
• v.34 no.2
• /
• pp.123-134
• /
• 2014

This study aims to develop and validate an instrument to measure students' attitude toward convergence. To do so, we have defined five constructs (i.e. knowledge about convergence, personal relevance, social relevance, interest and self-efficacy) of 'attitude toward convergence' based on literature review, developed items, and collected data from 233 11th grade science track students. The validity of these items have been evaluated by Messick's framework (1995) (i.e. content, substantive, structural aspects of validity), experts' review, Rasch analysis, and confirmatory factor analysis using structural equation modeling. Our results have confirmed the five constructs and 23 selected items have met the benchmark of item validity. Moreover, the theoretical model illustrating that the high level of attitude toward convergence increases the level of science motivation has also been supported by the data. The items developed in this study will be used to measure students' attitude toward convergence and to estimate the effect of learning program for convergence science.

• Journal of the Korean Chemical Society
• /
• v.63 no.2
• /
• pp.102-110
• /
• 2019

The purpose of this study was to explore the progression levels of science metamodeling knowledge through using questionnaires for 97 students of the gifted in G science academy. As a result of the Rasch model analysis, it was confirmed that the progression levels of the scientific metamodeling knowledge is suitable for the person reliability of 0.71 and the item reliability of 0.96. The progression levels of students' science metamodeling knowledge were classified into 4 stages. First and second levels were considered model to be objective and the third and fourth stages were perceived as subjective. The first level is to view the model as a visual representation of a phenomenon as it is, and the second level is to think that the model corresponds to objective knowledge or theory and is a tool for explanation. The Third level looks at the model as a scientist's exploration tool and fourth level is to think that the model is provisional one and multiple models can coexist in one phenomenon. The progression levels of science metamodeling knowledge of science high school students derived from this study is expected to be used as a reference when constructing a curriculum for science modeling and modeling for gifted students.

• Journal of Korean Academy of Nursing
• /
• v.46 no.1
• /
• pp.109-117
• /
• 2016

Purpose: The aim of this study was to develop a Korean version of Night Eating Questionnaire (KNEQ) and test its psychometric properties and evaluate items according to item response theory. Methods: The 14-item NEQ as a measure of severity of the night eating syndrome was translated into Korean, and then this KNEQ was evaluated. A total of 1171 participants aged 20 to 50 completed the KNEQ on the Internet. To test reliability and validity, Cronbach's alpha, correlation, simple regression, and factor analysis were used. Each item was analyzed according to Rasch-Andrich rating scale model and item difficulty, discrimination, infit/outfit, and point measure correlation were evaluated. Results: Construct validity was evident. Cronbach's alpha was .78. The items of evening hyperphagia and nocturnal ingestion showed high ability in discriminating people with night eating syndrome, while items of morning anorexia and mood/sleep provided relatively little information. The results of item analysis showed that item2 and item7 needed to be revised to improve the reliability of KNEQ. Conclusion: KNEQ is an appropriate instrument to measure severity of night eating syndrome with good validity and reliability. However, further studies are needed to find cut-off scores to screen persons with night eating syndrome.

• Women's Health Nursing
• /
• v.27 no.2
• /
• pp.69-74
• /
• 2021

Structural validity, internal consistency, and cross-cultural validity/measurement invariance are psychometric properties of the internal structure of an instrument. In psychometric studies published in Korean nursing journals, structural validity has mainly been assessed using confirmatory factor analysis. Cross-cultural validity/measurement invariance has rarely been evaluated. It is recommended for Korean nursing researchers to evaluate the internal structure of instruments using a greater variety of methods, such as item response theory, Rasch analysis, multi-group confirmatory factor analysis, and differential item functioning.

• Journal of The Korean Association For Science Education
• /
• v.37 no.4
• /
• pp.659-668
• /
• 2017

This study was conducted to identify whether there is a significant difference in the developmental stages of the evolution concept depending on the major and the country. For this study, college students (both biology major and non-biology major) in Korea and the United States answered evolution concept assessment developed by Ha (2007). The data were analyzed based on the method of developed by Ha (2016). As a result of this study, Cronbach alpha for internal consistency reliability and MNSQ indices for item response fitness of the ordered multiple choice method providing 0 to 4 point scores to creationism, teleology, intentionality, use/disuse, and natural selection respectively, satisfied the benchmark. The level of Korean college students' evolution concepts was located in use/disuse and the level of USA college students' evolution concepts was located in teleology. No interaction effect was found between the difference of conceptual progressions of evolution concept by major and country and evolution contexts (human, animal, and plant). There was a significant relationship between developmental stages of evolution concept and their religiosity. Based on the results of this study, we discuss developmental characteristics of evolutionary concepts.

• Journal of the Korean earth science society
• /
• v.43 no.1
• /
• pp.199-209
• /
• 2022

In this study, we analyzed the preparedness of Korean citizens for earthquake hazards. For this purpose, we developed a questionnaire on the preparedness of citizens for earthquake hazards, consisting of three constructs (knowledge, awareness, and management). A total of 1,256 citizen responses were collected through probability proportionate-to-size sampling and then subjected to Rasch analysis, inferential statistical analysis, and cluster analysis. The findings are as follows. First, questionnaire analysis showed that overall, the earthquake preparedness of citizens was 'normal', with a lower management score than knowledge and awareness scores. Second, analysis of variables related to preparedness for earthquake hazards, gender, education level, actual distance, and safety awareness were found to influence preparedness for earthquake hazards. Third, correlation analysis revealed a high correlation between the three constructs of preparedness for earthquake hazards, namely knowledge, awareness, and management, indicating a structurally close relationship with each other. In addition, even if gender and education level differed, these structural correlations were similar. Through cluster analysis, the citizens were further divided into five groups; the group with moderate levels of the three constructs accounted for the majority of citizens. Considering these findings, we propose an educational orientation that fosters the preparedness of citizens for earthquake hazards.

• Journal of The Korean Association For Science Education
• /
• v.37 no.1
• /
• pp.113-123
• /
• 2017

The purpose of this study is to investigate engineering students' attitude toward convergence and relevance with engineering education accreditation, gender, and academic year and attitude toward convergence. To be specific, fist, we examined whether the instrument for measuring attitudes toward convergence were reliable and valid for engineering students. Second, we compared levels of attitudes toward convergence in terms of engineering education accreditation, gender and academic year. Third, latent classes, which were distinguished in terms of attitudes toward convergence, were identified. Participants were 2076 engineering students. By using factor analysis and Rasch analysis, validity and reliability of instrument measuring attitudes toward convergence were confirmed. The differences in attitude toward convergence in terms of engineering education accreditation experience, gender, and academic year were examined by independent t-test and ANOVA. There were significant differences in attitude towards convergence in terms of engineering education accreditation, gender, and academic year. Students who experience engineering education accreditation program and male and high academic year have higher levels of attitude toward convergence than others. Lastly latent class analysis (LCA) was conducted to identify subgroups underlying engineering students in terms of attitude toward convergence and five latent classes were identified. In addition, the chi-square results showed that there were significant relationships between identified latent classes and engineering education accreditation, gender, and academic year. Based on these results, engineering education considering students' characteristics and diversity in attitude toward convergence were discussed.

• Journal of the Korean School Mathematics Society
• /
• v.9 no.3
• /
• pp.405-424
• /
• 2006

The purpose of this study was to develop the instruments which can measure behavior characteristics as a component of Mathematically Giftedness with in middle school period. This study prescribed the variable factors of measurement after classify the characteristics of Mathematically Giftedness through literature studies. And it produced instruments those are finally composed of 51 items through the preliminary test. The participants for the study were 424 Korean middle school students. Statistical analyses were carried out to verify the validities and reliability. Reliability(Cronbach $\alpha$) was in behavior characteristics, .95. Content validity was found to be satisfactory by internal validity evaluation on the test items. Internal validity were analyzed by BIGSTEPTS based on Rasch's 1-parameter item-response model. Construct validity was also found to be satisfactory through factor analysis which showed the four factors which the identification instruments were intended to measure such as, General mathematical mental ability, Mathematical Ability, Processing and Obtaining mathematical information Anility and Mathematical Disposition Ability. In conclusion, the instruments about behavior characteristics of Mathematically Giftedness during middle school period developed by this study are highly reliable on its reliability and validity.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.75-86
• /
• 2016

The purpose of the present study is to develop and validate an instrument to assess STEM career motivation. We developed 32 items for 7 constructs (i.e. education experience, career value, academic self-efficacy, career self-efficacy, career interest, parents' support, and career motivation) on STEM career motivation based on Social Cognitive Career Theory (SCCT; Lent et al.,1994). 767 first year high school students participated in this study. The items were validated by Messick's framework (1995). In this study, we examined the validity of items in four aspects (i.e. content, substantive, structural and generalizability of validity). Methodologically, we used Rasch analysis, Exploratory factor analysis, confirmative factor analysis based on structural equation modelling. We confirmed that our instrument with 32 items as valid and reliable for measuring the STEM career motivation. In addition, we tested the STEM career motivation model based on SCCT. Our model explained the data well, suggesting that external factors (education experience and parents' support) and cognitive factors (perception of value, self-efficacy and interest) were significantly related to STEM career motivation.

• Journal of The Korean Association For Science Education
• /
• v.36 no.5
• /
• pp.729-737
• /
• 2016

Natural selection is the core idea of evolution that pre-service biology teachers need to understand to solve diverse biological problem. This study aims to investigate the level of Korean pre-service biology teachers' understanding of natural selection by comparing their knowledge with their Chinese, American, and German biology major undergraduate counterparts. In particular, this study focuses on two conceptual components of natural selection (i.e., ecology and genetics). This study used a total 1226 pre-service biology teachers and biology majors' data. The instrument measuring the understanding of natural selection concepts was Conceptual Inventory of Natural Selection, which consists of ten ecology concept items and ten genetics concept items. The Rasch model analysis, multivariate analysis of variance, and univariate analysis of variance were used for the statistical tests. The result reveals that the level of Korean pre-service biology teachers' understanding of natural selection were similar with Chinese undergraduates' understanding and significantly lower than American and German undergraduates.' In the first year student data, the level of genetics concept of Korean pre-service biology teachers were significantly lower than Chinese and German students. In the fourth year student data, the level of ecology concept of Korean pre-service biology teachers were significantly lower than American and German students. Based on these results, the ecology concept education and balanced natural selection concept education are discussed.