• The Journal of Korean Association of Computer Education
• /
• v.9 no.6
• /
• pp.11-18
• /
• 2006

The purpose of this paper is to draw problems from analyzing "General Computer" questions of Career Searching Section in the College Scholastic Ability Test in 2005 and 2006 and to offer some suggestions about them. For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty and item discrimination by using Bayesian 1.0 based on 2-parameter item response model and this paper analyzed item reliability and distracters by using Testan 1.0. By analyzing "General Computer" questions, this paper would like to improve the quality of items and estimate item difficulty. Therefore, "General Computer" questions could be suggested as materials for developing reliable and discriminative questions.

• The Journal of the Korea Contents Association
• /
• v.17 no.4
• /
• pp.520-531
• /
• 2017

The purpose of this study was to test the validity and reliability of the Korean version of the Tuberculosis Interview Instrument (K-TII). The instrument was first translated into Korean, back-translated to English, and reviewed. After the translation process, the instrument was revised from 52 items to 37 items by researchers and an expert according to the systematic review. In addition, these items were reduced to 32 items after the content validity test was done by 9 experts. As a result of pilot study conducted in 20 early childhood teachers, 32 items were selected for the preliminary instrument. Data collected from 289 early childhood teachers were used to test the validity and reliability of the preliminary instrument. The result of factor analysis showed that the instrument categorized into 7 factors explaining 71% of the total variance and 27 items were retained for the final instrument. The result of Cronbach's ${\alpha}$ coefficient was .88. In conclusion, the K-TII may be a suitable instrument for assessing tuberculosis prevention behaviors in early childhood teachers in Korea.

• 한국체육학회지인문사회과학편
• /
• v.58 no.1
• /
• pp.295-308
• /
• 2019

The purpose of the present study is to apply a health belief model to the serious perception of an increase in youth obesity, and to develop and validate a measurement tool for youth obesity prevention among this group who are experiencing increasing rates of obesity. The specific goals of this study are to 1) apply a health belief model to develop a measurement tool for obesity prevention among youth who are seeing rising rates of obesity, and 2) provide an integrated validation procedure and foundation for developing this measurement tool. A total of 1801 high school students[sample1: 902(male:464,female:438); sample2: 899(male:464,female:438)] were recruited and collected data from 12 high school in Seoul and Kyonggi area. For this study the analytic framework of unified validity was developed which can comprehensively reflect unified validity be Messick(1995), framework for conducting a strong program of construct validation by Benson(1998), the unified validity implementation method of Rasch model suggested by Wolfe and Smith(2007a, 2007b). Furthermore, after dividing the developed analytic framework into each stage(the substantive domain), the evidence of validity of Youth Obesity Prevention Scale(YOPS) applying Health Belief Model was systematically suggested. The YOPS suggested the evidence about the substantive domain of unified validity. The developed YOPS was consist of Susceptibility, Severity, Benefits, Barriers and Cues to Action. After 3 stage in substantive domain, the components of YOPS(5factors and 28items) satisfied the unidimensionality, and the 5 point Likert scale had the significant discrimination of the respondents' response.

• Education of Primary School Mathematics
• /
• v.17 no.2
• /
• pp.159-171
• /
• 2014

Spatial ability has been valued as one component of intelligence and as an talented domain. And it is associated with the achievements in science, technology, engineering, and mathematics (STEM) disciplines. So, the instrument for measuring spatial ability is very important. The purpose of this study is to develop Spatial Visualization Tests for Elementary School Children and examine internal consistency reliability evidence and construct validity evidence on confirmatory factor analysis of that instrument. For this purpose, 'The Spatial Visualization Tests for Elementary School Children was administered to 1482 Korean elementary school students. As a result, this study show that internal consistency reliability evidence using Cronbach' alpha showed item consistency and construct validity evidence from confirmatory factor analysis in the Spatial Visualization Tests for Elementary School Children. And also, this study show ed that item difficulty and item discrimination of the Spatial Visualization Tests for Elementary School Children were within an acceptable range.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.9
• /
• pp.177-188
• /
• 2023

The purpose of this study is to develop and validate a scale for measuring digital literacy by identifying the factors consisting of digital literacy and extracting items for each factor. Preliminary items for the Delphi study were developed through the analysis of previous literature and the deliberation of the research team. As a result of two rounds of the expert Delphi study, 65 items were selected for the main survey. The validation of the items was carried out in the process of exploratory and confirmatory factor analyses, reliability test, and criterion validity test using the data collected in the main survey. As a result, a 4-factor structure composed of 31 questions(factor 1: digital technology & data literacy- 9 questions, factor 2: digital content & media literacy- 8 questions, factor 3: digital communication & community literacy- 9 questions, factor 4: digital wellness literacy - 5 questions) was confirmed. Also, the goodness of fit indices of the model were found to be good and the result of reliability test revealed the scale had a very appropriate level of Cronbach's alpha(α=.956). In addition, a statistically significantly positive correlations(p<.001) were found between digital literacy and internet self-efficacy and between digital literacy and self-directed learning ability, which were predicted in the existing evidence, therefore the criterion validity of the developed scale was secured. Finally, practical and academic implications of the study are provided and future study and limitations of the study are discussed.

• Journal of Science Education
• /
• v.40 no.3
• /
• pp.189-202
• /
• 2016

This study aimed to investigate pre-service science teachers' perceptions of significance and usefulness of evolution and genetics. To this end, 82 pre-service biology teachers and 159 non-biology science teachers answered the items to measure the perceptions of significance and usefulness of evolution and genetics. The validity and reliability were examined using Cronbach alpha, two-dimensional rating scale model Rasch analysis, and factor analysis. The finding illustrated that the test items met the benchmark to be valid and reliable test items. Second, pre-service teachers' perception of significance and usefulness of evolution was independent to that of genetics. The level of pre-service teachers' perception of significance and usefulness of evolution was lower than the level of genetics. Lastly, the levels of pre-service teachers' perceptions of significance and usefulness of evolution and genetics were not significantly different across academic years and majors (biology and non-biology). The findings of this study stressed the importance of teaching significance and usefulness of evolution and genetics in pre-service science teacher education program.

• Journal of The Korean Association For Science Education
• /
• v.34 no.2
• /
• pp.123-134
• /
• 2014

This study aims to develop and validate an instrument to measure students' attitude toward convergence. To do so, we have defined five constructs (i.e. knowledge about convergence, personal relevance, social relevance, interest and self-efficacy) of 'attitude toward convergence' based on literature review, developed items, and collected data from 233 11th grade science track students. The validity of these items have been evaluated by Messick's framework (1995) (i.e. content, substantive, structural aspects of validity), experts' review, Rasch analysis, and confirmatory factor analysis using structural equation modeling. Our results have confirmed the five constructs and 23 selected items have met the benchmark of item validity. Moreover, the theoretical model illustrating that the high level of attitude toward convergence increases the level of science motivation has also been supported by the data. The items developed in this study will be used to measure students' attitude toward convergence and to estimate the effect of learning program for convergence science.

• (The) Korean Journal of Educational Psychology
• /
• v.22 no.2
• /
• pp.367-384
• /
• 2008

The purpose of this study was to develop picture testing instrument for measuring children's causal reasoning ability on events that can occur in daily life. The measurement instrument contains three domain of human development; haman behavior domain, human psychology domain, and natural/physical domain. Through this study, researchers designed a concept model based on theoretical framework and prior studies and investigated the reliability and validity of the measurement instrument which was developed in accordance with the concept model. For the empirical validation research, a pretest was conducted to 336 elementary school students in grade 2 to 4 in Seoul. Considering reliability and validity of the developed measurement instrument and factor loadings, researchers sorted out 18 questions. And then 18 question test and KICE Critical Thinking Ability Test was conducted to 509 elementary school students in grade 1 to 4 in Seoul. According to the result of the tests, the researchers sorted out final 12 questions. The Cronbach's alpha, reliability of the children's causal reasoning ability test consisted of the final 12 question, was significant as .72. Also, the result of exploratory factor analysis showed that factors of this test were haman behavior domain, human psychology domain, and natural/physical domain. Moreover, the correlation between the KEDI Reasoning Ability Test(2003) scores and the scores of the test developed in the current study was significant as .55. Finally, the result of the analysis about children's grade differences, the development by discrepancy of age was significant in total points and that of each domain. The children's causal reasoning ability test developed by this study can be useful not only for the evaluation of children's thinking ability but also for screening of the handicapped children in thinking ability development.

• Journal of the Korean Society for Library and Information Science
• /
• v.58 no.3
• /
• pp.5-34
• /
• 2024

The purpose of this study was to develop and validate a job-esteem scale that reflects the unique characteristics of academic librarians. The study conducted an analysis of relevant literature and existing scales in the scale development phase, followed by in-depth interviews with 10 academic librarians, resulting in the creation of 100 preliminary measurement items. These items underwent content validity testing, consultations with linguists, and face validity assessments, which culminated in the selection of 52 items for a preliminary measurement scale. A pilot survey was then administered with 300 academic librarians from four-year universities nationwide to collect data, and item analysis and reliability testing were performed with the data. Then, an exploratory factor analysis was conducted, resulting in the elimination of 22 items and the finalization of 30 items. The main survey was conducted with 345 academic librarians, and the study confirmed high reliability of the data through item analysis and internal consistency tests. Through another confirmatory factor analysis, the study finalized 29 items. The final scale met all criteria for convergent, discriminant, and criterion validity. This study marks the first development of a job-esteem scale tailored to the distinct attributes of academic librarians, and its significance lies in its utility for assessing and analyzing the job esteem of academic librarians.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.4
• /
• pp.236-247
• /
• 2020

This study was conducted with the aim of developing inspection tools to select and measure human resource figures and appropriate core competency of the educational goals pursued by S universities. Therefore, key competency factors were defined consistent with concept of talented figures and educational objectives of S universities, inspection tools were developed to measure core competences, and directions are presented for future education policies and curriculum compilation and securing data for rational operation. Based on key competency indicators, questions were developed in a self-reporting form that measures the consent level of the respondents by comprising seven areas of competence, 16 small areas (sub-capacity), and 46 questions. The main Test conducted an analysis of the questionnaires based on the survey results of 2,486 people to ensure the validity of the inspection by conducting a positive factor analysis and reliability analysis. The core competency diagnostic tool of S university is meaningful in this study which verifies the effectiveness of the curriculum and programs conducted at S university and as the first step for the rational operation of the core competency certification system to improve the competency appropriate for students.