• Journal of the Korean Society for Library and Information Science
• /
• v.47 no.2
• /
• pp.181-200
• /
• 2013

The test instrument utilized to diagnose and evaluate a trainee's ability are necessary for an effective information literacy education. Nevertheless, there is a lack of a standardized test instrument to comprehensively measure students' information literacy. The purpose of this study is to develop a standardized test instrument to evaluate the information literacy of middle school students, and to verify the reliability and validity of the test instrument. For this purpose, this study selected factors that can show the information literacy and developed an information literacy test framework that was designed based on Guilford's SOI model and Meeker's SOI-LA test. The test instrument that was developed through this study is a 30-item Web-based multiple-choice test. This study administrated tests in middle school students (794 students joined), and analyzed difficulty, reliability, discrimination index, validity of tests, and reviewed tests items to qualify the standardized test. The cutoff score was also decided when using these tests as a diagnostic information literacy assessment.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.1-13
• /
• 2016

The purpose of this study is to develop a Science Ethicality Test (SET) to measure students' science ethics. To secure the validity and reliability of the SET, the authors have applied Rest's Four Components Model (FCM). To develop the SET, authors have conducted the following procedures: analysis of the Korean Youth Moral Test (Kim & Lee, 2012), alteration of the KYMT; and development of the SET. Rest's FCM is consisted of moral sensitivity, moral judgment, moral motivation, and moral character. The SET is consisted of ethical sensitivity, ethical judgment, ethical motivation, and ethical character with each factor having its own elements. To secure the validity and reliability of SET, authors requested a validity assessment from five experts (two evaluators are science education experts, two others are ethics education experts, and one evaluator is a scientist), and surveyed 599 elementary school students. As a result, SET proved high levels of validity and reliability.

• The Journal of Korean Association of Computer Education
• /
• v.23 no.3
• /
• pp.17-30
• /
• 2020

Although the importance of Artificial Intelligence(AI) education is increasing, research on the development of test tools has not been conducted in AI education research in Korea has not been conducted. Accordingly, there is a limit to designing AI curriculum and analyzing the effect of the educational program. So, in this study, Test tool was developed that to measure the attitude toward artificial intelligence of middle school students. For the development of test tools, the objectives, components, factors, and test tools were developed through the discussion of AI education experts. The test tool was finally developed by item analysis, exploratory factor analysis and confirmatory factor analysis. Finally, the criteria of the developed test tool were analyzed. Future research is needed to analyze the effects of educational programs and to analyze factors affecting attitudes toward artificial intelligence in middle school students using developed test tools.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.07a
• /
• pp.415-416
• /
• 2019

이 연구의 목적은 기존 CT 검사 도구를 확인하여 한계를 파악하고, CT 기반 역량의 의미를 밝히고 이를 통해 올바른 CT 검사도구 개발의 방향을 제시하는 것이다. 그래서 이 연구로 CT 기반 스킬을 통해 CT 역량을 검사할 수 있는 방법을 제시하였다. 이 연구의 결론으로 CT 역량을 검사하는 것은 CT 기반 역량을 검사하는 것으로 CT 기반 하드스킬을 밝혀내어 이를 평가 요소로 적용한다면, 기존 검사도구의 한계를 극복하는 묘책이 될 것으로 판단되었다. 이 연구의 후속으로 CT 기반의 하드 스킬을 찾아 CT 기반 역량을 명확히 규명하고, 이를 바탕으로 검사도구를 개발하여 검증하고자 한다.

• Journal of Korean Elementary Science Education
• /
• v.41 no.4
• /
• pp.701-724
• /
• 2022

In this study, the Nature of Science (NOS) instrument for elementary school students in the form of open questionnaires was developed specifically to reveal elementary school students' perceptions of the NOS, and its validity and effectiveness were investigated. To develop a NOS instrument for elementary school students, problems that may occur when applying the existing NOS instruments to elementary school students were analyzed and based on this, the development direction of the NOS instrument was established. In addition, after selecting seven NOS types suitable for the level of elementary school students, the preliminary instrument was produced by modifying and supplementing the items in the existing instruments for each type or by developing new items. Finally, the NOS instrument consisting of eight questions was developed by adding one question asking for a comprehensive understanding of science to seven questions related to each type of NOS after a content validity test of the science education expert group. To verify the practical effect of the developed instrument, pre- and post-tests were conducted on 50 students in two classes of sixth grade at two elementary schools in Seoul: 'existing instrument → development instrument' in one class, and 'development instrument → existing instrument' in the other class. The collected data were then compared and evaluated through summary content analysis and analyzed by executing the Wilcoxon signed-rank test. As a result of comparing and analyzing students' responses to the existing NOS instrument and the developed NOS instrument, students' perspectives on the NOS were more diverse when using the developed instrument, and the level of error in the response caused by misinterpreting the intention of the question was reduced. In addition, when using the developed instrument, the responses of the majority of students at a statistically significant level changed more specifically. In this study, the implications for the development of NOS instruments suitable for elementary school students were discussed based on these results.

• Journal of the Korean earth science society
• /
• v.24 no.6
• /
• pp.508-523
• /
• 2003

This study has developed the test tool to measure the level of spatial concept in the astronomy education for high school students. The items of the test tool are composed of basic elements (spatial position, spatial reasoning, spatial variation) forming spatial concepts in the astronomy. The test tool was applied to the 274 high school students. As a result of item analysis, the test tool showed that the content validity was 98%, the reliability (KR 20) was 0.84, the measure the level of astronomical spatial concept for the high school students.

• Journal of Korean Library and Information Science Society
• /
• v.47 no.2
• /
• pp.329-358
• /
• 2016

The purpose of this study is to develop a test tool that can be measured in various aspects for the reading attitudes of children. For that it was set the configuration based on the preceding reading attitude survey and models and tacit knowledge of attitude toward reading and wrote the questions for reading attitudes. It conducted a primary and secondary test for elementary school students in grades 4-6 to verify the validity and reliability of measurement tools. 8 factors of the reading attitudes measurement tool were extracted through exploratory factor analysis and it described 66.29% of total variable. the r-value for inter-item consistency about reading attitudes were above 0.4 on all questions. The Cronbach ${\alpha}$-value of reliability coefficient about reading attitudes measurement tool was 0.950. Therefore Reading attitude test tool have reading usefulness, reading efficacy, leisure, stiumulation, flow, expression, study, assertiveness as sub factors of reading attitude has been shown that it can serve as a useful tool for measuring various aspects of the reading attitude for children.

• Journal of The Korean Association For Science Education
• /
• v.41 no.6
• /
• pp.533-542
• /
• 2021

This study aims to develop an instrument for measuring high school students' action competence on climate change (ACoCC). The instrument is defined as the construct comprised of seven factors and thirty-five items and takes approximately 15 minutes to fill out. A panel of experts and students' content validation were undertaken to modify the items. Five hundred and twenty-eight first and second graders in Korean high schools participated in the instrument survey. To assess the reliability and validity of ACoCC instrument, item analysis (mean, skewness, kurtosis, item-total correlation), internal consistency estimate, and confirmatory factor analysis were used. It was appropriate to use the 7-dimensional ACoCC instrument (knowledge about climate change, climate change sensibility, reflection, communication, integrated thinking, willingness, decision making), with 35 items for high school students. The following instrument was self-report given in the 5-point Likert scale (1=strongly disagree, 2=disagree, 3=neutral, 4=agree, 5=strongly agree). The internal consistency coefficient was shown as a whole was shown as 0.953, and the subscale's internal consistency coefficient ranged from 0.786 to 0.862.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.3
• /
• pp.225-238
• /
• 2022

Although the importance of literacy in Artificial Intelligence (AI) education is increasing, there is a lack of testing tools for measuring such competency. To address this gap, this study developed a testing tool that measures AI literacy among middle school students. This goal was achieved through the establishment of an expert group that was enlisted to determine the relevant factors and items covered by the proposed tool. To verify the reliability and validity of the developed tool, a field review, exploratory factor analysis, and confirmatory factor analysis were conducted. These procedures resulted in a testing tool comprising six domains that encompass 30 items. The domains are the social impact of AI (eight items), the understanding of AI (six items), AI execution plans (five items), problem solving with AI (five items), data literacy (four items), and AI ethics (two questions). The items are to be rated using a five-point Likert scale. The internal consistency of the tool was .970 (total), while that of the domains ranged from .861 to .939. This study can serve as reference for developing the analysis of AI literacy, teaching and learning, and evaluation in AI education.

• Journal of the Korean Society of Earth Science Education
• /
• v.13 no.1
• /
• pp.74-89
• /
• 2020

The purpose of this study was to develop a concept test tool for seasonal change with reliability and validity, and to objectively observe and analyze sub-concepts and misconceptions related to the concept of seasonal change to explain the relationship between variables. The development process of the conceptual change concept inspection tool consisted of the development of the inspection tool development plan, the development of the inspection tool draft, the modification of the preliminary inspection and inspection tools, the development of the final inspection tool, and the implementation of this inspection. The developed test tool can be used to provide students with appropriate learning and help by examining students' degree of seasonal change concept formation and analyzing the cause of the difficulty in concept formation. As a result of regression analysis of 198 students in 6th grade using the developed test tool, it was found that the understanding of pre-learning concept and correction of misconception had a statistically significant effect on the concept learned in the seasonal change unit, and misconception had greater effect. Correction of misconceptions had a significant effect on students above the average score among the two sections created and cut based on the average score, and on the students below the average score, the understanding of pre-learning concept had a significant effect.