• The Journal of Korean Association of Computer Education
• /
• v.23 no.3
• /
• pp.17-30
• /
• 2020

Although the importance of Artificial Intelligence(AI) education is increasing, research on the development of test tools has not been conducted in AI education research in Korea has not been conducted. Accordingly, there is a limit to designing AI curriculum and analyzing the effect of the educational program. So, in this study, Test tool was developed that to measure the attitude toward artificial intelligence of middle school students. For the development of test tools, the objectives, components, factors, and test tools were developed through the discussion of AI education experts. The test tool was finally developed by item analysis, exploratory factor analysis and confirmatory factor analysis. Finally, the criteria of the developed test tool were analyzed. Future research is needed to analyze the effects of educational programs and to analyze factors affecting attitudes toward artificial intelligence in middle school students using developed test tools.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.1-13
• /
• 2016

The purpose of this study is to develop a Science Ethicality Test (SET) to measure students' science ethics. To secure the validity and reliability of the SET, the authors have applied Rest's Four Components Model (FCM). To develop the SET, authors have conducted the following procedures: analysis of the Korean Youth Moral Test (Kim & Lee, 2012), alteration of the KYMT; and development of the SET. Rest's FCM is consisted of moral sensitivity, moral judgment, moral motivation, and moral character. The SET is consisted of ethical sensitivity, ethical judgment, ethical motivation, and ethical character with each factor having its own elements. To secure the validity and reliability of SET, authors requested a validity assessment from five experts (two evaluators are science education experts, two others are ethics education experts, and one evaluator is a scientist), and surveyed 599 elementary school students. As a result, SET proved high levels of validity and reliability.

• Journal of the Korean Society for Library and Information Science
• /
• v.47 no.2
• /
• pp.181-200
• /
• 2013

The test instrument utilized to diagnose and evaluate a trainee's ability are necessary for an effective information literacy education. Nevertheless, there is a lack of a standardized test instrument to comprehensively measure students' information literacy. The purpose of this study is to develop a standardized test instrument to evaluate the information literacy of middle school students, and to verify the reliability and validity of the test instrument. For this purpose, this study selected factors that can show the information literacy and developed an information literacy test framework that was designed based on Guilford's SOI model and Meeker's SOI-LA test. The test instrument that was developed through this study is a 30-item Web-based multiple-choice test. This study administrated tests in middle school students (794 students joined), and analyzed difficulty, reliability, discrimination index, validity of tests, and reviewed tests items to qualify the standardized test. The cutoff score was also decided when using these tests as a diagnostic information literacy assessment.

• Journal of Korean Elementary Science Education
• /
• v.41 no.4
• /
• pp.701-724
• /
• 2022

In this study, the Nature of Science (NOS) instrument for elementary school students in the form of open questionnaires was developed specifically to reveal elementary school students' perceptions of the NOS, and its validity and effectiveness were investigated. To develop a NOS instrument for elementary school students, problems that may occur when applying the existing NOS instruments to elementary school students were analyzed and based on this, the development direction of the NOS instrument was established. In addition, after selecting seven NOS types suitable for the level of elementary school students, the preliminary instrument was produced by modifying and supplementing the items in the existing instruments for each type or by developing new items. Finally, the NOS instrument consisting of eight questions was developed by adding one question asking for a comprehensive understanding of science to seven questions related to each type of NOS after a content validity test of the science education expert group. To verify the practical effect of the developed instrument, pre- and post-tests were conducted on 50 students in two classes of sixth grade at two elementary schools in Seoul: 'existing instrument → development instrument' in one class, and 'development instrument → existing instrument' in the other class. The collected data were then compared and evaluated through summary content analysis and analyzed by executing the Wilcoxon signed-rank test. As a result of comparing and analyzing students' responses to the existing NOS instrument and the developed NOS instrument, students' perspectives on the NOS were more diverse when using the developed instrument, and the level of error in the response caused by misinterpreting the intention of the question was reduced. In addition, when using the developed instrument, the responses of the majority of students at a statistically significant level changed more specifically. In this study, the implications for the development of NOS instruments suitable for elementary school students were discussed based on these results.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.3
• /
• pp.225-238
• /
• 2022

Although the importance of literacy in Artificial Intelligence (AI) education is increasing, there is a lack of testing tools for measuring such competency. To address this gap, this study developed a testing tool that measures AI literacy among middle school students. This goal was achieved through the establishment of an expert group that was enlisted to determine the relevant factors and items covered by the proposed tool. To verify the reliability and validity of the developed tool, a field review, exploratory factor analysis, and confirmatory factor analysis were conducted. These procedures resulted in a testing tool comprising six domains that encompass 30 items. The domains are the social impact of AI (eight items), the understanding of AI (six items), AI execution plans (five items), problem solving with AI (five items), data literacy (four items), and AI ethics (two questions). The items are to be rated using a five-point Likert scale. The internal consistency of the tool was .970 (total), while that of the domains ranged from .861 to .939. This study can serve as reference for developing the analysis of AI literacy, teaching and learning, and evaluation in AI education.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2019.07a
• /
• pp.415-416
• /
• 2019

이 연구의 목적은 기존 CT 검사 도구를 확인하여 한계를 파악하고, CT 기반 역량의 의미를 밝히고 이를 통해 올바른 CT 검사도구 개발의 방향을 제시하는 것이다. 그래서 이 연구로 CT 기반 스킬을 통해 CT 역량을 검사할 수 있는 방법을 제시하였다. 이 연구의 결론으로 CT 역량을 검사하는 것은 CT 기반 역량을 검사하는 것으로 CT 기반 하드스킬을 밝혀내어 이를 평가 요소로 적용한다면, 기존 검사도구의 한계를 극복하는 묘책이 될 것으로 판단되었다. 이 연구의 후속으로 CT 기반의 하드 스킬을 찾아 CT 기반 역량을 명확히 규명하고, 이를 바탕으로 검사도구를 개발하여 검증하고자 한다.

• Journal of the Korean Society of Earth Science Education
• /
• v.13 no.1
• /
• pp.74-89
• /
• 2020

The purpose of this study was to develop a concept test tool for seasonal change with reliability and validity, and to objectively observe and analyze sub-concepts and misconceptions related to the concept of seasonal change to explain the relationship between variables. The development process of the conceptual change concept inspection tool consisted of the development of the inspection tool development plan, the development of the inspection tool draft, the modification of the preliminary inspection and inspection tools, the development of the final inspection tool, and the implementation of this inspection. The developed test tool can be used to provide students with appropriate learning and help by examining students' degree of seasonal change concept formation and analyzing the cause of the difficulty in concept formation. As a result of regression analysis of 198 students in 6th grade using the developed test tool, it was found that the understanding of pre-learning concept and correction of misconception had a statistically significant effect on the concept learned in the seasonal change unit, and misconception had greater effect. Correction of misconceptions had a significant effect on students above the average score among the two sections created and cut based on the average score, and on the students below the average score, the understanding of pre-learning concept had a significant effect.

• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.545-555
• /
• 1998

The improvement of process skills has been one of the most important goals in secondary science education. To achieve this goal, it is essential to develop an instrument for evaluating inquiry skills in addition to improving science curricula, inquiry teaching methods, and other educational environment. There are a lot of instruments in testing science process skills in Korea as well as America and Europe. However, it has been difficult to find the instruments that have a characteristic in content and form. The purpose of this study is to develop a valid and reliable instrument for evaluating science process skills using line graph. This study examined the whole body of scientific process and identified 6 component skills. Three or four items for each component process skills were developed and revised by pilot test and field test. The instrument is considered valid and reliable, for the content validity is 78% and the reliability(KR-20) is 0.82. The discrimination index is 0.57 and difficulty index is 0.47, which also suffice the criteria of good test.

• 한국지구과학회:학술대회논문집
• /
• 2010.04a
• /
• pp.17-17
• /
• 2010

본 연구는 학생들의 과학 경험의 정도를 정량화 하는데 있어 통일된 측정 도구를 제시하는 것이다. 측정 도구를 구성하는 요인들은 선행연구를 통해 학교 안 과학 경험은 일반 활동 경험, 과학 탐구 경험, 실험 기구 경험으로 세분화 되며 학교 밖 과학 경험은 일반 활동 경험, 취미 활동 경험, 현장 견학 경험 6개의 영역으로 구분을 할 수 있었다. 각각의 요인을 구성하는 질문은 NAEP(1987)에서 사용된 과학 경험 검사 도구와 신영준(2000)의 과학 경험 검사 도구의 문항 중 일부를 발췌하고 더불어 과학 경험에 대한 개방적인 설문지를 통하여 1차 검사를 실시하여 얻은 답변 중 빈도가 많은 답변과 중등 교과서의 탐색적 분석을 통해 영역별 10문항씩 6개 영역의 문항을 선정하였다. 사전 설문조사와 선행 연구를 바탕으로 개발한 검사지를 고등학교 1학년 학생 413명을 대상으로 2차 검사를 실시하였다. 개발한 측정 도구의 타당도는 내용타당도와 구인타당도로 검사하였다. 내용타당도는 2명의 현직 중등교사와 2명의 과학교육전문가가 각 문항이 측정하고자 하는 목적에 부합하는지 심사하였고, 구인타당도는 요인분석을 통해 검사하였다. 신뢰도는 Cronbach $\alpha$를 통하여 문항을 분석하였다. 6개의 영역의 요인에 대하여 타당도와 신뢰도 분석 결과 6개 영역으로 구성된 60문항의 측정 도구는 학생들의 과학 경험을 측정하는 도구로서 적절하다는 결론을 내렸다.

• Journal of Korean Library and Information Science Society
• /
• v.47 no.2
• /
• pp.329-358
• /
• 2016

The purpose of this study is to develop a test tool that can be measured in various aspects for the reading attitudes of children. For that it was set the configuration based on the preceding reading attitude survey and models and tacit knowledge of attitude toward reading and wrote the questions for reading attitudes. It conducted a primary and secondary test for elementary school students in grades 4-6 to verify the validity and reliability of measurement tools. 8 factors of the reading attitudes measurement tool were extracted through exploratory factor analysis and it described 66.29% of total variable. the r-value for inter-item consistency about reading attitudes were above 0.4 on all questions. The Cronbach ${\alpha}$-value of reliability coefficient about reading attitudes measurement tool was 0.950. Therefore Reading attitude test tool have reading usefulness, reading efficacy, leisure, stiumulation, flow, expression, study, assertiveness as sub factors of reading attitude has been shown that it can serve as a useful tool for measuring various aspects of the reading attitude for children.