• Journal of The Korean Association For Science Education
• /
• v.38 no.6
• /
• pp.901-917
• /
• 2018

The purpose of this study is to develop the questionnaire on pre-service elementary teachers' recognition of self-understanding and change capacity for science education and to investigate their recognitions with it. At the beginning of the study, we made a tool to investigate the self-understanding and change capacity of pre-service elementary teachers through literature review and discussions. The former half of the questionnaire was related to self-understanding with factors such as 'self-concept clarity,' 'career identity' and 'self-efficacy:' 'self-understanding as a pre-service elementary teacher' (12 items) and 'self-understanding as a pre-service elementary science teacher' (12 items). Its latter half was about the change capacity with factors such as 'change sensitivity,' 'goal consciousness,' 'collaboration,' 'reflection,' and 'mastery.' It consisted of three parts: 'general change capacity,' 'change capacity as a pre-service elementary teacher' and 'change capacity as a pre-service elementary science teacher' with 17 items, respectively. With this tool, we surveyed 153 pre-service elementary teachers. The results are as follows: First, pre-service elementary teachers have a positive recognition about self-understanding and change capacity, but the recognition of self-understanding and change capacity as pre-service elementary science teachers were relatively less positive. Second, factors of self-understanding and change capacity as pre-service elementary science teachers have a significant correlation with each other. Especially, there was a high correlation between 'self-efficacy' of self-understanding and 'goal consciousness' and 'mastery' of change capacity. Based on these results, some implications for self-understanding and change capacity related to science education were discussed.

• Journal of The Korean Association For Science Education
• /
• v.35 no.3
• /
• pp.465-475
• /
• 2015

The purpose of this study is to analyze the results of physics (optics) in nationwide standardized assessment and to investigate middle-school students' characteristics of achievement by using an option response rate distribution curve. For this purpose, we analyzed the 10 optics problems from the National Assessment of Educational Achievement (NAEA) items for middle school science subject conducted in 2010-2013. The results of this study are as follows; First, students showed a little higher achievement in optics than classical mechanics and electromagnetism. Second, students achieved significantly worse in 'formation of image' in 'light' part and 'variation of phase in propagation of wave' in 'wave' part. Third, students showed a context-dependent problem solving strategy and result. Additionally, we suggested some implications about the readjustment of some optics concepts level of national science curriculum, the need for teaching and learning strategies for basic level students, and the need for teaching and learning strategies focused on the realistic context.

• Journal of Science Education
• /
• v.37 no.2
• /
• pp.348-358
• /
• 2013

The purpose of this study is to develop the science item on computer-based performance assessment which is able to replace the assessment with actual experimental apparatus. The survey on the necessities and the difficulties of the assessment with actual experimental apparatus was conducted with 57 physics teachers. By reflecting the results of the survey, the computer-based assessment items which are related with constructing circuits with an ammeter and a voltmeter were developed. The developed computer-based assessment items were organized in similarity to assessment conducted with actual experimental apparatus, proper feedback was provided by students' performance in the process of assessment so as to grading performance results automatically. To achieve them, the algorithm was developed so that computer can judge the accuracy of students' performance results.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.11
• /
• pp.227-234
• /
• 2023

The evaluation of students' computational thinking begins with the evaluation of knowledge about the concepts and principles of computing. In this study, we analyzed the differences in teachers' perceptions depending on the description method of the bebras challenge questions to evaluate computer science knowledge. First, we classified the questions into two types depending on whether computer science terms were included or not. Also we made a computational thinking questionnaire with two types of questions and surveyed 72 major teachers. As a result, teachers expressed the opinion that the evaluation questions that revealed computer science terms were appropriate as evaluation questions for information subjects. They also perceived it as more helpful in assessing computational thinking and coding skills. Through the results of this study, we suggested that the way the questions are worded is important in the process of assessing students' understanding of computer science concepts and computational thinking skills.

• Journal of The Korean Association For Science Education
• /
• v.32 no.2
• /
• pp.210-235
• /
• 2012

The purpose of this study was to develop a valid and reliable assessment tool for measuring scientific creative problem solving ability for middle school students. To achieve this aim, an assessment framework, four assessment items, and detailed rubrics for scientific creative problem solving were developed. The assessment framework had three dimensions (i.e. science contents, inquiry process, and thinking skills) and sub-elements for each dimension. The assessment items were tested with 320 middle school students in order to determine reliability, difficulty, and item discrimination. Science teachers and experts in science education checked the validity of the items and the rubrics. The results proved that the assessment tool was reliable enough to evaluate students' scientific creative problem solving skills.

• Journal of the Korean Society of Earth Science Education
• /
• v.9 no.3
• /
• pp.276-291
• /
• 2016

This study is to develop a valid and reliable instrument for measuring students' creative engineering problem solving propensity. The creative engineering problem solving is operationally defined in this study as a creative problem solving skill in an engineering context. To develop the instrument, first we define seven common constructs between engineering problem solving skill and creative problem solving skill through an intensive literature review; motivation, context, personal character, engineering design, engienering habits of mind, understandings of engineering and engineers, communication skill, and collaboration skill. Based on the seven constructs and the face validity test conducted by two in-service science teachers and 4 experts in science education research, 40 preliminary items were developed. Then the preliminary instrument was implemented in a science gifted highschool to measure the reliability of the instrument. From the 40 items, 34 items were selected through the initial reliability test by Cronbach's ${\alpha}$(>.75). Finally through the three times of factor analysis process, 28 items in five construct categories were selected; motivation (3 items), engineering design (6 items), engineering habits of mind (9 items), understandings of engineering and engineers (4 items), communication and collaboration skill (6 items). The factor analysis result showed that the reliability of each construct category was between .733 to .892., meaning that the instrument is reliable in terms of the higher structural validity (each item is categorized in an appropriate construct category). We expect that the creative engineering problem solving propensity instrument developed in this study can be used in various contexts for STEAM education research as a reliable and valid instrument.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.431-438
• /
• 2003

In this study, we have developed a web-based adaptive testing system using item response theory´s computerized adaptive testing to diagnose underachievers, and to check the evaluation results immediately. Adaptive testing system simple is not the fact that it presents a question to students. It calculates information of a question and presents the question to students. It controls the response of the students under extraction conditions of the next question. It extracts the question which is the most suitable it presents. In this adaptive testing system, you can extract questions according to the level of the students, and adjust the length and the level of the difficulty according to the response of the students.

• Journal of the Korean Chemical Society
• /
• v.59 no.5
• /
• pp.445-453
• /
• 2015

In 2005, descriptive assessment was introduced to increase students’ higher mental ability like problem-solving ability and creativity. Every year the ratio of descriptive assessment increases and it is regarded as an alternative evaluation to a multiple-choice item which measures simplicity knowledge. Externally the descriptive assessment took a root in school, but we can’t say definitely that it meets its original goal. In this paper, science descriptive assessment items of 5 middle schools in Gyeonggi-do were analysed; examiners was interviewed about how well they understood the characteristic of the assessment items. According to the analysis, characteristic of the items are ① unequal distribution of unit, ② difference of item’s type by unit, and ③ disappearance of measuring higher mental ability. It is considered that there are several factors of these characteristic - the lack of teachers’ ability to make assessment item; understanding of assessment instrument. These factors can be explained by the lack of assessment expertise. So the society’s effort is needed to raise teacher’s ability for the descriptive assessment.

• Journal of The Korean Association For Science Education
• /
• v.23 no.1
• /
• pp.75-85
• /
• 2003

We have developed of a criterion that would help to select and develop performance assessments in science education. There are six categories of a criterion: Fidelity, satisfaction, content validity, fairness & suitability, reliability & objectivity, and usability. There are the total of 25 sub-categories under the six categories. Five science educators evaluated the validity of the criterion. For reliability of the criterion, Kendall's tau-b was used. Eight science educators and elementary teachers evaluated three performance assessment tasks for the correspondence of the criterion. This study also discuss the implications of this criterion as well.

• Journal of The Korean Association For Science Education
• /
• v.33 no.2
• /
• pp.229-248
• /
• 2013

The purpose of this study is to develop sequential concept tests (ConcepTest) for teachers' conceptual change on the straight propagation of light through in-service training of science teachers by peer instruction. We revised the ConcepTests for attaining the goal concept by implementing similar training courses for teachers three times and analyzing the results using both Hake gain and verbal protocol. The final form helped most teachers to reach the goal concept. While teachers are solving a given concept problem test, they had shown not only significant cognitive conflict to select one among candidate answers, but also used the concept obtained through the previous problem. The sequential ConcepTests developed in this study can be useful for training elementary and secondary teachers or pre-service teacher education.