• Journal of the Korean Society of Earth Science Education
• /
• v.11 no.2
• /
• pp.125-144
• /
• 2018

The purpose of this study is to analyze the astronomical thinking level of elementary, middle, and high school students using ordered multiple choice items. For this purpose, we constructed a questionnaire comprising three items about spatial thinking and system thinking. This survey was conducted and applied to 1,066 students in the 5th grade, 8th grade, and 11th grade in 12 schools located in Gangwon Province. The collected student response data were analyzed by applying inferential statistics of classical test theory and Rasch model. The results of the analysis were as follows; First, in the level of spatial thinking, students were able to grasp the spatial location and orientation of the celestial body, but were not able to convert the celestial motion of two-dimensional plane into three-dimensional plane, and it was revealed that there is no statistically significant difference in the spatial thinking of students among grade levels. Second, in the level of system thinking, students were able to identify the components and relationship between components of the celestial motion system, but could not identify the patterns of the system, and it was revealed that there was statistically significant difference among the system thinking of students in different grade levels, unlike in spatial thinking. Third, the astronomical thinking expressed in certain context (content) was very similar regardless of grade level, Through this, we could confirm the context-dependency or content-dependency of the astronomical thinking of students. It is expected that the results of this study can be used as basic data for exploring ways to enhance astronomical thinking level in school science classes.

• Journal of Educational Research in Mathematics
• /
• v.18 no.2
• /
• pp.239-261
• /
• 2008

This study presents results by the content areas in mathematics. Average performance is provided for five content areas: number, algebra, measurement, geometry, and data. Relative achievement is shown among the content areas for 4 countries in comparison to Korea. In number, Korea had lower average achievement than Singapore, especially for ratio proportion percent. Among 5 countries, Korea had the highest average achievement in algebra and geometry, but the lowest in attributes and units of measurement. In data, Korean students didn't learn the followings successfully: a) comparing characteristics of data sets and using mean, median, range, and shape of distribution, b) interpreting data sets (e.g., draw conclusions, make predictions, and estimate values between and beyond given data points), c) evaluating interpretations of data with respect to correctness and completeness of interpretation.

• Journal of The Korean Association For Science Education
• /
• v.34 no.8
• /
• pp.703-718
• /
• 2014

This study sought to investigate learning progressions for astronomical systems which synthesized the motion and structure of Earth, Earth-Moon system, solar system, and the universe. For this purpose we developed ordered multiple-choice items, applied them to elementary and middle school students, and provided validity evidence based on the consequence of assessment for interpretation of learning progressions. The study was conducted according to construct modeling approach. The results showed that the OMCs were appropriate for investigating learning progressions on astronomical systems, i.e., based on item fit analysis, students' responses to items were consistent with the measurement of Rasch model. Wright map analysis also represented that the assessment items were very effective in examining students' hypothetical pathways of development of understanding astronomical systems. At the lower anchor of the learning progression, while students perceived the change of location and direction of celestial bodies with only two-dimensional earth-based view, they failed to connect the locations of celestial bodies with Earth-Moon system model, and they could recognized simple patterns of planets in the solar system and milky way. At the intermediate levels, students interpreted celestial motion using the model of Earth rotation and revolution, Earth-Moon system, and solar system with space-based view, and they could also relate the elements of astronomical structures with the models. At the upper anchor, students showed the perspective change between space-based view and earth-based view, and applied it to celestial motion of astronomical systems, and they understood the correlation among sub-elements of astronomical systems and applied it to the system model.

• Journal of The Korean Association For Science Education
• /
• v.36 no.3
• /
• pp.509-517
• /
• 2016

Previous studies have investigated the similarity between the development of evolutionary explanations and students' conceptual developments on evolution. However, the validity and reliability of the assessment method reflecting the similarity have not been quantitatively examined yet. In addition, no study has examined the conceptual progressions of evolution concept based on contexts although literature has addressed the contextual difference of evolutionary explanation in the history of science. This study examined the validity and reliability of history-of-science-based evolution concept assessment using ordered multiple choice (OMC) methods and Rasch analysis and explored conceptual progression by three contexts (e.g., human, animal, and plant). The evolution concept assessment developed by Ha (2007) was used to examine 1711 elementary, middle, and high school students, and pre- and in-service science teachers' (biology majors and non-majors) evolution concepts. Internal consistency reliability and item response fitness of the OMC method that provide 0- to 4-point scores to creationism, teleology, intentionality, use/disuse, and natural selection respectively met the benchmark based on the Cronbach alpha and MNSQ indices of Rasch analysis. The level of elementary and middle school students' evolution concepts were located between intentionality and use/disuse while the level of high school and non-biology science teachers' evolution concepts were located between use/disuse and natural selection. The conceptual progressions of evolution concepts were differentiated according to three contexts. This study provided the quantitative evidence for the similarity between the development of evolutionary explanations and students' conceptual developments on evolution and suggest new analysis methods (i.e., OMC) of evolution concept assessment.

• Journal of The Korean Association For Science Education
• /
• v.38 no.3
• /
• pp.355-367
• /
• 2018

The purposes of this study are 1) to identify systems thinking level and definition, 2) to develop a framework for the assessment of systems thinking level, and 3) to develop a rubric for scoring open-ended written responded test. In order to achieve these purposes, a total of 60 articles were analyzed by using the literature analysis framework. The systems thinking level and definition are identified through the results of systems thinking literature analysis. Based on the systems thinking level and definitions, the research derived a framework that includes the core ideas and evaluation content of each level. In addition, rubric for the scoring of open-ended response test items was revised and supplemented. It is concluded that a content validity test on the tools (systems thinking level and definition, framework for item development, rubric) has been developed in the study. The content validity was verified by 7-science education experts. According to the result of CVI, it was found to be more than .95 in all three tools. Based on the results of this study, the research will develop items that can measure students' level of systems thinking. The construct validity and criterion validity of the developed items should be verified systematically. The research could carry out a validation study for the systems thinking measurement related to the core competence emphasized in the 2015 revised curriculum.

• Journal of Korean Elementary Science Education
• /
• v.32 no.2
• /
• pp.139-158
• /
• 2013

This study investigated elementary students' (grade 4~6) learning progressions for water cycling drawn from iterative assessments using ordered multiple-choice (OMC) items. An assessment system, which consisted of construct map, item design, outcome space, and measurement model, was employed in this study to examine children's learning progressions. At the first stage of the assessment system, a construct map was designed on which children's conceptual understandings from naive to most sophisticated were represented. At the item design stage, 8 OMC items were drawn from the construct map. Each item option of the OMC items was scored from 0 to 3 according to its level of understanding at the stage of outcome space. As a measurement model, Rasch model, a branch of item response theory, was applied to interpreting the outcomes of the OMC items. This cycle of assessment system was furtherly implemented iteratively in order to elaborate on the first version of water cycling learning progression. In conclusion, children's understanding of water cycling could be described in two aspects: water distribution and water movement. We identified children's conjectural developmental pathways about water cycling existed from superficial and naive accounts to more complex and abstract accounts.

• Journal of The Korean Association For Science Education
• /
• v.36 no.6
• /
• pp.815-833
• /
• 2016

This study investigated children's (grade 3 to 9) responses to assessment items on energy as a cross-cutting concept in order to get basic information for a learning progression. The assessment consisted of 8 ordered multiple-choice items at the contexts of electric circuit, mechanical energy of falling objects, phase change of matter, dissolution, biological phenomena of a lizard, food chain, radiative equilibrium between Sun and Earth, and the system of water cycling. Children's responses to each item were analyzed with using cross-tabulations in terms of grades and item option levels and Wright map and Differential item functioning based on Rasch modeled item response analysis. The results offered empirical evidence of children's development of understanding energy from relation between energy and its phenomena, types of energy, transfer and conversion of energy, towards conservation and equilibrium of energy for all of eight contexts. Children of each grade did not fully understand energy conservation. As grade goes up, their understandings of energy transfer and conversion were differentiated across the contexts and topics of energy. According to Rasch analysis, children had easier understanding of energy on dissolution and poorer understanding of energy on water cycling than that on other contexts. It was discussed and suggested that the results of this study help us organize science topics with regard to energy when developing new national science curriculum.

• Journal of The Korean Association For Science Education
• /
• v.36 no.2
• /
• pp.295-302
• /
• 2016

In this study, we investigated a learning progression focusing on $5^{th}$ to $9^{th}$ graders' performances with dissolution and solution concepts using the construct modeling approach. We designed a construct map describing hypothetical pathways of the concept development of dissolution and solution by analyzing both National Science Curricula and related studies. A conceptions test consisting of ordered multiple-choice items was developed and administered to 826 students. A revised construct map was derived from analyses of the results based on the partial credit model, a branch of polytomous item response theory. The sequence of dissolution and solution concepts presented in the current science curriculum was found to correspond with the learning progression of the students. However, the lower anchor, the concept of the homogeneity of particles in solution, and the factors affecting solubility were not consistent with the expected levels of the construct map. After revising the construct map, we proposed a learning progression for dissolution and solution concepts with five levels: Students of level 1 (the lower anchor) recognize the particles in the solution but misunderstand various concepts; Students of level 2 understand the homogeneity of particles in solution; Students of level 3 understand solubility and the conservation of particles during dissolution; Students of level 4 partially understand the interaction between particles; and Students of level 5 (the upper anchor) understand the interaction between particles and the factors affecting solubility.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.29-43
• /
• 2016

There have been much efforts to reconstruct the science curriculum focusing on Disciplinary Core Ideas(DCI) in many countries such as America and Europe, the most practical effort has been to design a curriculum with learning progressions(LPs). LPs describe stepwise how students can systematically move toward the understanding of more sophisticated ideas or scientific activities and explain in succession the process of understanding the ideas while the students learn. In this study, a LP for ecosystems has been developed, and the developed LP is then evaluated accordingly. The Ecosystem is one of the DCI of the life science in Next Generation Science Standards(NGSS). The development process of the LP was set at step 4(Development, Assessment, Analysis, and Amendment), and developed through an iterative process of sequences. As a result of analyzing the developed LP, an assessment based on the LP provides reliable information to identifying student ability. This study proposes the development process of the LP and its methodological aspects to use Core Achievement Standards, Ordered Multiple-Choice items and the Rasch model. In addition, using the empirically proven LP suggests a way of strengthening curriculum linked to educational content, teaching methods and assessment. Utilizing the proposed development process in this study will be to present the standard into the direction of becoming part of the curriculum. Currently, the state of domestic research for the LP is still lacking. This study determined the development process of the LP and the need to conduct future research on the LPs.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.177-190
• /
• 2016

The purpose of this study is to validate learning progressions for Earth's motion and solar system from two different perspectives of validity. One is construct validity, that is whether a hypothetical pathway derived from our study of LPs is supported by empirical evidence of children's substantive development. The other is consequential validity, which refers to the impact of LP-based adaptive instruction on children's improved learning outcomes. For this purpose, 373 fifth-grade students and 17 teachers from six elementary schools in Seoul, Kangwon province, and Gwangju participated. We designed LP-based adaptive instruction modules delving into the unit of 'Solar system and stars.' We also employed 13 ordered multiple-choice items and analyzed the transitions of children's achievement levels based on the results of pre-test and post-test. For testing construct validity, 64 % of children in the experimental group showed improvement according to the hypothetical pathways. Rasch analysis also supports this results. For testing consequential validity, the analysis of covariance between experimental and control groups revealed that the improvement of experimental group is significantly higher than the control group (F=30.819, p=0.000), and positive transitions of children's achievement level in the experimental group are more dominant than in the control group. In addition, the findings of applying Rasch model reveal that the improvement of students' ability in the experimental group is significantly higher than that of the control group (F=11.632, p=0.001).