• School Mathematics
• /
• v.18 no.1
• /
• pp.15-42
• /
• 2016

Clarifying differences of scholastic characteristics showed in male and female students is the first step for resolving the differences. It is difficult that we figure out them by one test. If we evaluate a few subjects, they can't have generality. So, we must evaluate lots of subjects through several years by all-around contents. We keep going on like that, we can get objective and valid results. Accordingly, I dealt with 2010~2014 NAEA taken by complete enumeration evaluation for elementary, middle, and high school students. From the evaluation, while I organized the achievement scores and the average of percentage of correct answers from aspects of whole test, item types, and content domains, I elicited from differences of scholastic characteristics showed in male and female students by achievement levels. On the basis of these, I explored ways which can resolve the differences in male and female students and I proposed several suggestions to look for the better ways.

• School Mathematics
• /
• v.16 no.2
• /
• pp.237-257
• /
• 2014

The purpose of this study is to investigate the academic achievement characteristics in terms of proficiency levels through the in-depth analysis of mathematics test items and achievement standards of the National Assessment of Educational Achievement(NAEA) from 2010 to 2012, and to provide suggestions for teaching and assessing mathematics in middle schools. The results showed that 'Advanced level' students could fully understand the concept of mathematical terms and symbols as well as various mathematical properties presented in the national curriculum. However, 'Proficient level' students tended to feel difficult to apply linear function, properties of a plane figure, and a solid figure, while 'Basic level' students seemed to have trouble solving mathematical problems in almost all areas. Thus, it is necessary to identify the mathematical misconceptions that students have and to strengthen teaching, particularly, the areas of number and operation.

• Journal of The Korean Association For Science Education
• /
• v.28 no.8
• /
• pp.848-859
• /
• 2008

The purposes of this study were to investigate the relationship between science achievement and student-related variables in the 2006 National Assessment of Educational Achievement (NAEA), the subjects of which included 3% of students within the entire population of the grades 6, 9 and 10. The results showed that the more they talk with parents, study by themselves, and read the books, the higher the students achieved in science. The science achievement was also significantly and positively related to self-regulated learning, adaptation to school life and attitude toward science. It is implied that the approach of stimulating internal motive such as interest, attitude toward science and human relations is more effective in resulting in the students' higher science achievement than focusing on external attitudes such as forcing good study habits.

• School Mathematics
• /
• v.15 no.1
• /
• pp.179-199
• /
• 2013

In this study we grasp what contents in the mathematics curriculum the students of multicultural and North Korean migrant families are vulnerable to and we would like to provide the bases to devise the appropriate teaching and learning methods for them. In order to this work we used the results of 2011 National Assessment Educational Achievement. We categorized students from multicultural and North Korean migrant families into children from international marriage family (born in country or immigrated), foreign family, and North Korean migrant family and compared each category with the whole students. First, for each school class we analyzed characteristics of academic achievement by ratio of achievement level, means of calibrated score, and percentages of correct answers in NAEA, mean percentages of correct answers by content domains, and percentages of correct answers by items. In addition to these we analysed items qualitatively and investigated study conditions in which the students of multicultural and North Korean migrant families have difficult times. In every subgroup the more ratio of advanced level decreases and ratio of below basic level increases the more school classes go up. Also these phenomena appear differently by each group and by content domain. For this reason by group, the supporting on learning will be needed.

• School Mathematics
• /
• v.15 no.2
• /
• pp.289-314
• /
• 2013

Achievement profile by attribute in Korean students' mathematics was analyzed by applying cognitive diagnostic model, which is the newest measurement theory, to 2011 NAEA(National Assessment of Educational Assessment) results. The results are as follows. As the level of school is higher from 6th grade, 9th grade to 11th grade, the percentage of students mastering cognitive attribute 9(expressions using picture, table, graph, formula, symbol, writing, etc) drastically declined from 78%, 35% to 26%. It is necessary to have learning strategies to reinforce their abilities of expressing table, graph, etc. that higher graders in mathematics are more vulnerable to. Next, the property of mastering cognitive attributes according to gender, multi-cultural family was analyzed. In terms of mathematics, the percentage of girls mastering most of the attribute generally is higher than that of boys from 6th grade to 9th grade, however, boys show higher mastery in almost attributes than girls in the 11th grade. Compared to boys, the part where girls have the most trouble is attribute 9 in mathematics(expressions using picture, table, graph, formula, symbol, writing, etc). As international marriage, influx of foreign workers, etc. increase, the number of students from Korea's multi-cultural families is expected to be higher, therefore, identifying the characteristics of their educational achievement is significant in reinforcing Korea's basic achievement. In mathematics, gap of mastery level of attributes between multi-cultural group and ordinary group is more severe in higher grade and the type of multi-cultural group that needs supports for improving achievement most urgently changed in 6th grade, 9th grade and 11th grade respectively. In the 6th and 11th grade, migrant students from North Korea show the lowest level of mastering attributes, however, in the 9th grade, the mastery rate of immigrant students is lowest. Therefore, there is an implication that supporting plans for improving achievement of students from multi-cultural family should establish other strategies based on the characteristics of school level.

• Journal of The Korean Association For Science Education
• /
• v.33 no.6
• /
• pp.1186-1201
• /
• 2013

We investigated student's characteristics in each educational achievement level using the results of the NAEA (National Assessment of Educational Achievement) in 2009, 2010, and 2011 for Grade 6 students, and compared the characteristics between elementary and middle school students. The analysis of representative items for each educational achievement level of elementary and middle school students revealed that (a) advanced level students from both elementary and middle school could exactly understand the achievement criteria of the curriculum, (b) proficient level students from both elementary and middle school were understanding the achievement criteria of the curriculum superficially, for example, they could not understand concepts exactly but could memorize terms, and so should have compensational education under situations that ask for short answer or essay type items instead of multiple choice items, and (c) basic level students from both elementary and middle school almost could not understand the achievement criteria of curriculum, and so should have compensational education under situations that only deal with a simple situation. Science concepts treated in science curriculum are hierarchically organized by level of school, and simple compensational education for the students of below basic level will not solve learning deficits in science education. Differentiated education by educational achievement should be largely expanded instead.

• Journal of the Korean Chemical Society
• /
• v.65 no.3
• /
• pp.209-218
• /
• 2021

This study investigated the condition of chemistry teacher's student competency assessment based on the inquiry report. To this end, an inquiry report was collected for chemistry teachers who took the training at two universities that conducted the 2020 first-class chemistry teacher training. The science subject competencies presented in NAEA analysis framework was used to analyze what kind of competencies teachers assess students through inquiry reports. A total of 63 chemistry teachers submitted inquiry reports, which were analyzed by competency, sub-element of each competency, and detail element to analyze the actual situation. As a result of the study, most chemistry teachers reflected their 'scientific inquiry and problem-solving ability' in their evaluation through inquiry reports. 'Ability to understand and apply scientific principles', which is mainly evaluated through paper-based evaluation, was partially used as confirmation of prerequisite learning at the beginning of the inquiry and the weight of evaluating 'scientific communication skill' was not large. In 'scientific inquiry and problem-solving ability' through inquiry report, 'design and conduct explorations', 'data analysis and interpretation' and 'drawing conclusion and suggesting solution' were mainly assessed. However, 'discover and recognize problems' and 'development and use of model' were hardly assessed.

• Journal of the Korean earth science society
• /
• v.41 no.6
• /
• pp.684-694
• /
• 2020

In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

• Journal of The Korean Association For Science Education
• /
• v.42 no.6
• /
• pp.611-619
• /
• 2022

The purpose of this study is to explore the possibility of applying big data analysis to provide appropriate feedback to students using evaluation data in science education at a time when interest in educational data mining has recently increased in education. In this study, we use the evaluation data of 2,576 students who took 24 questions of the national assessment of educational achievement. And we use K-means cluster analysis as a method of unsupervised machine learning for clustering. As a result of clustering, students were divided into six clusters. The middle-ranking students are divided into various clusters when compared to upper or lower ranks. According to the results of the cluster analysis, the most important factor influencing clusterization is academic achievement, and each cluster shows different characteristics in terms of content domains, subject competencies, and affective characteristics. Learning motivation is important among the affective domains in the lower-ranking achievement cluster, and scientific inquiry and problem-solving competency, as well as scientific communication competency have a major influence in terms of subject competencies. In the content domain, achievement of motion and energy and matter are important factors to distinguish the characteristics of the cluster. As a result, we can provide students with customized feedback for learning based on the characteristics of each cluster. We discuss implications of these results for science education, such as the possibility of using this study results, balanced learning by content domains, enhancement of subject competency, and improvement of scientific attitude.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.