• Journal of Educational Research in Mathematics
• /
• v.22 no.1
• /
• pp.1-22
• /
• 2012

The purpose of this study is to understand Korea students' characteristics as well as to give important information of improving our education using comparative analysis of framework, test booklets, test results between PISA 2009 and NAEA 2009. PISA 2009 was administered on May of 2009 and NAEA was administered on October of same year. The summary of the results of comparing two assessment is as follows First, cut score of NAEA Advance level is bigger than the cut score of level 5, which is considered as high achievement level. The cut score of Basic level of NAEA is also higher than the level 2 of PISA, which is considered as basic achievement level. This phenomenon can show that NAEA achievement level is set little bit higher than the achievement level of PISA in mathematics domain. Second, the percentage of female students on higher level was higher than that of male students. In suburban area, the percentage of high level was small and the percentage of low level was big. Third, students of Advanced level are distributed concentrating in PISA levels 4~6, Proficient achievement level concentrating in PISA levels 3~5, Basic achievement level concentrating in PISA levels 2~4, and below basic achievement levels concentrating in below level 1 and level 3 of PISA. Fourth, the correlation between NAEA 2009 and PISA 2009 achievement scores are significantly positive. However, the correlation of subscales were low. Fifth, analysis of non-equivalent group, 11 items located in 'change and relationship', 'uncertainty', 'connection cluster' domains found to be significantly different. The percent correct showed very big difference. The analysis results presents the implication of mathematics curriculum, teaching and learning methods as well as National Assessment of Educational Achievement.

• Journal of Science Education
• /
• v.41 no.3
• /
• pp.382-404
• /
• 2017

This study aims to explore a learning progression for eight core concepts of middle school science using constructed response items in the national assessment of educational achievement (NAEA). For this purpose, a total of 7,390 responses of the 9th graders on 8 constructed response items in NAEA conducted in 2015 were inputted by computer and the inputted answers were analyzed and classified into different levels. After completing this process, five levels were set for each construct and a construct map was created according to the levels. In this study, the construct map was written in a progression-based rubric format, which was used as a criterion for leveling the answers of all students. In addition, the Rasch model was applied to measure the scores and achievements of the respondents by means of statistical analysis to correlate the scores of the students with the achievement levels of the constructs. Lastly, a preliminary learning progression was created by revising the construct map reflecting the results of Rasch model application. This study was meaningful in that it explored the possibility of developing the learning process by using constructed response items in NAEA. However, the preliminary learning progression developed in this study is still hypothetical and inferential because it is not longitudinally traced to individual students. Therefore, it is necessary to continually revise and supplement through iterative research process.

• Journal of Educational Research in Mathematics
• /
• v.16 no.3
• /
• pp.199-220
• /
• 2006

One of the main objectives of National Assessment of Educational Achievement (NAEA), which is implemented by Korea Institute of Curriculum and Evaluation(KICE), is to manage the qualities of National Curriculum. Thus we considered NAEA as the research for educational program assessment and tried to find out how to make NAEA better for achieving that objective. For the purpose of this paper we analyzed the present conditions of NAEA into four perspectives. And then according to each perspective we explored schemes for improving NAEA. In conclusion, we proposed the following; Firstly, in relation to assessing students' understanding of the mathematics contents, the meanings of Achievement Levels have to become much more clear and concrete. in relation to assessing for comparing student' understanding according to mathermatics content areas, the number of items has to be increased for elevating validities of NAEA. Thirdly, in relation to gathering the information about properties which are shown by the students in particular Achievement, it is necessary to think about how to produce items for the purpose in the step of developing items in NAEA. Finally in relation to collecting the data which can be useful for relevance of mathematics contents, it is necessary to make a special group of items for identifying relevance of mathematics contents, and to apply performance assessments on part of the students, not whole students.

• Journal of The Korean Association For Science Education
• /
• v.42 no.1
• /
• pp.149-160
• /
• 2022

Comparative studies using large-scale data such as TIMSS, PIRLS, and PISA inform us of the effectiveness of each educational system. Even though samples in the large-scale studies were representative, admitting potential discrepancy when applying the findings of the large-scale studies to local educational system is still needed. This study examines the structural relationship among students' attitude towards science, learning support from teachers, school life, and science academic achievement with both large-scale data and local comparative study data utilizing same variables. Responses on the TIMSS 2019 of 5,554 Korean seventh-grade students and National Assessment of Educational Achievement (NAEA) 2019 of 6,365 third-grade middle school students were used. The results indicate that: a) school life did not affect the science achievements in both data. However, in NAEA 2019, students' attitude mediated the relationship between school life and science achievement; b) learning support from teachers had a significant impact on TIMSS science achievements, and also had positive effect on achievement through students' attitude in TIMSS. On the other hand, learning support had a positive effect on achievement only when student's attitude mediated the relationship in NAEA; c) students 'attitude toward science had positive effect on science achievement on both data; d) the impact of gender was different on school life, academic achievement, students 'attitude towards science, and learning support from teachers on both data; and e) the impact of the number of books differed as well. There were differences in results between the international and domestic research, which inform us that we need to pay attention when interpreting the domestic environment through the results of international research.

• School Mathematics
• /
• v.12 no.2
• /
• pp.113-136
• /
• 2010

According to the self-assessment tool identifying teacher's competence in assessment, many teachers have difficulty in making assessment tools. This study analyzes the types of modification with data of NAEA(National Assessment of Educational Achievement) items from 2006 to 2008. NAEA goes through complicated formalities from begin to make draft items to completing them. This study shows the types of item modification and its specific examples. NAEA analyzes the degrees of studuents' achievement according to the educational objectives of the National Curriculum. This study provides specific comments on making mathematics assessment items to the teachers who embody national curriculem. Therefore this study will contribute to improve mathematics teacher's professional competence in the area of assessment tool development.

• The Mathematical Education
• /
• v.52 no.3
• /
• pp.303-317
• /
• 2013

Recently in South Korea, various methods are followed in decreasing educational gap between region and social classes through school education. The National Assessment Educational Achievement(NAEA) intends to strengthen responsibility of school education and manage quality of curriculum. Besides, the NAEA intends to bridge achievement gap which is one of educational gaps by grasping the characteristics of academic ability to guarantee basic academic ability. There is not much research about the educational gap among regional scales. Therefore in this study, to examine the achievement characteristics among regional scales closely, we analyse the 2010, 2011 NAEA results in elementary mathematics subject and explore characteristics of items which have sharp differences between local population sizes. The results of the analysis has been showed that the educational gap between 'big-sized cities' and 'small and midium-sized cities' has been increased, but the overall educational gap among regional scales has been decreased.

• Journal of Educational Research in Mathematics
• /
• v.10 no.2
• /
• pp.161-182
• /
• 2000

This study is to develop assessment framework, test items and questionnaire for the National Assessment of Educational Achievement(NAEA), which administered in the elementary and secondary schools across the country in this year(2000). According to the first year study result of the NAEA, the test was administered in two core subjects, Mathematics and Social Studies. In this study, test items and sets of questionnaire and administered pretest were developed in the last year. In this year, the NAEA was administered with the adjusted test items and questionnaires and the results was analyzed and would be reported to the public. NAEA was developed on the basis of national curriculum, especially of the nature and objectives of subject curriculum in Mathematics (and also Social Studies). In the framework of assessment, we set up four differentiated levels of student achievement: 'under basic', 'basic', 'intermediary', and 'advanced'. Here 'the intermediary level' means the level of educational achievement in which students can understand average content of subject curriculum. 'Advanced level' indicates the level of educational achievement in which students master all the content of subject curriculum and apply basic concepts and principles to a variety of situations. 'The basic level' means the level of educational achievement in which students do not achieve the intermediary level. Students who do not understand average content of subject curriculum are classified as belonging to the basic level. Finally, this study would explain how to administer and analyze the test in the future. The test result was analyzed to report students' educational achievement according to regions, content areas, behavioral characteristics, and etc. This study would show how to report test result\ulcorner and how to set up students' academic achievement.

• Communications of Mathematical Education
• /
• v.32 no.3
• /
• pp.435-453
• /
• 2018

The results analysis of National Assessment of Educational Achievement(NAEA) can provide various implications for teaching and learning in the school field. In this study we analyzed the deviation of NAEA achievement level-based correct-answer rate and the distribution of the responses percentages for three years from 2015 to 2017 focused on multiple-choice items. First we calculated the deviation of correct-answer rate between advanced level and proficient level and between proficient level and basic level, and then we selected the items whose deviation of correct-answer rate is more than the third quartile. We explored what the content areas, behavior areas and achievement standards of each item are and what the achievement standards and characteristics of these questions are. Based on the results of the analysis, we intended to derive implications for appropriate teaching-learning methods at each achievement-level.

• Education of Primary School Mathematics
• /
• v.5 no.1
• /
• pp.21-39
• /
• 2001

This study is to develop assessment framework, test items and questionnaire for the National Assessment of Educational Achievement(NAEA), which administered in the elementary and secondary schools across the country in this year(2000). According to the first year study result of the NAEA, the test was administered in two core subjects, Mathematics and Social Studies. In this study, test items and sets of questionnaire and administered pretest were developed in the last year. In this year, the NAEA was administered with the adjusted test items and questionnaires and the results was analyzed and would be reported to the public. NAEA was developed on the basis of national curriculum, especially of the nature and objectives of subject curriculum in Mathematics (and also Social Studies). In the framework of assessment, we set up four differentiated levels of student achievement:‘under basic’,‘basic’,‘intermediary’, and ‘advanced’. Here ‘the intermediary level’means the level of educational achievement in which students can understand average content of subject curriculum. ‘Advanced level ’indicates the level of educational achievement in which students master all the content of subject curriculum and apply basic concepts and principles to a variety of situations. ‘The basic level’means the level of educational achievement in which students do not achieve the intermediary level. Students who do not understand average content of subject curriculum are classified as belonging to the basic level. Finally, this study would explain how to administer and analyze the test int he future. The test result was analyzed to report students’s educational achievement according to regions, content area, behavioral characteristics, and etc. This study would show how to report test results and how to set up student’s academic achievement.

• Education of Primary School Mathematics
• /
• v.5 no.2
• /
• pp.121-142
• /
• 2001

The goal of the National Assessment of Educational Achievement(NAEA) 2001 was to affirm the accountability of school education, to scientifically manage and elevate the quality of education at the national level, and to articulate the final design of the NAEA. It was implemented on June 28th of the year 2001. The assessment frame for NAEA includes the achievement standards, the assessment standards, the instruction for the item development, and the grading policy for mathematics subject. Most of items are multiple-choice types, but the performance-based items should be at least thirty percent of the total items, also 30% in case of mathematics. Approximately 1% of students among entire population of the Grades 6 were randomly selected. Therefore, the finally sampled examines were 8023 at Grade 6. The result of the analysis of the NAEA revealed that Grade 6 students was labelled as ‘average’ level in general (Number and Operation: average, Geometric figures: average, Patterns and Functions: excellent, Measurements: average, Letters and Expressions: average, Probability and Statistics: average). The most characteristic finding was that except for Grade 6(its average is 69.92), most secondary students obtained low test scores and its average of each grade is below 50 out of 100. Especially, the scores on the performance-based items were by and large very low. This finding implies that Korean students are not familiar with the kind of test items which requires expression of ideas and feelings and they are rather familiar with the multiple-choice items. Another interesting finding was that the students in small towns and remote areas showed significantly low scores in all four skills compared with Seoul, metropolitan cities and medium and small cities. This may be attributed from the fact that the remote areas do not have equal learning environment with regard to social and cultural experience, supply of various teaching materials, extracurricular lessons which are directly related to teaching and learning. These findings may be utilized as a reliable resource fur improving curriculum and teaching and learning in Mathematics.