• Journal of Science Education
• /
• v.34 no.1
• /
• pp.164-174
• /
• 2010

The purpose of this study was to find out taxonomic characteristics of objectives infered from questions of summative evaluation by analyzing those objectives with Bloom's revised taxonomy of educational objectives. 1,711 questions of midterm and final examinations collected from 25 middle schools were analyzed to classify objective of each question. The major findings of the study were as follows: first, from the analysis of objectives in the knowledge dimension, the assessment of factual knowledge was most prevailing(67.6%) in the biology summative evaluation. In the cognitive process dimension, memory assessment was most dominant(76.1%). Thus, the main objectives of evaluation leaned toward particular classes in the Bloom's revised taxonomy, which was different from the findings of earlier studies on the weights of evaluation areas. Second, the level of the objectives should be determined in consideration of the grade of middle schoolers, as their cognitive level improves with grade. In fact, however, there was no difference among three grades in characteristics of objective taxonomy.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

• Journal of Science Education
• /
• v.42 no.2
• /
• pp.198-213
• /
• 2018

In recent years, descriptive evaluation has been gaining importance at school. The purpose of this study is to analyse descriptive evaluation items which have been made by school teachers. 300 items for regular examinations are collected from 7 middle schools (grades 1 through 3) in Gyeongnam Province. Distribution and types of items are examined to compare educational objectives of standard achievements and those of evaluation according to Bloom's revised taxonomy of educational objectives. The result shows that there exist a majority of shared subject units for descriptive evaluation. Huge difference of frequency is also found among subject units and standard achievements. Less than 65% of evaluation items are descriptive and the rest is simple completion or short answers. In addition, it reveals only 40.3% of agreement between educational objectives of standard achievements and those of evaluation items. The interviews with 27 teachers indicate that lack of ability to develop proper items and grading are the major obstacles. In conclusion, systematic training courses are to be provided in order to resolve issues over descriptive evaluation.