• Journal of the Korean earth science society
• /
• v.26 no.6
• /
• pp.511-523
• /
• 2005

The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

• Journal of the Korean Chemical Society
• /
• v.54 no.3
• /
• pp.329-337
• /
• 2010

In this study, we analyzed the end-of-chapter questions in 8 types of chemistry II textbooks for science teachers according to revised Bloom's taxonomy of educational objectives not only to raise interests of questions in textbooks but also acquire a basic material for using questions in textbooks effectively. The results of classification following Bloom's cognitive category showed that 'Understanding(44.7%)' level was the most, then 'Application(29.9%)', Knowledge(15.6%) and 'Analysis (9.5%)' in order, which is distinct difference from the result of classification of the end-of-chapter questions in college general chemistry books which was 'Application', 'Analysis' and 'Understanding' in order. Especially, questions of 'Evaluation' level were not found at all in any textbook investigated and 'Synthesis(0.3%)' level was very few. On the other hand, the percentage of questions in 'Understanding' and 'Executing Quantitative' which required specific algorithms was 70% of total with most of the questions in 'Application' were 'Executing Quantitative'.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

• Korean Educational Research Journal
• /
• v.38 no.1
• /
• pp.29-39
• /
• 2017

This study analyzes the items of acid base and redox unit in the middle school science textbook based on the 2009 revised science curriculum using Bloom's taxonomy of educational objectives. As a result of the analysis, the elements of knowledge area appeared the most in textbook items of all publishing companies, and those elements were less in order of understanding, application, analysis, synthesis and evaluation. And the sub-domain of cognitive domains were not evenly distributed by the publisher. Therefore, schools need to refer to the evaluation items of the textbooks of various publishing companies and use them in class.

• Journal of Elementary Mathematics Education in Korea
• /
• v.5 no.1
• /
• pp.19-36
• /
• 2001

The aim of the study is to explore some problems that we have to solve to execute assessments effectively and in agreement with the objectives of them. We analysed the practices of some assessments Including our national assessment of educational achievement and the third international mathematics and science study with focussing on the frames of assessments, the analyses of results, and the items presented in the assessments. The results of the study are the following. Firstly, we need to make the frame of assessment to agree with the objectives of assessment and to reflect the characteristics of the item related to a few areas. Secondly, we need to analyse the results of assessment with reflecting the frames of assessment. Thirdly, we need to discuss more concretely on the level and presentation of items including the order of conditions to need to solve the items. And lastly, we need to minimize the difference caused by the variations of translation in the international assessments.

• Journal of Science Education
• /
• v.44 no.1
• /
• pp.38-49
• /
• 2020

The purpose of this study is to analyze the paper test items of high school physics I 'Space-Time and the Universe' unit and how similar the textbook goals are to the cognitive and content areas. This study analyzed paper test items used from nine high schools and KICE about the unit. In order to analyze the distribution of items, they were classified by contents and by cognitive level which is knowledge, comprehension and application levels. As conclusion, application level items were a few, and unbalanced contents distribution appeared in school items. In comparison through the ratio difference index, the objectives of the textbook and the school items were very similar, but the similarities were low when comparing the school items with the KICE items. Based on the above, we suggested some ways to increase the validity of test items.

• Journal of the Korean Chemical Society
• /
• v.56 no.4
• /
• pp.491-499
• /
• 2012

This study was to analyze the educational objectives of evaluation of practice quizzes and learning objectives of chemistry I textbooks for the 2009 revised curriculum by Klopfer's taxonomy. The result revealed that the objectives of science education indicated in the 2009 revised curriculum were contained the educational meaning of all categories except 'manual skills' of Klopfer's taxonomy of educational objectives. The learning objectives of chemistry I textbooks laid mostly on 'the knowledge and comprehension' and 'the process of scientific inquiry'. It showed that 'the objectives of scientific knowledge and methods', 'manual skills' and 'scientific attitude and interest', 'orientation' seemed to be taken in a relatively careless way. The result on the practice quizzes in textbooks, they also laid stress on 'the knowledge and comprehension' were covered much, even though they were emphasized in the other objectives of the curriculum. It was concluded that the educational objectives of the science textbooks did not reflect much on educational objectives of the 2009 revised curriculum.

• Journal of the Korean School Mathematics Society
• /
• v.20 no.4
• /
• pp.387-404
• /
• 2017

In this paper, in the last 4 years(2014~2017 school year), we classified the probability and statistical items based on the evaluation scope of the mathematics subject content knowledge which were presented by the Korea Institute for Curriculum and Evaluation, and the classified items were analyzed. As a result, First, in order to induce normalization of the probability and statistical curriculum, four assessment field should be evenly distributed. Second, integrated thinking and comprehensive analytical thinking assessment is required. Third, item an epilogue should be used to measure mathematical thinking and logical competence. Fourth, the ratio of the number of items in probability and statistics to the number of that was 7.7%~10.0%, and the ratio according to the item weighting was 5.0%~7.5%. Fifth, it maintains the policy of stabilizing a good the level of difficulty of the items. Finally, probability and statistical assessment should focus on measuring problem solving ability from an inductive point of view.

• 한국체육학회지인문사회과학편
• /
• v.58 no.1
• /
• pp.295-308
• /
• 2019

The purpose of the present study is to apply a health belief model to the serious perception of an increase in youth obesity, and to develop and validate a measurement tool for youth obesity prevention among this group who are experiencing increasing rates of obesity. The specific goals of this study are to 1) apply a health belief model to develop a measurement tool for obesity prevention among youth who are seeing rising rates of obesity, and 2) provide an integrated validation procedure and foundation for developing this measurement tool. A total of 1801 high school students[sample1: 902(male:464,female:438); sample2: 899(male:464,female:438)] were recruited and collected data from 12 high school in Seoul and Kyonggi area. For this study the analytic framework of unified validity was developed which can comprehensively reflect unified validity be Messick(1995), framework for conducting a strong program of construct validation by Benson(1998), the unified validity implementation method of Rasch model suggested by Wolfe and Smith(2007a, 2007b). Furthermore, after dividing the developed analytic framework into each stage(the substantive domain), the evidence of validity of Youth Obesity Prevention Scale(YOPS) applying Health Belief Model was systematically suggested. The YOPS suggested the evidence about the substantive domain of unified validity. The developed YOPS was consist of Susceptibility, Severity, Benefits, Barriers and Cues to Action. After 3 stage in substantive domain, the components of YOPS(5factors and 28items) satisfied the unidimensionality, and the 5 point Likert scale had the significant discrimination of the respondents' response.

• The Journal of the Korea Contents Association
• /
• v.17 no.10
• /
• pp.472-482
• /
• 2017

In this study, discrete mathematical items were classified into analytical items and mathematical items were analyzed on the basis of analytic framework items of mathematics and the past items of mathematics subject contents of the period 2011-2017 school year. First, the discrete mathematics evaluation areas and evaluation contents proposed by the Korea Institute for Curriculum and Evaluation should be evenly distributed. Second, the items of measuring metacognitive knowledge as a strategic knowledge on the use of cognitive methods should be given. Third, the ratio of the number of items in discrete mathematics to the number of that was 3.8%~6.8%, and the ratio according to the item weighting was 2.2%~6.3%. Fourth, it is analyzed that all the items are suitable for the evaluation goal and the pre-service math teachers who have faithfully implemented the curriculum have maintained the appropriate level of difficulty to solve. Finally, the content items such as the method of counting the discrete mathematics curriculum, the Recurrence Relation, the generation function, and the graph are matched with the teacher certification examination and the mathematics education curriculum of each teachers college. By these reasons, we conclude that the contribution of pre-service teachers to the motivation of learning is obtained and implications.