• The Mathematical Education
• /
• v.60 no.2
• /
• pp.209-228
• /
• 2021

The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

• Journal of the Korean Chemical Society
• /
• v.59 no.5
• /
• pp.445-453
• /
• 2015

In 2005, descriptive assessment was introduced to increase students’ higher mental ability like problem-solving ability and creativity. Every year the ratio of descriptive assessment increases and it is regarded as an alternative evaluation to a multiple-choice item which measures simplicity knowledge. Externally the descriptive assessment took a root in school, but we can’t say definitely that it meets its original goal. In this paper, science descriptive assessment items of 5 middle schools in Gyeonggi-do were analysed; examiners was interviewed about how well they understood the characteristic of the assessment items. According to the analysis, characteristic of the items are ① unequal distribution of unit, ② difference of item’s type by unit, and ③ disappearance of measuring higher mental ability. It is considered that there are several factors of these characteristic - the lack of teachers’ ability to make assessment item; understanding of assessment instrument. These factors can be explained by the lack of assessment expertise. So the society’s effort is needed to raise teacher’s ability for the descriptive assessment.

• Proceedings of the Korean Society for the Gifted Conference
• /
• 2005.11a
• /
• pp.165-182
• /
• 2005

본 논문에서는 영재와 정보과학영재에 대한 여러 학자들의 정의와 특성 및 관련문헌의 분석을 통하여 정보과학영재의 특성과 정의를 재정립하여 초등정보과학영재 선발평가문항을 개발하였고, 개발된 문항의 신뢰도와 타당도를 검증하기 위해 1, 2차 예비검사를 통해 문항의 난이도와 변별도를 조정하였으며, 최종 검사를 통해 선발된 영재아와 일반 우수아의 검사 결과를 분석하고 정리하였다.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

• Journal of Science Education
• /
• v.44 no.1
• /
• pp.38-49
• /
• 2020

The purpose of this study is to analyze the paper test items of high school physics I 'Space-Time and the Universe' unit and how similar the textbook goals are to the cognitive and content areas. This study analyzed paper test items used from nine high schools and KICE about the unit. In order to analyze the distribution of items, they were classified by contents and by cognitive level which is knowledge, comprehension and application levels. As conclusion, application level items were a few, and unbalanced contents distribution appeared in school items. In comparison through the ratio difference index, the objectives of the textbook and the school items were very similar, but the similarities were low when comparing the school items with the KICE items. Based on the above, we suggested some ways to increase the validity of test items.

• Journal of Science Education
• /
• v.42 no.2
• /
• pp.198-213
• /
• 2018

In recent years, descriptive evaluation has been gaining importance at school. The purpose of this study is to analyse descriptive evaluation items which have been made by school teachers. 300 items for regular examinations are collected from 7 middle schools (grades 1 through 3) in Gyeongnam Province. Distribution and types of items are examined to compare educational objectives of standard achievements and those of evaluation according to Bloom's revised taxonomy of educational objectives. The result shows that there exist a majority of shared subject units for descriptive evaluation. Huge difference of frequency is also found among subject units and standard achievements. Less than 65% of evaluation items are descriptive and the rest is simple completion or short answers. In addition, it reveals only 40.3% of agreement between educational objectives of standard achievements and those of evaluation items. The interviews with 27 teachers indicate that lack of ability to develop proper items and grading are the major obstacles. In conclusion, systematic training courses are to be provided in order to resolve issues over descriptive evaluation.

• Journal of Elementary Mathematics Education in Korea
• /
• v.18 no.3
• /
• pp.505-518
• /
• 2014

The purpose of this study was to examine how pre-service elementary teachers develop mathematical tasks in the elementary teacher education program. Elementary pre-service teachers revise their tasks in clarifying representation, reflecting curriculum, modifying mathematical errors. Elementary pre-service teachers' perspective on assessment has been changed from focusing on tasks to focusing on students.

• Journal of the Korean Chemical Society
• /
• v.54 no.3
• /
• pp.329-337
• /
• 2010

In this study, we analyzed the end-of-chapter questions in 8 types of chemistry II textbooks for science teachers according to revised Bloom's taxonomy of educational objectives not only to raise interests of questions in textbooks but also acquire a basic material for using questions in textbooks effectively. The results of classification following Bloom's cognitive category showed that 'Understanding(44.7%)' level was the most, then 'Application(29.9%)', Knowledge(15.6%) and 'Analysis (9.5%)' in order, which is distinct difference from the result of classification of the end-of-chapter questions in college general chemistry books which was 'Application', 'Analysis' and 'Understanding' in order. Especially, questions of 'Evaluation' level were not found at all in any textbook investigated and 'Synthesis(0.3%)' level was very few. On the other hand, the percentage of questions in 'Understanding' and 'Executing Quantitative' which required specific algorithms was 70% of total with most of the questions in 'Application' were 'Executing Quantitative'.

• Journal of Korean Home Economics Education Association
• /
• v.19 no.3
• /
• pp.149-168
• /
• 2007

The purpose of this study was to analyze the home economics education items in the teacher recruitment examination for secondary school. To achieve the purpose, all the home economics education items, which were carried out for seven times from the school year 2001 to the most recent year 2007, were compared and analyzed. The form of items was analyzed by frequency and rate. Behavioral domain of items was analyzed by content analysis. In this study, some recommendations were suggested for the quality of home economics education items through discussion of science education and society education items, which were abstracted from the school year 2001 to the most recent year 2007. The results of this study were as follows. First, the score ratio of home economics education items was fluid as 20-30% from the school year 2001 to 2004 but it fixed as 30-35% since the school year 2005. In subcategory of home economics education, curriculum items accounted for highest ratio(43%). In the next thing, items of teaching-learning method(35%), evaluation(19%) and philosophy(3%) related to home economics education were followed in order. Second, the form of home economics education items was coexistent form of single item and subordinate item from the school year 2001 to 2004. But it was changed into form of single item by 100% since the school year 2005. Third, regarding the content of home economics education items, most of the curriculum items were related to the content of the 7th National Curriculum. Teaching-learning method items were taken mostly from model of teaching-learning. Evaluation items were taken mostly from performance assessment. Philosophy items related to home economics education were taken only from Habermas's three systems of action on the school year 2005. Fourth, about behavioral domain of home economics education items, most of the curriculum items were level of 'simple knowledge or memory'. Therefore, it was suggested that behavioral domain of curriculum items had to be changed into 'complex knowledge or comprehension and application'. The behavioral domain of teaching-learning method items and education evaluation items was mostly 'complex knowledge or comprehension and application'. However, to bettering the items it was suggested that the behavioral domain of them has to be changed 'comprehension' into more 'application'. Fifth, regarding the coverage of home economics education items, curriculum items were limited only superficial content of the 7th National Curriculum. Therefore, it was suggested that coverage of curriculum items had to be extended to theoretical content, which was philosophical background and various principles of curriculum. It was suggested that coverage of teaching-learning method items had to be extended to the content including various teaching-learning theories and the practical reasoning home economics instruction proved effective as home economics instruction recently. Evaluation items were taken mostly from performance assessment. Therefore, it was suggested that coverage of evaluation items had to be extended to analysis of evaluation result, item validity and reliability, and evaluator's philosophical perspective.

• Journal for History of Mathematics
• /
• v.25 no.2
• /
• pp.97-111
• /
• 2012

This paper aims to identify the area of knowledge required for constructing test items by comparing the consulting contents with the area of MKT(Mathematical Knowledge for Teaching). This paper collects the consulting results by the consulting group of A provincial office of education from 2007 to 2009, and analyzes and categorizes the results. The knowledge for constructing test items are known by the analysis on the consulting contents. Training and consulting for teachers are necessary to enable them to recognize the importance of these categories and improve the quality of test items.