• The Mathematical Education
• /
• v.46 no.4
• /
• pp.407-421
• /
• 2007

The purpose of this study is to identify the item characteristics that are supposed to affect item difficulty and to estimate the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test(CSAT). We selected six variables related to item characteristics based on learning theories: contents, cognitive domain, novelty, item type, number of concepts, and the amount of computation. With data of the CSAT mathematics test administered in 2004-2006, item difficulty was regressed on the six variables, the location of an item, and the item writer's judgment on difficulty. The novelty of an item was found to be a statistically insignificant variable in explaining item difficulty. Four regression equations with different sets of independent variables could explain $70%{\sim}80%$ of the item difficulty variance and were validated as predicting item difficulty of the mock CSAT in 2006.

• Journal of Korean Elementary Science Education
• /
• v.35 no.2
• /
• pp.137-149
• /
• 2016

The purpose of this study is to develop a descriptive paper test item which can evaluate elementary school students' HGA (scientific Hypothesis Generating Ability) and to propose a counting formula that can easily assess student's HGA objectively and quantitatively. To make the test item can possibly evaluate all the students from 6th graders to 3rd graders, the 'rabbit's ear' item is developed. Developed test item was distributed to four different elementary schools in Seoul. Total 280 students who were in the 6th grade solved the item. All the students' reponses to the item were analyzed. Based on the analyzed data evaluation factors and evaluation criteria are extracted to design a Hypothesis Generating ability Quotient (HGQ). As the result 'Explican's Degree of Likeness' and 'Hypothesis' Degree of Explanation' are chosen as evaluation factors. Also precedent evaluation criteria were renewed. At first, Explican's Degree of Likeness evaluation criterion was turned four levels into three levels and each content of evaluation criterion is also modified. Secondly, new evaluation factor 'Hypothesis' Degree of Explanation' was developed as combined three different evaluation criteria, 'level of explican', 'number of explican' and 'structure of explican'. This evaluation factor was designed to assess how the suggested hypothesis can elaborately explain the cause of one phenomenon. Newly designed evaluation factors and evaluation criteria can assess HGA more in detail and reduce the scoring discordant through the markers. Lastly, Developed counting formula is much more simple than precedent Kwon's equation for evaluating the Hypothesis Explanation Quotient. So it could help easily distinguish one student's scientific hypothesis generating ability.

• Education of Primary School Mathematics
• /
• v.8 no.2 s.16
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• Proceedings of the IEEK Conference
• /
• 2003.07d
• /
• pp.1371-1374
• /
• 2003

This paper designs and implements of Item pool-Based Program using Visual Basic, a sort of self- study system. This paper is implemented the system which makes and remakes the test items using item-pool data with different method from an ordinary fixed form of evaluation. This system helps teachers to make a various test type of items by searching data through the item-pool and accounting it to the test items. This system will also improve the learner's understanding of the problems and desire for self-solving a problem.

• Journal of The Korean Association For Science Education
• /
• v.16 no.3
• /
• pp.314-328
• /
• 1996

This study investigated the literature about science process skills' evaluation to analyse transition of evaluation objectives before and after a Scholastic Ability Test for College Entrance. In the literature survey the researcher established a 3 dimensional science assessment framework with X axis as science concept, Y axis as science process skills and Z axis as problem context. In order to analysis and compare each items the researcher selected 210 items from the 1st to the 7th trials and 138 items from the 1st to 4th Scholastic Ability Test for College Entrance and sampled 2873 science achievement test items from 10 high schools. In accordance with this taxonomy the researcher analysed and compared science process skills item forms. The following results were drawn : The items were evenly distributed in all the four areas(Earth Science, Biology, Physics and Chemistry) of the science concept domain, but they were heavily concentrated on data analysis and drawing a conclusion in science process domain. In the domain of problem context school context was the majority. In spite of distribution like this the ratio on science process skills measurement items and science achievement test items was increased after the Scholastic Ability Test for College Entrance was given. Also the ratio on item expression type was increased. Item form was almost 5 options selection type in the national level test. Although there were 4 options selection type, 5 options selection type, short answer type, essay type in school level test, rising from 33.1% to 65.5% on 5 options selection type is exhibited. This study showed that the school level item form was better various than the nation level. This point like this is the evidence for the improvement toward the science process skills test and influenced by Scholastic Ability Test for College Entrance. The ratio on the item which joined with the 3 axes had a mean of 99.3% in nation level test and mean 44.9% in school achievement test level. But the ratio in the school achievement test level increased after the Scholastic Ability Test for College Entrance was given. In view of this study we must furthermore study the item types which can evaluate valjdately science process skill's five stage each and evaluation method by the high school students' problem solving patterns and features in scientific inquiry on all science process skills elements.

• Journal of Korean Academy of Nursing
• /
• v.14 no.2
• /
• pp.5-11
• /
• 1984

The main purpose of this study were; to determine the reliability and validity of evaluation tool administered to the nursing student in nursing management practice,；to identify the effective evaluation method of nursing student in nursing management practice. The subjects were 46 senior nursing students at Department of Nursing, College of Medicine, Seoul National University in 1983. The evaluation tool was analyzed according to evaluation method; self-evaluation. and head nurse evaluation. Also individual item of evaluation tool was analyzed by item analysis in order to determine the evaluation area, and appropriateness of the test item used. A Summary of the results is as follows; 1. The reliability and validity of evaluation tool were relatively high both in self-evaluation and head nurse evaluation. 2. In comparison of mean scores, there is no significant difference between head nurse evaluation and self-evaluation. 3. The nursing management activities which have the correlation of self-evaluation and head nurse evaluation were in the activity of interpersonal relation, independent activity and implementing nursing process. In general nursing practice and unit management activity, there was no correlation of self-evaluation and head nurse evaluation.

• The Korea Journal of Herbology
• /
• v.37 no.2
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• Culinary science and hospitality research
• /
• v.6 no.2
• /
• pp.5-21
• /
• 2000

The purpose of this study looks for the directions to improve the performance evaluation of cook by examining the perceptions for performance of cook by supervisors in hotel restaurant. In order for this purpose, this study focuss on two areas: (1) the significant differences of each hotel type on the perceptions of each performance evaluation item, (2) the significant differences of each kitchen type on the perceptions of each performance evaluation item in terms of two different types of hotel. To examine (1) and (2), this study uses Student t test and anova analysis. The findings from this study have both theoretical and practical implications. Implications of these findings are discussed.

• Journal of Applied Reliability
• /
• v.12 no.3
• /
• pp.131-138
• /
• 2012

A design of reliability qualification test based on performance distribution is developed. In general, the performance of an item degrades as the time goes by and the failure of an item occurs when the performance degradation reaches the pre-determined critical level. This article considers the reliability qualification test based on a more tightened critical value at the earlier stage to reduce the evaluation testing time and cost. A numerical example is provided to illustrate how to use the developed reliability qualification test.

• Journal of The Korean Association For Science Education
• /
• v.30 no.4
• /
• pp.452-471
• /
• 2010

As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.