• 한국수학교육학회지시리즈A:수학교육
• /
• 제46권4호
• /
• pp.407-421
• /
• 2007

The purpose of this study is to identify the item characteristics that are supposed to affect item difficulty and to estimate the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test(CSAT). We selected six variables related to item characteristics based on learning theories: contents, cognitive domain, novelty, item type, number of concepts, and the amount of computation. With data of the CSAT mathematics test administered in 2004-2006, item difficulty was regressed on the six variables, the location of an item, and the item writer's judgment on difficulty. The novelty of an item was found to be a statistically insignificant variable in explaining item difficulty. Four regression equations with different sets of independent variables could explain $70%{\sim}80%$ of the item difficulty variance and were validated as predicting item difficulty of the mock CSAT in 2006.

• 한국초등과학교육학회지:초등과학교육
• /
• 제35권2호
• /
• pp.137-149
• /
• 2016

The purpose of this study is to develop a descriptive paper test item which can evaluate elementary school students' HGA (scientific Hypothesis Generating Ability) and to propose a counting formula that can easily assess student's HGA objectively and quantitatively. To make the test item can possibly evaluate all the students from 6th graders to 3rd graders, the 'rabbit's ear' item is developed. Developed test item was distributed to four different elementary schools in Seoul. Total 280 students who were in the 6th grade solved the item. All the students' reponses to the item were analyzed. Based on the analyzed data evaluation factors and evaluation criteria are extracted to design a Hypothesis Generating ability Quotient (HGQ). As the result 'Explican's Degree of Likeness' and 'Hypothesis' Degree of Explanation' are chosen as evaluation factors. Also precedent evaluation criteria were renewed. At first, Explican's Degree of Likeness evaluation criterion was turned four levels into three levels and each content of evaluation criterion is also modified. Secondly, new evaluation factor 'Hypothesis' Degree of Explanation' was developed as combined three different evaluation criteria, 'level of explican', 'number of explican' and 'structure of explican'. This evaluation factor was designed to assess how the suggested hypothesis can elaborately explain the cause of one phenomenon. Newly designed evaluation factors and evaluation criteria can assess HGA more in detail and reduce the scoring discordant through the markers. Lastly, Developed counting formula is much more simple than precedent Kwon's equation for evaluating the Hypothesis Explanation Quotient. So it could help easily distinguish one student's scientific hypothesis generating ability.

• 한국수학교육학회지시리즈C:초등수학교육
• /
• 제8권2호
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅲ
• /
• pp.1371-1374
• /
• 2003

This paper designs and implements of Item pool-Based Program using Visual Basic, a sort of self- study system. This paper is implemented the system which makes and remakes the test items using item-pool data with different method from an ordinary fixed form of evaluation. This system helps teachers to make a various test type of items by searching data through the item-pool and accounting it to the test items. This system will also improve the learner's understanding of the problems and desire for self-solving a problem.

• 한국과학교육학회지
• /
• 제16권3호
• /
• pp.314-328
• /
• 1996

This study investigated the literature about science process skills' evaluation to analyse transition of evaluation objectives before and after a Scholastic Ability Test for College Entrance. In the literature survey the researcher established a 3 dimensional science assessment framework with X axis as science concept, Y axis as science process skills and Z axis as problem context. In order to analysis and compare each items the researcher selected 210 items from the 1st to the 7th trials and 138 items from the 1st to 4th Scholastic Ability Test for College Entrance and sampled 2873 science achievement test items from 10 high schools. In accordance with this taxonomy the researcher analysed and compared science process skills item forms. The following results were drawn : The items were evenly distributed in all the four areas(Earth Science, Biology, Physics and Chemistry) of the science concept domain, but they were heavily concentrated on data analysis and drawing a conclusion in science process domain. In the domain of problem context school context was the majority. In spite of distribution like this the ratio on science process skills measurement items and science achievement test items was increased after the Scholastic Ability Test for College Entrance was given. Also the ratio on item expression type was increased. Item form was almost 5 options selection type in the national level test. Although there were 4 options selection type, 5 options selection type, short answer type, essay type in school level test, rising from 33.1% to 65.5% on 5 options selection type is exhibited. This study showed that the school level item form was better various than the nation level. This point like this is the evidence for the improvement toward the science process skills test and influenced by Scholastic Ability Test for College Entrance. The ratio on the item which joined with the 3 axes had a mean of 99.3% in nation level test and mean 44.9% in school achievement test level. But the ratio in the school achievement test level increased after the Scholastic Ability Test for College Entrance was given. In view of this study we must furthermore study the item types which can evaluate valjdately science process skill's five stage each and evaluation method by the high school students' problem solving patterns and features in scientific inquiry on all science process skills elements.

• 대한간호학회지
• /
• 제14권2호
• /
• pp.5-11
• /
• 1984

The main purpose of this study were; to determine the reliability and validity of evaluation tool administered to the nursing student in nursing management practice,；to identify the effective evaluation method of nursing student in nursing management practice. The subjects were 46 senior nursing students at Department of Nursing, College of Medicine, Seoul National University in 1983. The evaluation tool was analyzed according to evaluation method; self-evaluation. and head nurse evaluation. Also individual item of evaluation tool was analyzed by item analysis in order to determine the evaluation area, and appropriateness of the test item used. A Summary of the results is as follows; 1. The reliability and validity of evaluation tool were relatively high both in self-evaluation and head nurse evaluation. 2. In comparison of mean scores, there is no significant difference between head nurse evaluation and self-evaluation. 3. The nursing management activities which have the correlation of self-evaluation and head nurse evaluation were in the activity of interpersonal relation, independent activity and implementing nursing process. In general nursing practice and unit management activity, there was no correlation of self-evaluation and head nurse evaluation.

• 대한본초학회지
• /
• 제37권2호
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• 한국조리학회지
• /
• 제6권2호
• /
• pp.5-21
• /
• 2000

The purpose of this study looks for the directions to improve the performance evaluation of cook by examining the perceptions for performance of cook by supervisors in hotel restaurant. In order for this purpose, this study focuss on two areas: (1) the significant differences of each hotel type on the perceptions of each performance evaluation item, (2) the significant differences of each kitchen type on the perceptions of each performance evaluation item in terms of two different types of hotel. To examine (1) and (2), this study uses Student t test and anova analysis. The findings from this study have both theoretical and practical implications. Implications of these findings are discussed.

• 한국신뢰성학회지:신뢰성응용연구
• /
• 제12권3호
• /
• pp.131-138
• /
• 2012

A design of reliability qualification test based on performance distribution is developed. In general, the performance of an item degrades as the time goes by and the failure of an item occurs when the performance degradation reaches the pre-determined critical level. This article considers the reliability qualification test based on a more tightened critical value at the earlier stage to reduce the evaluation testing time and cost. A numerical example is provided to illustrate how to use the developed reliability qualification test.

• 한국과학교육학회지
• /
• 제30권4호
• /
• pp.452-471
• /
• 2010

수능이 1994학년도에 처음 시행된 이후 17년 동안 시행되어 오면서 기출을 피하면서 사고력을 측정하는 참신한 문항을 출제하는 것이 점점 어려워지고 있다. 그러므로 수학능력 측정을 위한 양호한 문항의 개발을 위한 지속적인 연구가 필요하다. 이러한 맥락에서 수능 문항 개발에 필요한 시사점을 도출하기 위해 수능과 같은 국가 수준의 선다형 대입 관련 시험 분석의 일환으로 일본 센터시험을 분석하였다. 이 연구에서는 센터시험의 체제와 이과 출제 과목 및 응시과목의 수나 응시자 현황을 파악하고, 2009년 1월에 시행한 '이과' 시험의 검사지 구성, 문항 유형, 특이 사항 등을 분석하였다. 또한 센터시험 문항을 수능과 관련하여 내용 요소 및 행동영역에 따라 분석하였고, 아울러 우리나라 수험생의 관점에서 예상 정답률을 추정하였다. 분석 결과, 센터시험 문항은 고급 사고력보다는 지식 측정 또는 낮은 사고력을 주로 측정하고 있다. 또한 문항 당 배당되는 시간이 수능보다 길며 문항 수가 고정되지 않았고, 배점과 답지 수도 다양하다. 그리고 실생활 소재를 많이 사용하면서 문장 표현을 엄격하게 하지 않는 경향이 있다. 센터시험에서 원점수를 사용하는 것으로 보아 선택 과목 간 유 불리 문제가 크지 않은 것으로 보인다. 또한 문과나 이과의 계열 구분 없이 대부분의 학과에서 선택 과목으로 과학과목 성적을 요구하고 있다.