• Journal of the Korean earth science society
• /
• v.22 no.6
• /
• pp.469-479
• /
• 2001

This study investigated the trends in the number of applicants and mean score and applicants’ responses on the test items of Earth Science in the College Scholastic Ability Test (CSAT) implemented for 3 years (1999-2001). The percentage of applicants of science track were 43.14% in 1995, but reduced through 29.5% in 2001 to 26.92% in 2002 CSAT For elective subject, about 22% of science track students applied to Earth Science II which ranked third to Biology II and Chemistry II. In 1999, test items were developed to have the expected difficulty 40 ${\sim}$ 59% (6 items) to 60 ${\sim}$ 79% (10 items). But in 2001 every 16 items were developed to have difficulty 60 ${\sim}$ 79%, which was caused by the policy of so called ‘easy CSAT’. Thus the mean score of ‘Earth Science II’ was increased from 50.26 in 1999 through 64.47 in 2000, to 67.58 in 2001. Applicants were generally very good at solving test items focusing on process skills only and familar items but poor at solving test items related to the motion of the earth and planets and sea wave, especially items calling two or more concepts. Thus special measures to cope with the decrease in applicants of science track should be provided. And it is recommended to develop test items with wider range of difficulty and to reduce test items calling process skills only. And special consideration should be given to teaching the content area with poor achievement and high actual difficulty compared to the expected.

• Child Health Nursing Research
• /
• v.8 no.3
• /
• pp.291-301
• /
• 2002

This study was performed to develop a scale of maternal conflict based on already established scales and the literature review. The major purpose of this study was to develop a scale of which contains difficulties which mother can feel to rearing her child and can be applied to mothers at home or employed mothers. 68 items were developed. For content validity test, the items were examined by 7 experts panel with Likert 4 scale. The 39 items were selected as high validity from 86% of the experts. The item number of each area and the misunderstanding words were corrected by advices of experts. 10 mothers again examined 39 items in order to correct the misunderstanding words and the long sentences. For reliability and factor analysis of 39 items, 496 mothers participated. 34 items were chosen because 5 items that corrected item-total correlation coefficient were lower than 0.2 were excluded by the result of reliability analysis. Factor analysis was done with 34items. 6 factors were classified higher than eigen value 1.0, 28 items were chosen because 6 items that factor loadings were lower than 0.4 were excluded. These factors were named as employment and caring for child(6 items), child education(5 items), support system for caring for child(4 items), interaction with mother and child(4 items), view of maternal role(5 items) and me as human being(4 items). Reliability analysis was done with 28 items. 1 item(36 number of factor 1) was excluded because corrected item-total correlation coefficient were lower than 0.2. Therefore, 27 items were chosen. Maternal Conflict Scale was contained 27 items. The corrected item-total correlation coefficient of 27 items were ranged from .2345 to .5240 and Cronbach alpha coefficient of those was .8207 by the results of reliability analysis. It can be evaluated that this scale had a high validity and reliability because of passing through an objective process of test.

• Korean Medical Education Review
• /
• v.15 no.3
• /
• pp.125-135
• /
• 2013

Since the establishment of the national medical licensing examination board in 1992, the medical licensing examination system has changed enormously and this has had a number of impacts on examination services. All those reforms were aimed at improving the relevance and reliability of the test. Several attempts of the testing system have appeared in the new examination service, and which have also brought about the changes in the medical school curriculum such as introducing integrated courses instead of traditional subjects, using test scores as a reference to the post-graduation selection test. Some examples of changes in the examination system are as follows: 1) choosing three integrated test subjects and outlines of their reference content instead of 15 academic subjects, 2) adjusting the ratio of multiple choice question items to focus more on the problem solving level, 3) introduction of 'one-best answer' single set and 'extended matching type items, 4) item construction based on real clinical cases and real clinical materials. Recently, a clinical skill test system has been introduced to measure examinees' basic clinical skills competencies. Despite continuing efforts, the examination system still has many issues remaining to be solved. These problems include the differential weighting of test items, appropriate threshold for passing, and practicality of pre-testing to stabilize the passing rate and avoid the hazards of newness and undesirably difficult test items.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.5
• /
• pp.295-302
• /
• 2011

The purpose of this study was to develop Korean Consonant Perception Test (KCPT), that is a phonemic level including elementary data to evaluate speech and consonant perception ability of the normal and the hearing impaired qualitatively and quantitatively. KCPT was completed with meaningful monosyllabic words out of possible all Korean monosyllabic words, considering articulation characteristics, the degree of difficulty, and the frequency of the phonemic appearance, after assembling a tentative initial and final consonants testing items using four multiple-choice method which were applied to the seven final consonant regulation and controlled with the familiarity of the target words. Conclusively, the final three hundred items were developed including two- and one-hundred items for initial and final testing items, respectively, with the evaluation of the 20 normal hearing adults. Through this process, the final KCPT was composed upon the colloquial frequency following identification of no speakers' variances statistically and elimination of the highly difficult items. The 30 hearing impaired were tested with KCPT and found that the half lists, A and B, were not different statistically and the initial and final testing items were appropriate for evaluating initial and final consonants, respectively.

• Journal of Pharmaceutical Investigation
• /
• v.3 no.4
• /
• pp.16-27
• /
• 1973

An investigation was carried out on a basis of the examination with a view to detecting the degree of microbial contamination for the 82 samples collected from the locally-sold liquid preparations. The results obtained are summarized as follows ; 1. Total viable Bacteria(TVB) per ml. in test sample shows min. 0 and Max. $8.0{\times}10^5$. Among the test samples, 2 items of Herb medicines have shown the highest bacterial contamination degree. 2. The number of unsuitable products are 9(11.0%) of the 82 items tested. Comparing with the study of 1971 (18 or 23.4% of 77 items), this fact suggests that the more than 50% decreasing tendency has come from the technical preventive efforts on bacterial contamination. 3. E. coli, Staph. aureus, and Pseudomonas aeruginosa could not be detected with the test sample. 4. The number of confirmable mycotic contamination in the test samples has been revealed as 17 items (20.7%). 5. Chiefly, the causative organisms of the contamination are proved to be bacilli and fungi broadly distributed in nature. 6. Generally, the neutrality of the pH had greatly increased the number of products unsuitable on the specification of TVB. pH >7.0 No. of unsuitable items 0/4 (0.0%) pH 6.0-7.0 No. of unsuitable items 4/9 (44.4%) pH 4.0-6.0 No. of unsuitable items 5/45(11.1%) pH <4.0 No. of unsuitable items 0/24(0.0%) 7. The viability of general bacteria has shown a rather decreasing tendency in time.

• The Korea Journal of Herbology
• /
• v.37 no.2
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

• Journal of Korean Academy of Nursing
• /
• v.39 no.2
• /
• pp.259-269
• /
• 2009

Purpose: The aim of this study was to develop a breast feeding adaptation scale (BFAS) to evaluate adaptation to breastfeeding for breastfeeding mothers and their infants and to test the validity and reliability of the instrument. Methods: The study was conducted as follows: application of the conceptual framework, identification of the content domains, items generation, and test of validity and reliability. In order to test validity and reliability, two panels of experts reviewed items and subcategories of the preliminary questionnaire and then data were collected from 329 mothers who were up to 4 weeks postpartum and breastfeeding. Descriptive statistics, t-test, factor analysis, and Cronbach's alpha were used to analyze the data. Results: The conceptual framework was based on the Roy adaptation model. The content domains were developed via literature review, review of instruments, and data acquired from the interviews of breastfeeding mothers and nurses. A total of 69 items belonging to 8 domains were generated. A reduction to 44 preliminary items was accomplished through content validity analysis. Factor analysis extracted 8 factors with a total of 27 items on a 5-point Likert scale. Content validity, construct validity, criterion validity, and reliability of the BFAS were established. Conclusion: The newly developed BFAS is a reliable and valid instrument with which the adaptation of breastfeeding mothers and their infants to the breastfeeding behavior can be evaluated.

• Journal of the Korean Society for Aviation and Aeronautics
• /
• v.26 no.2
• /
• pp.31-38
• /
• 2018

The pilot aptitude test so far has been conducted with a dichotomous concept of cognitive factor and non-cognitive factor, so it was not easy to explain concrete factors about pilot aptitude. Therefore, an integrated approach is needed to construct pilot aptitude test including all factors that can predict pilot aptitude. In previous study, we developed questionnaire items for the Pilot Aptitude Personality Test(PAPT) which can predict the flight training achievement through personality and personal characteristics. And those items were categorized as personality, cognition, and motivation factors. The flight training grades were correlated with all the test factors of the items, and the cognitive factors were high. As a result of the regression analysis, the total score of the three factors together accounted for 16% of the flight training grades. The results of the ANOVA showed that the cognition factors and motivation factors had significant effects on the completion of the flight training. The factors of PAPT predicted not only the completion of the flight training but also the flight performance. This is because the existing paper-pencil pilot aptitude test can only discriminate the flight training completion status. This is also a result of the fact that the introductory flight training consists of various factors including not only basic cognition but also personality and motivation.

• Archives of Plastic Surgery
• /
• v.33 no.2
• /
• pp.225-232
• /
• 2006

The aim of this study is to evaluate the clinical competence of medical student using short case test items. Development of short case test items with definition of an assessment of subject, choice of clinical stations sampling, identification of components of clinical competence to be evaluated, and assessment of practicability and results exploitation. For the last three years 28, 48 and 30 topics were developed annually. Among them 20, 23 and 23 topics were selected. About 50 students were examined annually. The mean score was 72.7, 57.1, 64.3 respectively. The mean preparation time of the students for the examination was 9.8 hours. About 60% of the students prepared the test in small group activity. Our experience suggests that short case test items be feasible for evaluation of student learning in Plastic Surgery. This method should be considered as a useful tool to assess medical student's competence or even an examination for board certification.