• School Mathematics
• /
• v.15 no.2
• /
• pp.263-288
• /
• 2013

This study was conducted to provide practical ways to apply interview assessments in classrooms. Interview assessments have been asserted to serve as one of the alternatives to the traditional paper-and-pencil tests. In order to propose ways for teachers to actively use interview assessments for mathematics assessments, relevant instruments were developed by analyzing a number of related theories. These instruments were developed in two forms: interview assessments focused on identifying student characteristics and those focused on identifying thought processes. The interview assessments were applied in classroom settings and the results of this application were analyzed. The findings from this study are expected to suggest beneficial implications for teachers who are interested in practicing interview assessments in classrooms.

• School Mathematics
• /
• v.6 no.1
• /
• pp.21-35
• /
• 2004

This article was to develop a tool and apply it to the high school classrooms for the performance assessment in trigonometry Bloom(1956)'s cognitive domain and holistic rubric and analytic rubric(NCTM, 1999) were used to guide the development of 12 problems. To find validity and credibility of this developed tool, Cronbach n and Rasch's BIGSTEPS were used with the samples of high students, 208, using SPSS 10.0K. The results from the investigation, indicated that the tool was very worth assessing students' achievement and there was no difference between the areas where students lived, but were differences between genders as well as between a specialized high school and preparatory high schools.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.12 no.1
• /
• pp.318-326
• /
• 2011

The purpose of this study is to investigate whether standardized patient(SP) can be used as a reliable examiner in Objective Structured Clinical Examination(OSCE). 4 SPs and 4 faculties who have more than 2 years experience of OSCE scoring were selected. For 1 assignment 2 members of faculty and 2 SPs were designated as raters. SPs were educated for assessing 2 technical skills, male Foley catheter insertion and wound dressing, for 8 hours (4 hours / day, each topic). The definition, method, cautions and complications for each of procedural skills were covered in the education. Theoretical lectures, video learning, faculty demonstration and practical training on mannequins were employed. The 8 raters were standardized for an hour with simulated OSCE scoring using previous videos on the day before the OSCE. Each assessment was composed of 14 checklists and 1 global rate. The allotted time for each assignment was 5minutes and for evaluation time 2 minutes per student. The evaluation from the faculty and SPs were compared and analyzed with the GENOVA program. The overall generalizability coefficient (G coefficient) was 0.839 from two cases of OASTS. The reliability of the raters was high, 0.946. The inter-rater agreement between faculty group and SP group was 0.949 for checklist and 0.908 for global rating. Therefore SPs can play a role of raters in OSCE for procedural skills, if they are given the appropriate training.

• Journal of Korean Home Economics Education Association
• /
• v.20 no.3
• /
• pp.85-105
• /
• 2008

The purpose of this study was to develop a narrative analytic scoring rubric through teacher-students negotiations, as an assessment of tasks using methods of experiment and practice for home economic(HE) in the middle school. In this study. an analytic rubric had been developed in the following three stages: In the first stage, all the things for rubric development were defined and prepared, by selecting tasks used for rubric application through a questionnaire survey, providing detailed directions on methods and procedures and needed items, and selecting a class for rubric negotiation and setting the development schedule. In addition, the method suggested by Ainsworth and Christinson(1998) in Student Generated Rubrics was used. In the second stage, performance criteria for tasks in terms of knowledge, skills, and attitude were developed, setting scoring framework and scales depending on assessment areas. Referring to selected scoring framework and assessment criteria, observable and assessable behaviors were used to describe rubric based on A, B, and C scale. Then, a primary rubric was developed through teacher-students negotiations, using rubrics made by group. In the last stage, the developed primary rubric was reviewed by an expert of HE education to test the validity. Moreover, the analysis to test the suitability of the final rubric assessment tool employed 46 copies of questionnaire collected from incumbent home economics teachers selected by way of random sampling mainly focusing on those teachers who were in the Master's degree program or completed the program at one university. As a result, the average of suitability of aa the rubrics were over 4.0 in th 5-point scale.

• School Mathematics
• /
• v.5 no.1
• /
• pp.1-25
• /
• 2003

This study develops a performance assessment system to improve grade 4-9 students' creativity. First, this study discusses its educational meaning, its task types, scoring methods and practical application methods. Then, this study provides the typical examples of performance assessment task classified by each of the types and its scoring rubrics. Finally, this study analyzes students' achievement levels for each task. Each task includes item informations such as content area, evaluation goal, evaluation procedure, preparatory material, characteristics, considering points, scoring rubric etc. for grade 4-9 teachers to use them in their evaluation processes directly without difficulties.

• Korean Medical Education Review
• /
• v.12 no.2
• /
• pp.19-26
• /
• 2010

Purpose: Until now, students wrote only differential diagnoses and plans during the interstation work (IW) portion of clinical performance examinations (CPX). The contents of history taking (Hx) and the physical examination (PE) were only evaluated using checklists. This study addressed the correlations of Hx and PE scores from the checklists and the subsequent IW to research the necessity of adding Hx and PE sections in to the IW. Methods: One hundred and thrity-three students participated in a ten case CPX, and eight cases were used in this study. Immediately following the 12 minute patient encounter, students were given 6 minutes to write the IW. For the Hx and PE section, students were instructed to write the findings that they considered key information in approaching the patient's problem. The Hx and PE sections of the IW were scored using the same items that appeared on the SP checklist. Calculations of Spearman's rho were performed to find the relationship between the checklist scores and IW scores of Hx and PE sections. Results: Correlations of Hx and PE scores between the SP checklists and IW were low to moderate. Across the eight cases, the median Spearman's rho was 0.37 with a range of 0.14 to 0.54. Conclusion: We suggest that, because SP checklist scores measure only what information the students gather, but not their reasons for doing so (e.g.: relative importance), students tend gather very specific information from the patients. By analyzing of their IW, we were able to explore how students prioritize the important information they have obtained from the patients.

• Culinary science and hospitality research
• /
• v.13 no.1 s.32
• /
• pp.129-142
• /
• 2007

This study is to prevent the applicants who apply for the test from being confused by finding problems in the practical test of the bartender certificate and to detect the best way to find out the scoring factors and allotting marks. The goal of this study is to give the direction of proposing the alternative plans of the qualification test for the bartender by the expert group. The questionaries of the survey were sent and collected from June 20 though 30, 2005. After removing some questionaries that have a problem, the survey was conducted for 20 days from August 5, 2005. The samples of the expert group was set up as 50 persons, but 43 samples were available for the final analysis. Also, 7 selected experts proposed the improvements of the marking lists in the practical test for the bartender certificate throughout 2 in-depth studies from September 15 through 25, 2005. According to the analysis, marking lists of the practical test need to be improved. For the detail categories of the practical test, priority appears as follows : sanitation, service and cocktail mixing. For the proper score in the marking lists of the practical test, 25 points is more proper than existing 33 points for selecting ingredients and stools, 10 points is more suitable than existing 9 points for pouring main ingredients, 30 points is more appropriate than existing 42 points for cocktail mixing, 20 points is more proper than existing 10 points for sanitation and 15 points is more suitable than existing 6 points for service.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.87-101
• /
• 2016

This study analyzes the content validity of descriptive tests developed for elementary schools, in order to acquire basic data to improve them. Various descriptive tests were collected and tested for differences in proportions between two-dimensional classification of educational objectives and the level of behavioral objectives. Results show that the descriptive tests developed by elementary school teachers mainly focused on "knowledge" and "understanding," and that content validity for behavioral levels to be low. Nine elementary school teachers were interviewed to understand the result. From the interviews, we found both internal and external factors that cause low content validity. The main internal factors were teachers' ability to make two-dimensional classification of educational objectives, the teachers' consideration of students' level, item level of difficulty, the ease of scoring, and path dependence. The main external factors were curriculum, parents, and administration. Based on the results, we suggested the factors related to elementary school teachers' PCK of descriptive tests.

• Journal of Korean Home Economics Education Association
• /
• v.23 no.3
• /
• pp.69-90
• /
• 2011

To develop the descriptive evaluation questionnaire with high validity and reliability on the Clothing and Textiles section of the middle school Technology & Hone Economics textbook, apply it to students and analyze its results. We made out a draft for descriptive evaluation questionnaire that was based upon the concrete establishment of the goal and the range of evaluation. We also made a rubric for scoring as well as sample answer-sheets. Finally, we completed a total of twenty three descriptive evaluation questions and we applied it to sixty five 2nd-grade students in two classes in a middle school. Descriptive evaluation questionnaire exhibited the relative high validity on each question. Moreover, three graders gave the same score on each question of descriptive evaluation, suggesting that descriptive evaluation questionnaire has the high inter-grader reliability and the strong correlation. But, low academic achievement was generally observed in the subjects. They had difficulty in describing their knowledge via their own language and drawing up accurate and detailed answers. They recognized the positive aspects of descriptive evaluation questionnaire, but they felt it uncomfortable due to study-burden and description itself. To overcome these limitations, it is required that students should experience various materials related to subject contents in classes as well as textbooks, concentrate themselves on finding solutions for problems, expand their scope, and practice describe them in advance. Therefore, the additional training for description evaluation questionnaire will be necessary for the more efficient and discriminative questionnaire. Also the questionnaire with high validity and reliability should be developed and the aggressive and voluntary participation of teachers will be needed.

• Journal of Gifted/Talented Education
• /
• v.26 no.2
• /
• pp.235-255
• /
• 2016

This study examined whether there were differences in stakeholders' concerns regarding consulting in gifted education institutes. A total of 122 stakeholders in gifted and talented education responded to SoCQ(the Stage of Concerns Questionnaire, Hall & Hord, 2011). The SoCQ responses of these stakeholders to consulting for gifted education institutes were converted into relative intensities and SoCQ profiles, which were analyzed by the affiliated areas of institute, teaching years in gifted education, continuities of affairs in gifted education, and approaches to teacher training for gifted education with using t-test and one-way analysis of variance. Results indicated that stakeholders generally showed the highest concern for stage 1(information) and the lowest concerns for stage 4(consequence), which were the initial stage of change and innovation in consulting for gifted education institutes. In the meanwhile, skakeholders having training program for professionals showed the more concern for stage 6(refocusing), which was a kind of resistance for the present consulting for gifted education institutes. On the based on these results, this study suggested ways(or methods) for settlement and the diffusion of successful gifted education consulting.