• The Journal of the Convergence on Culture Technology
• /
• v.8 no.6
• /
• pp.471-478
• /
• 2022

In a good class, the elements that make up the class are organically related as a system. Unilateral assessment without sufficient explanation or agreement on assessment criteria, subjective assessment that does not guarantee the reliability of the assessment process and decolonized evaluation separate from the learning process can be a threat to a good class or healthy learning ecosystem. This study analyzed the evaluation through rubric and its effects to solve problems related to educational evaluation. 'Rubrick' is a descriptive evaluation tool that details the criteria for evaluating performance tasks based on class goals and the quality of performance in several stages. The rubric applied for movie literacy evaluation is 'analytical rubric'. It covers literacy to understand movies, movie making literacy and movie utilization literacy. For rubric, learners recognized it as a valid and very useful learning reflection tool.

• English Language & Literature Teaching
• /
• v.17 no.4
• /
• pp.339-356
• /
• 2011

This study explored pre-service English teachers' participation in the development of a rubric and examined evaluation of their own English poetry. The current study would investigate: 1) the pre-service English teachers' perception as a rubric developer and self-evaluator, 2) the number of analytic area that the participants included in their rubrics and the scoring scheme that they designed in their rubrics, and 3) the inter-rater differences between self-assessemnt and expert-assessment across analytic areas. Twenty-four EFL learners participated in the current study. The researchers analyzed the learners' own English poetry, their field notes which contained the process of their writing, their rubrics, scores of self-assessment, and expert raters' scores. The results revealed that learners showed positive responses on learner-directed assessment, that 'content' is the most important area, and that inter-rater difference is small across all analytic areas.

• Human Ecology Research
• /
• v.61 no.2
• /
• pp.195-218
• /
• 2023

The purpose of this study was to present a class case that verified the validity, reliability, and usefulness of a portfolio assessment in a cohousing class in the housing area of home economics. To achieve this objective, 241 male and female students in eight classes of the third grade of a junior high school in Gyeonggi-do, Korea, were enrolled in a project class on establishing a cohousing village in which the portfolio assessment method was applied for a total of 10 sessions for approximately four weeks from May 24 to June 16, 2021. To ensure the validity of the portfolio assessment, we designed the lesson after presenting the curriculum goals in detail using the backward design model and developed a specific rubric and conducted all evaluations and feedback based on the rubric to ensure objectivity and reliability. The online tool Padlet was used as a portfolio, which allowed students to easily upload their work, receive feedback from the teacher, and interact with their peers. After the class, the students reflected on the rubric and were generally satisfied with the class using portfolio assessment. This study is expected to facilitate the use of the portfolio assessment method in the classroom, while also supporting student growth and development.

• English Language & Literature Teaching
• /
• v.12 no.3
• /
• pp.147-166
• /
• 2006

This study investigates the effect of misplacement in a written Computer-delivered ESL Placement Test (CEPT) context. The study aims to address the following two research questions: a) which scoring rubric features cause the misplacement of ESL learner's writing scores? and b) which scoring rubric features improve ESL learner's writing scores? Thirty-four international examinees took the test and participated in surveys at the University of Illinois. Twelve examinees of them attended the CEPT workshop test. In the workshop test, they carried out self-evaluation on their first essays using a scoring rubric and compared with expert raters' results. After the workshop, the examinees responded to a survey and interview. For the first research question, the results of the survey and interview addressed that the majority disagreed with the raters' rating results. The self-evaluation results also indicated that their misunderstanding of organization feature caused the misplacement. For the second question, the CEPT workshop scores were improved due to the score improvement in the organization feature while the contribution of other features to the total scores was little. Most of the examinees pointed out that a lesson on the scoring rubric enhanced their understanding of the writing features of the rubric so that their placement scores were generally improved.

• Journal of Educational Research in Mathematics
• /
• v.11 no.1
• /
• pp.207-221
• /
• 2001

The purpose of this study is to develop the assessment rubric of mathematical communication ability by each type: listening, speaking, reading, writing, and graphic. This rubric is qualified in the content-validity and reliability by professional educators' evaluation and correlation coefficient. 16 math educators judged that this involves the results of learning mathematical communication, the results of possible instruction, and the content of scoring mathematical communication by teachers. 170 middle school students were tested by the assessment task according to the types of mathematical communication. After two researchers and two teachers scored the tasks, correlation coefficient was calculated between evaluators. The coefficient is evaluated high in that it is more than 0.70.

• Journal of Engineering Education Research
• /
• v.13 no.6
• /
• pp.132-142
• /
• 2010

The purpose of this study is to suggest the assessment method for PO6(teamwork) and PO7(communication skill), one of the most important assessment items in engineering accreditation. In this paper, we used the assessment criteria of Rubric, to empirically measure the teamwork and communication skill. Teamwork and communication skill (PO6, PO7) are the most critical social competences in modern society. Numerous studies on education showed that teamwork and communication skill can be enhanced through learning. We, therefore, need to investigate teamwork and communication skill in terms of education. However, research on the assessment method of the engineering accreditation, based on educational view is scarce. In this study, we suggest the assessment criteria of Rubric for PO6 and PO7 with the perspective of the education. We also tried to apply the developed criteria to the related subjects.

• School Mathematics
• /
• v.3 no.2
• /
• pp.325-354
• /
• 2001

The study aims to develop balanced performance assessment tasks for primary school mathematics which can be implemented in the primary school easily. In order to these purposes, I suggest the types of performance assessment tasks and the framework of assessment standards for the balanced performance assessment with describing the procedures of developing tasks and rubrics. The types of task are journal writing, problem posing, constructed task, and descriptive task. In the framework of assessment standards, I suggest holistic scoring which are classified as four levels according to the degree of excellence which students perform totally concerning about the criterion of implication, reasoning, accuracy, and communication. Also I analyse the responses of children to the task “make a beautiful pattern” and suggest its assessment rubric and anchor papers for each level for illustrating the process of developing a rubric in holistic scoring. In order to reflect the viewpoints of children and their Parents concerning about the tasks, the responses in self assessment and parent assessment are analysed. Finally, methods of implementing the assessment tasks and considerations are discussed.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.13 no.4
• /
• pp.201-211
• /
• 2017

This study provided a rubric prior to the performance of a task in a coding class and aimed to verify its effect. As for the research contents, this study redesigned the rubric developed in the preceding studies for the purpose of this study, presented that to the students and conducted a verification of its effects on the computer efficacy and academic achievement of the students who participated in the experiment, conducting a class. For this purpose, with 41 students in an experimental group, to which the rubric was presented to conduct the class and 39 students in a control group to which the rubric was not presented to conduct the class, this study conducted a six-week class and conducted a survey on their self-efficacy in the computer and a test to measure their academic achievement before and after the experiment. As a result, there were more positive effects on both computer efficacy and academic achievement in the group to which a rubric was presented and in which a rubric evaluation was conducted than in the control group. Through the result of this study, it was noted that the evaluation method presenting more specific and more detailed standards for performance and the level of the standards would have positive impacts on the learners' learning.

• Journal of the Korean earth science society
• /
• v.41 no.6
• /
• pp.684-694
• /
• 2020

In this study, we developed a rubric for assessing middle school students' conceptual understanding about dew point. For this purpose, we analyzed 9th grade students' responses collected by using a multi-tiers constructed-response item of National Assessment of Educational Achievement (NAEA) and classified the types of the responses according to their characteristics. In addition, we analyzed the distribution of student response types according to mean achievement scores and developed an assessment rubric of conceptual understanding about dew point. The findings are as follows: First, the analysis of student responses to finding dew point in the saturation curve showed that many students had no or lack understanding of the scientific concept of dew point. Second, as a result of analyzing the student response to the water vapor condensation process at dew point, the proportion of scientific conception types was very low, while the proportion of misconception types was relatively high and the types varied as well. Third, a four- level assessment rubric was developed based on the analysis of the distribution of student response types according to the mean achievement scores. Based on the findings, we suggested the development and utilization of assessment rubric in the field of Earth science education.

• Journal of Korean Home Economics Education Association
• /
• v.20 no.3
• /
• pp.85-105
• /
• 2008

The purpose of this study was to develop a narrative analytic scoring rubric through teacher-students negotiations, as an assessment of tasks using methods of experiment and practice for home economic(HE) in the middle school. In this study. an analytic rubric had been developed in the following three stages: In the first stage, all the things for rubric development were defined and prepared, by selecting tasks used for rubric application through a questionnaire survey, providing detailed directions on methods and procedures and needed items, and selecting a class for rubric negotiation and setting the development schedule. In addition, the method suggested by Ainsworth and Christinson(1998) in Student Generated Rubrics was used. In the second stage, performance criteria for tasks in terms of knowledge, skills, and attitude were developed, setting scoring framework and scales depending on assessment areas. Referring to selected scoring framework and assessment criteria, observable and assessable behaviors were used to describe rubric based on A, B, and C scale. Then, a primary rubric was developed through teacher-students negotiations, using rubrics made by group. In the last stage, the developed primary rubric was reviewed by an expert of HE education to test the validity. Moreover, the analysis to test the suitability of the final rubric assessment tool employed 46 copies of questionnaire collected from incumbent home economics teachers selected by way of random sampling mainly focusing on those teachers who were in the Master's degree program or completed the program at one university. As a result, the average of suitability of aa the rubrics were over 4.0 in th 5-point scale.