• 한국어교육
• /
• 제28권1호
• /
• pp.173-196
• /
• 2017

Writing is a subjective and performative activity. Writing ability has multi-facets and compoundness. To understand the examinees's writing ability accurately and provide effective writing scores, raters first ought to have the competency regarding assessment. Therefore, this study is significant as a fundamental research about rater's characteristics on the TOPIK writing assessment. 150 scripts of the 47th TOPIK examinees were selected randomly, and were further rated independently by 20 raters. The many-facet Rasch model was used to generate individualized feedback reports on each rater's relative severity and consistency with respect to particular categories of the rating scale. This study was analyzed using the FACETS ver 3.71.4 program. Overfit and misfit raters showed many difficulties for noticing the difference between assessment factors and interpreting the criteria. Writing raters appear to have much confusion when interpreting the assessment criteria, and especially, overfit and misfit teachers interpret the criteria arbitrarily. The main reason of overfit and misfit is the confusion about assessment factors and criteria in finding basis for scoring. Therefore, there needs to be more training and research is needed for raters based on this type of writing assessment characteristics. This study is recognized significantly in that it collectively examined writing assessment characteristics of writing raters, and visually confirmed the assessment error aspects of writing assessment.

• 한국어교육
• /
• 제28권1호
• /
• pp.23-47
• /
• 2017

This research analyzed procedural problems presented in academic writing faced by international students. The result of this research will serve as a basis for suggesting methods of developing a curriculum in Korean writing as a liberal arts education designed for international students. To analyze problems presented in academic writing by international students, the standard of assessment was divided into interaction, knowledge construction, and material quotation. Then, knowledge construction was divided into contents, structure, and expression, and the items were subdivided in each category. These categories of assessment correspond to the genre of academic writing and are different from the existing standard of assessment for academic writing. Applying these standards, this research analyzed 43 texts of academic writing in process for a final paper by international students in an class and presented problems in them. Furthermore, this paper aims to give detailed feedback that can help solve those problems.

• 영어어문교육
• /
• 제8권1호
• /
• pp.165-198
• /
• 2002

The purpose of this research is to improve the writing ability of students by an ideal test model of English writing based on strategies of procedural learning stages enhancing the level of students' writing ability. Assessment of writing in the field of English education has been limited so far to very restricted areas with no appropriate scientific scrutiny. Assessment is really meaningful only when it exactly estimates the ability of students. Since English writing competence has become indispensable in this era of global village, writing instruction should be most emphasized. The most forceful method of busting writing instruction is to utilize the so-called washback effect of testing. So, to develop a good test model of writing, the first thing that is required is to inspect writing strategy in steps and, then, testing itself. First of all, analyzed with a special reference to the 6th high school English curriculum were the goals and contents of the syllabus reflected in one kind of junior high textbook and eight different kinds of senior high textbooks. Then questionnaires on the whole area of writing and tendencies of English writing classes were given to 100 English teachers, 300 students. The results of questionnaires were statistically analyzed. Then, some suggestions and opinions about the questioning method were made: the procedural strategy in steps, English writing instruction and test model of assessment were applied to the syllabus referring to teaching plans. On the bases of the results of the questionnaires, three pretests and a final test of English writing were administered to verify the effect of enhanced English writing competence which had been gradually promoted and, through the promotion, produced the test criteria of English writing. In conclusion, guidance and evaluation of English writing through in steps are really indispensable to increase student's practical ability and, accordingly, we are in need of the development of a testing method of useful writing practiced in school class above anything else. So, it is necessary to further the study on methods to assess writing ability on the bases of participation and fluency of students with their keen interest in English. Also, to intensify the effect of the test model, more accommodating reorganization of syllabus is required in our education. For instance, we need a flexible operation in organizing time units from the current 50 minutes to 100-130 minutes.

• 동의신경정신과학회지
• /
• 제25권2호
• /
• pp.133-142
• /
• 2014

Objectives: The aim of this study was to investigate the effects of handwriting on the writing assessment, according to whether the handwriting is excellent or bad. Methods: A total of 24 elementary and middle school teachers participated in this study and assessed 6 original writings and 6 transcriptions of the same original writings using the HWP 2007 program. Six writings were collected from elementary students of 4th to 6th grades, 3 of 6 students presented with excellent handwriting and 3 of 6 with bad handwriting. The assessments were done according to the standards of propositional knowledge assessment (You & Jeong, 2008). Results: In the excellent handwritings, the rules of orthography and the contents of introduction of the original writings were scored higher than those in the transcriptions. The difference between transcription and original writing showed minus scores in original writing assessments and plus scores in transcription assessments. In the propositional knowledge score and its subscales scores - content knowledge, text knowledge, language knowledge and text context knowledge -, were differences in transcription assessments significantly higher than those in original writing assessments. Several assessment indices - clarity of the ending, contents of introduction, appropriate contents, rules of orthography, structured composition and various vocabularies showed significantly higher differences in transcription assessments than those in original writing assessments. Conclusions: The excellent handwriting could be assessed high and the bad handwriting could be assessed low. These results suggest that we should consider the effects of handwriting factors on the results of writing assessment and that the transcription could be used for an accurate writing assessment.

• 인지과학
• /
• 제30권4호
• /
• pp.175-197
• /
• 2019

고차적 사고를 요구하는 글쓰기는 배운 지식을 활용하고 발전시키게 한다. 학습 장면에서 글쓰기를 더 많이 활용하기 위해서는 동료평가를 도입하는 동시에 동료평가의 정확도를 높일 필요가 있다. 본 연구에서는 동료평가의 정확도를 높이는 방안으로, 평가 기준에 대해 학생들끼리 토론하게 하거나 전문가의 평가를 참고하도록 하는 두 방안을 탐색하였다. 대학생 150명을 대상으로 한 실험 결과, 동료평가 후 전문가의 평가를 참고했던 집단이 평가했던 글을 다시 평가할 때는 평가 정확도가 향상되었지만, 새로운 글을 평가할 때는 향상되지 않았다. 반면에, 동료평가 후 평가 기준에 대하여 토론을 진행했던 집단은 평가했던 글을 다시 평가할 때는 평가 정확도가 향상되지 않았지만, 새로운 글을 평가할 때는 향상됨을 발견하였다. 또한 토론 집단의 경우 평가 기준에 대한 토론에서 총 발언 수가 많아질수록 평가 정확도가 높아졌다. 이상의 결과는 평가 기준에 대한 토론에서 적극적이고 자발적인 논의가 활발할수록 이후 동료평가의 정확도가 향상됨을 시사한다.

• 인지과학
• /
• 제29권2호
• /
• pp.85-104
• /
• 2018

동료평가란 학생들이 다른 학생의 글, 발표, 집단 활동과 같은 평가 대상이 될 수 있는 모든 결과물이나 수행 과정에 대해 점수를 매기거나 의견을 제공하는 활동을 가리킨다. 동료평가는 채점부담으로 인해 잘 활용되지 않는 글쓰기 기회를 늘릴 수 있을 뿐만 아니라, 평가를 하는 과정을 통해 학습도 향상시킬 수 있다는 장점이 있다. 본 개관 논문에서는, 주요 동료평가 시스템과 동료평가를 사용한 경험적 연구 결과를 소개한 다음, 동료평가 확산의 장애 요인을 살펴보고, 앞으로의 연구에서 해결되어야 할 과제가 논의되었다. 이 논의를 통해 동료평가에 대한 후속 연구가 활성화되고 동료평가가 실제 교육 장면에서 활용되어, 우리나라의 평가와 수업 방법에 큰 변화를 가져오기를 기대해본다.

• 영어어문교육
• /
• 제13권2호
• /
• pp.91-108
• /
• 2007

This study investigates learners' perception on their engagement in rating activities in the EFL essay-writing context. The current study aims to address the answers to the following research questions: 1) What attitude do students show about their participation in the rating tasks? and 2) which of three aspects (e.g. the degree of rating experience, the exposure to English composition instruction and learning, and proficiency level) significantly influences learners' rating activities? 104 EFL learners participated in the rater training session. After participants finished rater training session, they rated three sample essays and peer essays using the given scoring guide. Based on the analysis of survey responses that students made, students showed positive attitude toward their engagement in rating tasks. For research question 2, only L2 writing proficiency seriously affected students' perception on the rating tasks. Advanced level of subjects did not feel stressed by a grade of peers as low level of subjects did. They were also critical about the benefits of self- and peer-assessment, suggesting that a peer's feedback on their own essay was not so useful and that a self-rating does not fully help learners identify their writing proficiency.

• 아동학회지
• /
• 제21권3호
• /
• pp.107-117
• /
• 2000

This study examined a portfolio scale for the assessment of the writing of 295 kindergarten children. The data were analyzed by Spradley's Developmental Research Sequence(DRS), using qualitative methods. Results showed that the writing portfolio scale for 4-year-olds includes "a word or write a children's name" "picture or word with shape of letters" and "scribbling or zig-zag". The writing portfolio scale for 5- and 6-year-olds includes "invented spelling" "write according to sound" and "omitted letters" "write a good hand". The writing portfolio scale for 4-, 5-, and 6-year-olds reflects their writing experience in daily life.

• 한국초등과학교육학회지:초등과학교육
• /
• 제26권4호
• /
• pp.385-394
• /
• 2007

In order to investigate elementary school students' readiness to write on scientific subject, we analyzed the participants' draft in elementary student section [National Student Science Writing Contest] which is sponsored by a daily press. As a first step, we designed an assessment framework to analyze the students' writing. It is composed of three domains: scientific thinking, logical validity, creativeness. Each domain has three sub-domains. By using the framework, seven raters scored the students' inquiry reports. The findings reveal that the students needed the training for scientific writing. Especially they had great difficulty in the sub-domain of 'suggestion of rational alternative solution' in scientific thinking domain, the sub-domains of 'clearness' and 'coherence' in logical validity domain, and in the sub-domains of 'creative problem solving' and 'creative presentation' in creative domain.

• 공학교육연구
• /
• 제14권6호
• /
• pp.51-59
• /
• 2011

The authors have developed a reading & writing textbook for engineering students to improve their communication capability, and also analyzed the outcomes that the students accomplished through the Engineering Reading and Writing class. The reading & writing textbook has been organized to be used as a guidebook with which the engineering students can practically solve the problems that they would face continuously after they finish their regular curriculum and when they are employed. The questionnaire survey analysis has been performed in order to evaluate the textbook contents, lecturing, and learning outcomes for the lecturers and students finished the engineering reading and writing classes. Desirable evaluation has been resulted in the broad areas: subject extraction from the readings, logical understanding, summarizing, practical writing, writing principle, etc.