• Title/Summary/Keyword: scorer training

Search Result 3, Processing Time 0.021 seconds

A Study on design of The Internet-based scoring system for constructed responses (서답형 문항의 인터넷 기반 채점시스템 설계 연구)

  • Cho, Ji-Min;Kim, Kyung-Hoon
    • The Journal of Korean Association of Computer Education
    • /
    • v.10 no.2
    • /
    • pp.89-100
    • /
    • 2007
  • Scoring the constructed responses in large-scale assessments needs great efforts and time to reduce the various types of error in Paper-based training and scoring. For the purpose of eliminating the complexities and problems in Paper and pencil based training and scoring, many of countries including U.S.A and England already have applied online scoring system. There, however, has been few studies to develop the scoring system for the constructed responses items in Korea. The purpose of this study is to develop the basic design of the Internet-based scoring system for the constructed responses. This study suggested the algorithms for assigning scorers to constructed responses, employing methods for monitoring reliability, etc. This system can ensure reliable, quick scoring such as monitor scorer consistency through ongoing reliability checks and assess the quality of scorer decision making through frequent various checking procedures.

  • PDF

Development and Implementation of Performance Assessment for Middle School Mathematics (중학교 수학과 수행평가의 개발과 적용 효과에 관한 분석)

  • 권오남;황숙균;권기순
    • Journal of Educational Research in Mathematics
    • /
    • v.9 no.1
    • /
    • pp.333-350
    • /
    • 1999
  • The purpose of this study is to define performance assessment of mathematics, to make a model of performance task of mathematics for the first grade middle school students in higher group, to examine validity and reliability of performance task and to investigate the effects on the students' achievement and attitude. It first defines performance assessment and exanmines its main features and scoring methods. Based on these, nine performance assessment tasks and scoring criteria were designed for the first grade middle school students in higher group. The validity of performance tasks were examined by experts. The loaming achievement and mathematical attitude test between two groups were performed as pre and post test. The thinking of students about performance assessment was investigated by attitude survey. The results of this study are as follows: First, the validity of the performance tasks is very high. Second, The control group. Forth, there is a difference in student's attitude about mathematics between scorer reliability was high due to the scorer training. Third, there is little difference in teaming achievement between experimental and experimental and control group in 5% meaningful levels. That is, student's of both groups attitude about mathematics comes negatives, but the width of change of negative attitude in experimental group is less than control group. In the trend of negative attitude of mathematics as grade comes higher, this results showed that performance assessment of mathematics had positive influence on attitude of mathematics. The result of survey about mathematical performance assessment experience showed that students have positive attitude to performance assessment and recognized effectiveness of the performance assessment of mathematics.

  • PDF

A Study on the Classification of Student's Bluffing on Geographical Terms (지리 용어에 대한 학습자의 블러핑(Bluffing) 유형에 관한 연구)

  • Jang, Eui-Sun
    • Journal of the Korean Geographical Society
    • /
    • v.49 no.4
    • /
    • pp.615-632
    • /
    • 2014
  • This study aims to explore 'bluffing', one of the most important topics in order to ensure the objectivity, validity, reliability of scoring of constructed-response items. The author identifies the conception of bluffing, and classifies major types of bluffing on the basis of previous studies on the theoretical level. Next, the author analyzes empirically the bluffing strategies and types of learners on key terms of Korean Geography subject. Compared with the existing research reports, the result of this study shows a significantly lower average bluffing score. On the other hand, it is consistent in results of previous studies reported that average bluffing score is similar between genders and that those students who got highest grades did least bluffing. Actually bluffing types are classified into four categories: 'repeating the question' type, 'depending on a well-known or existing knowledge' type, 'applying some basic concepts regardless of understanding' type, and 'inducing scorer's basic beliefs' type. Some comments and suggestions are as follows. First, it is necessary to continue researches of the relations among bluffing and age, gender, grade, intelligence and learning styles. Second, it is required for scorers who score constructed-response items to develop and supply the scoring guide including analysis contents of bluffing types and cases, and increase opportunity for training. Third, we need to inquire the domain-specific bluffing types in geography subject based on the generalizable sample size.

  • PDF