Journal of Korean Society of Industrial and Systems Engineering (산업경영시스템학회지)

Society of Korea Industrial and System Engineering (한국산업경영시스템학회)
권호 표지
DOI QR코드

DOI QR Code

Equitable Peer Assessment Method in Collaboration Project Using Statistical Technique

통계적 기법을 이용한 집단 협업 프로젝트에서의 공정한 동료 평가 방법론에 대한 연구

  • Cho, Miyeon (Department of Business Engineering, Karlsruhe Institute of Technology(KIT)) ;
  • Ko, Sung-Seok (Department of Industrial Engineering, Konkuk University)
  • 조미연 (카를스루에 공과대학교 산업공학) ;
  • 고성석 (건국대학교 산업공학)
  • Received : 2012.11.15
  • Accepted : 2013.02.15
  • Published : 2013.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

For evaluating participation in collaboration project, the peer assement method is mostly used and various scoring methods have been proposed. But, the reliability and validity of the peer assessment method are still doubted for all most method. In order to overcome these weaknesss, some guidelines and training methods have been recommended. In this article, however, statistical technique is proposed for measuring individual contributions to collaboration projects considering each assessor's reliability. The gist of our proposed algorithm is that an assessor's reliability depends on the evaluation policy, and this reliability is evaluated by an analysis of variance of the scores assigned by the assessor. We also show that the proposed method is very efficient by case study in university class.

Keywords

Acknowledgement

Supported by : Konkuk University

References

  1. Freeman, M., Peer assessment by groups of group work. Assessment and Evaluation in Higher Education, 1995, Vol. 20, p. 289-299. https://doi.org/10.1080/0260293950200305
  2. Gehringer, E.F., Assessing Studentsʼ Wiki Contributions, 2008 American Society for Engineering Education Annual Conference and Exposition, 2008.
  3. Herbet, N., Peer assessment : Is it fair?, In Uniserve science assessment symposium proceeding. Sydney, 2006.
  4. Kennedy, J.G., Peer-assessment in Group Projects : Is It Worth It?, Australian Computer Society, Inc, 2005, Vol. 42.
  5. Ko, S.S. and Cho, M.Y., The Quality Control System on Online Collaboration System. Journal of the Society of Korea Industrial and Systems Engineering, 2010, Vol. 33, p 127-132.
  6. Marjo van Zundert, Effective peer assessment processes : Research findings and future directions. Learning and Instruction, 2009, Vol. 20, p 270-279.
  7. Michaelsen, L.K., Team learning : a comprehensive approach for harnessing the power of small groups in higher education. To Improve the Academy, 1994, Vol. 11, p 107-122.
  8. Panchal, J. and Fathianathan, M., Product Realization in The Age of Mass Collaboration, Proc. ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2008, p 3-6.
  9. Parsons, D., Justice in the Classroom : Peer Assessment of Contributions in Group Projects, Proc. 17th NACCQ, 2004, p 145-151.
  10. Raban, R. and Litchfield, A., Supporting peer assessment of individual contributions in groupwork, Proc. 23rd Annual Ascilite Conference, 2007, p 685-694.
  11. Topping, K.J., Peer Assessment, Theory Into Practice, 2009, p 20-27.

Cited by

  1. 융복합 소셜 앱 제작 플랫폼에서 참여자의 기여도 평가 방법에 관한 연구 vol.13, pp.9, 2015, https://doi.org/10.14400/jdc.2015.13.9.225