Journal of Engineering Education Research (공학교육연구)

Korean Society for Engineering Education (한국공학교육학회)
권호 표지

Development and Validation of a Behaviorally Anchored Rating Scale for Peer Evaluation in Group Projects

조별 과제 동료평가 행동기준평정척도 개발 및 타당화 연구

  • 신태섭 (이화여자대학교 교육학과)
  • Received : 2018.08.23
  • Accepted : 2018.09.30
  • Published : 2018.09.28
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to develop and validate a behaviorally anchored rating scale for peer evaluation in group projects based on social interdependence theory. A mixed method involving a qualitative and quantitative approach was used in this study. In the qualitative study, both the individual and group interviews were conducted to college students regarding their cooperative learning experiences. Data from this qualitative research was analyzed based on 5 elements of cooperative learning and 'critical incidents' were extracted from students' own voices that would serve as specific rating criteria in the scale. Once the 'critical incidents' have been incorporated into the scale, validation from 3 independent experts was conducted. In the quantitative study, correlations with relevant variables were analyzed to examine the criteria-referenced validity. Findings suggest that the behaviorally anchored rating scale for peer evaluation in group projects can be used in various team-based learning contexts.

Keywords

References

  1. 김상균(2011). 조별과제 동료평가의 역효과 해결을 위한 직무배정 수업기법. 한국산학기술학회논문지, 22, 2543-2547.
  2. 도승이, 김은주(2007). 협동학습에서 과제와 사회적 요소의 작용: 조원 간 친밀한 소집단을 중심으로. 교육심리연구, 21, 1047-1070.
  3. 문지윤, 신태섭(2015). 대학 수업 조별과제의 집단효능감 경험에 대한 질적 연구: Bandura의 사회인지이론을 중심으로. 교육심리연구, 29(1), 41-64.
  4. 이현우(2012). 과제기반 협력학습에서 소집단 구성원의 자기조절학습 수준이 집단자기조절, 소집단 성과 및 활동 만족도에 미치는 영향. 교육방법연구, 24, 171-183.
  5. 정광조, 신태섭(2016). 국내 장애 학생 대상 협동학습 연구의 효과 분석 - R을 이용한 메타분석(Meta-Analysis)을 중심으로 -. 특수교육, 15(4), 181-203.
  6. 최윤미(2010). 대학에서의 팀 학습 활동에 대한 학습자의 평가. 교육방법연구, 22, 143-163.
  7. Bandura, A. (1997). Self-efficacy: The exercise of control. NY: Macmillan.
  8. Brooks, C. M., & Ammons, J. L. (2003). Free riding in group projects and the effects of timing, frequency, and specificity of criteria in peer assessments. Journal of Education for Business, 78, 268-272. https://doi.org/10.1080/08832320309598613
  9. Campbell, J. P., Dunnette, M. D., Arvey, R. D., & Hellervik, L. V. (1973). The development and evaluation of behaviorally based rating scales. Journal of Applied Psychology, 57, 15-22. https://doi.org/10.1037/h0034185
  10. Capar, G., & Tarim, K. (2015). Efficacy of the Cooperative Learning Method on Mathematics Achievement and Attitude: A Meta-Analysis Research. Educational Sciences: Theory and Practice, 15 (2), 553-559.
  11. Colbeck, C. L., Campbell, S. E., & Bjorklund, S. A. (2000). Grouping in the dark: What college students learn from group projects. The Journal of Higher Education, 71, 60-83.
  12. Cole, M. W. (2013). Rompiendo el silencio: Meta-analysis of the effectiveness of peer-mediated learning at improving language outcomes for ELLs. Bilingual Research Journal, 36 (2), 146-166. https://doi.org/10.1080/15235882.2013.814609
  13. Creswell, J. W.(2009). Research design: Qualitative, quantitative, and mixed methods approaches. LA: Sage.
  14. Davidson, N., & Worsham, T. (1992). Enhancing thinking through cooperative learning. Teachers College Press, 1234 Amsterdam Avenue, New York, NY 10027.
  15. Deutsch, M. (1949). A theory of co-operation and competition. Human Relations, 2 (2), 129-152. https://doi.org/10.1177/001872674900200204
  16. Jassawalla, A., Sashittal, H., & Malshe, A. (2009). Students' perceptions of social loafing: It's antecedents and consequences in undergraduate business classroom teams. Academy of Management Learning and Education. 8, 42-54. https://doi.org/10.5465/amle.2009.37012178
  17. Johnson, D. W., & Johnson, R. T. (2009). An educational psychology success story: Social interdependence theory and cooperative learning. Educational Researcher, 38, 365-379. https://doi.org/10.3102/0013189X09339057
  18. Johnson, D. W., & Johnson, R. T. (1992). Positive interdependence: Key to cooperation. In R. Hertz-Lazarowitz & N. Miller (Eds.), Interaction in cooperative groups (pp.174-292). New York: Cambridge University Press.
  19. Johnson, D. W., Johnson, R., & Anderson, D. (1983). Social interdependence and classroom climate. The Journal of Psychology, 114 (1), 135-142. https://doi.org/10.1080/00223980.1983.9915406
  20. Johnson, D. W., Johnson, R. T., Roseth, C., & Shin, T. S. (2014). The relationship between motivation and achievement in interdependent situations. Journal of Applied Social Psychology, 434, 622-633.
  21. Maiden, B., & Perry, B. (2011). Dealing with free-riders in assessed group work: Results from a study at a UK university. Assessment & Evaluation in Higher Education, 36, 451-464. https://doi.org/10.1080/02602930903429302
  22. Millis, B. J., & Cottell Jr, P. G. (1998). Cooperative learning for higher engineering faculty. Phoenix, AZ: American Council on Education/Oryx Press.
  23. Neber, H., Finsterwald, M., & Urban, N. (2001). Cooperative learning with gifted and high-achieving students: A review and meta-analyses of 12 studies. High Ability Studies, 12 (2), 199-214. https://doi.org/10.1080/13598130120084339
  24. Ohland, M. W., Loughry, M. L., Woehr, D. J., Bullard, L. G., Finelli, C. J., Layton, R. A., Pomeranz, H. R., & Schmucker, D. G. (2012). The comprehensive assessment of team member effectiveness: Development of a behaviorally anchored rating scale for self- and peer evaluation. Academy of Management Learning & Education, 11, 609-630. https://doi.org/10.5465/amle.2010.0177
  25. Saavedra, R. & Kwun, S. K. (1993). Peer evaluation in selfmanaging work groups. Journal of Applied Psychology, 78, 450-462. https://doi.org/10.1037/0021-9010.78.3.450
  26. Sharan, Y. (2010). Cooperative learning for academic and social gains: Valued pedagogy, problematic practice. European Journal of Education, 45, 300-313. https://doi.org/10.1111/j.1465-3435.2010.01430.x
  27. Shimazoe, J., & Aldrich, H. (2010). Group work can be gratifying: Understanding & overcoming resistance to cooperative learning. College Teaching, 58, 52-57. https://doi.org/10.1080/87567550903418594
  28. Slavin, R. E. (1996). Research for the future research on cooperative learning and achievement: What we know, what we need to know. Contemporary Educational Psychology, 21, 43-69. https://doi.org/10.1006/ceps.1996.0004
  29. Smith, K. A. (1996). Cooperative learning: Making "groupwork" work. New directions for teaching and learning, 1996 (67), 71-82. https://doi.org/10.1002/tl.37219966709
  30. Warfa, A. R. M. (2015). Using cooperative learning to teach chemistry: A meta-analytic review. Journal of Chemical Education, 93 (2), 248-255. https://doi.org/10.1021/acs.jchemed.5b00608