Journal of Digital Convergence (디지털융복합연구)

The Society of Digital Policy and Management (한국디지털정책학회)
권호 표지
DOI QR코드

DOI QR Code

The Relationship between Formative and Summative Assessments Using the Mosoteach App in College EFL Classes in China

Mosoteach 앱을 이용한 중국 대학 EFL 수업 형성평가와 총괄평가와의 관계

  • Received : 2021.07.26
  • Accepted : 2021.08.20
  • Published : 2021.08.28
Download PDF
⟨ Previous Next ⟩

Abstract

This study was intended to help improve assessment in college EFL classes by examining the relationship between formative assessment (FA) and summative assessment (SA). Participants for the study were 75 undergraduates, taking an eight-week optional college English course at a four-year college in China. FA data were collected in the final course of the course by a self-reporting survey using the online training platform Mosoteach. To achieve the finding, the relationship between FA scores and SA scores (final exam and performance scores) was analyzed in SPSS by means of Pearson correlation analyses. Significant positive correlations were found between FA and SA scores overall. In addition, students' performance on chapter tests, online discussions, brainstorming, quick-responses, assignments and the number of thumbs-up clicks by teachers were significantly correlated with SA scores. The results suggested that FA administered through the Mosoteach app could improve students' academic performance, thus providing an empirical basis for improving educational assessment. Based on these findings, implications for assessment in EFL classes were described.

본 연구는 형성평가 (FA)와 총괄평가 (SA) 사이의 관계를 검사하여 대학 EFL 수업 평가 개선을 돕고자 수행되었다. 이 연구의 참여자들은 중국의 4년제 대학에서 선택적으로 8주간의 대학 영어 과정을 수강했던 75명의 학부생들이었다. FA 데이터는 온라인 교육 플랫폼인 Mosoteach를 사용하여 자기 보고식 설문 조사에 의해 코스 마지막 과정에서 수집되었다. 연구 결과를 도출하고자, Pearson 상관관계 분석을 통해 FA와 SA(기말고사 및 수행활동 점수)간의 관련성을 SPSS로 분석하였다. 전반적으로 그 두 평가 점수 간 유의미한 긍정적 상관관계가 있다는 것으로 나타났다. 학생들의 단원 평가, 온라인 토론, 브레인스토밍, 신속한 답변, 그리고 과제 수행에서 교수자들의 엄지척 클릭수와도 깊은 상관관계를 보였다. Mosoteach 앱을 통해 관리되는 FA가 학생들의 수업의 학업 성과를 향상 시킬 수 있었다는 결과는 교육 평가 개선을 위한 경험적 기반을 제공할 수 있음을 시사하였다. 이러한 연구 결과에 따라 EFL 수업 평가에 대한 중요성이 설명되었다.

Keywords

Acknowledgement

This work was supported by a General Grant on Higher Education and Teaching Reform of the NEAC, China (19080); a General Grant of Social Science Fund of Jilin Province, China (2021B225); a General Grant of Jilin Higher Education Institution (JGJX2019D39)

References

  1. Cowie, B. & Bell, B. (1999). A Model of Formative Assessment in Science Education. Assessment in Education: Principles, Policy & Practice, 6(1), 101-116. DOI: 10.1080/09695949993026
  2. Chinese Ministry of Education. (2004). College English Teaching Guidelines. Shanghai: Shanghai Foreign Language Education Press.
  3. Jin, Y. & He, L. Z. (2015). Constructing a Comprehensive and Diversified College English Curriculum Evaluation System: Needs Analysis and the Way Forward. China Foreign Languages, 12(3), 4-13. DOI: 10.13564/j.cnki.issn.1672-9382.2015.03.002
  4. Jin, Y. & Sun, H. (2020). Classroom-Based Foreign Language Assessment (2007-2018): Looking Back and Moving Forward. Journal of Northeast Normal University (Philosophy and Social Sciences), 5, 166-173. DOI: 10.16164/j.cnki.22-1062/c.2020.05.022
  5. Chinese Ministry of Education. (2020). College English Teaching Guidelines. Shanghai: Shanghai Foreign Language Education Press.
  6. Tang, X. Y. & Zhang, S. Q. (2007). The Implement and Challenges of New Forms of Assessment in a Context of College English Teaching. Foreign Languages and Their Teaching, 214(1), 14-19. DOI: 10.13458/j.cnki.flatt.003525
  7. Wang, T. S. Zhu, X. T. & Xu, Y. Y. (2018). A Study on Effects of Assessment for Learning on Motivation and Writing of Chinese College English Learners. Foreign Languages Research, 35(3), 46-53, 112. DOI: 10.13978/j.cnki.wyyj.2018.03.008
  8. Lu, Y. & Mao, N. (2018). The Formative Assessment and Practice of Mixed Teaching Reform Based on the Mosoteach Cloud Class. Education Modernization, 5(15), 61-62, 76. DOI: 10.16541/j.cnki.2095-8420.2018.15.025
  9. Herrera, L. & Macias, D. (2015). A Call for Language Assessment Literacy in the Education and Development of Teachers of English as a Foreign Language. Colombian Applied Linguistics Journal, 17(2), 302-312. DOI: 10.14483/udistrital.jour.calj.2015.2.a09
  10. Wai, N. N. & Hirakawa, Y. (2001). Teachers' Conceptualization and Actual Practice in the Student Evaluation Process at the Upper Secondary School Level in Japan: Focusing on Problem Solving Skills. Studies in Educational Evaluation, 27(2), 175-198. DOI: 10.1016/S0191-491X(01)00020-7
  11. Alison, R. (2005). Formative Assessment: A Key to Deep Learning? Medical Teacher, 27(6), 509-513. DOI: 10.1080/01421590500129159
  12. Black, P. & Wiliam, D. (1998). Assessment and Classroom Learning. Assessment in Education, 5(1), 7-74. DOI: 10.1080/0969595980050102
  13. Darrell, J. R. Paul, Z. & Robert, A. S. (2014). Motivating Student Learning Using a Formative Assessment Journey. Journal of Anatomy, 224(3), 296-303. DOI: 10.1111/joa.12117
  14. Sadler, D. R. (1989). Formative Assessment and the Design of Instructional Systems. Instructional Science, 18(2), 119-144. DOI: 10.1007/BF00117714
  15. Ames, C. (1992). Classrooms: Goals, Structures, and Student Motivation. Journal of Educational Psychology, 84(3), 261-271. DOI: 10.1037/0022-0663.84.3.261
  16. Vispoel, W. P. & Austin, J. R. (1995). Success and Failure in Junior High School: A Critical Incident Approach to Understanding Students' Attributional Beliefs. American Educational Research Journal, 32(2), 377-412. DOI: 10.2307/1163436
  17. Cardozo, L. T. Ramos de Azevedo, M. A. Morais Carvalho, M. S. Costa, R. De. Lima, P. O. & Marcondes, F. K. (2020). Effect of an Active Learning Methodology Combined with Formative Assessments on Performance, Test Anxiety, and Stress of University Students. Advances in Physiology Education, 44, 744-751. DOI: 10.1152/advan.00075.2020
  18. Zhang, Y. J. (2019). The Research on Application of Blended Learning Assessment Based on Blue Moyun Class in Comprehensive English Course. Journal of Ningbo Institute of Education, 21(4), 77-78, 96. DOI: 10.13970/j.cnki.nbjyxyxb.2019.04.020
  19. Gu, Y. Q. & Yu, G. X. (2020). Researching Classroom-Based Assessment for Formative Purposes. Chinese Journal of Applied Linguistics, 43(2), 150-168. DOI: 10.1515/CJAL-2020-0010
  20. Cao, R. P. Zhang, W. X. & Zhou, Y. (2004). Implementation of Formative Evaluation in an EFL Writing Course. Foreign Language Education, 25(5), 82-87. DOI: 10.16362/j.cnki.cn61-1023/h.2004.05.022
  21. Richard, J. S. Donald, B. Y. Carlos, C. A. Paul, R. B. Erin, M. F. Maria, A. R-P. Miki, K. T. & Yue, Y. (2008). On the Impact of Curriculum-Embedded Formative Assessment on Learning: A Collaboration between Curriculum and Assessment Developers. Applied Measurement in Education, 21(4), 295-314. DOI: 10.1080/08957340802347647
  22. Guo, X. & Yang, Z. Q. (2003). Formative Assessment and College English Teaching and Testing. Tsinghua Journal of Education, 24(5), 103-108. DOI: 10.14138 /j.1001-4519. 2003.05.019 https://doi.org/10.14138/j.1001-4519.2003.05.019
  23. Zhang, A. Z. (2020). Problems and Measures on Process Assessment Based on Blended Teaching. All-Round Development in West Region, 6(12), 155-156, 159. DOI: 10.16681/j.cnki.wcqe.202012070
  24. Liu, M. & Wu, S. N. (2020). The Construction of a Cloud-Based Formative Assessment Model in English Teaching. Foreign Language Education, 41(5), 71-75. DOI: 10.16362/j.cnki.cn61-1023/h.2020.05.014