Journal of Science Education (과학교육연구지)

Science Education Research Institute Kyungpook National University (경북대학교 과학교육연구소)
권호 표지
DOI QR코드

DOI QR Code

Exploring a Learning Progression for Eight Core Concepts of Middle School Science Using Constructed Response Items in the National Assessment of Educational Achievement (NAEA)

국가수준 학업성취도 평가의 서답형 문항을 이용한 중학교 과학 8개 핵심 개념에 대한 학습발달과정 탐색

  • Received : 2017.09.27
  • Accepted : 2017.12.20
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study aims to explore a learning progression for eight core concepts of middle school science using constructed response items in the national assessment of educational achievement (NAEA). For this purpose, a total of 7,390 responses of the 9th graders on 8 constructed response items in NAEA conducted in 2015 were inputted by computer and the inputted answers were analyzed and classified into different levels. After completing this process, five levels were set for each construct and a construct map was created according to the levels. In this study, the construct map was written in a progression-based rubric format, which was used as a criterion for leveling the answers of all students. In addition, the Rasch model was applied to measure the scores and achievements of the respondents by means of statistical analysis to correlate the scores of the students with the achievement levels of the constructs. Lastly, a preliminary learning progression was created by revising the construct map reflecting the results of Rasch model application. This study was meaningful in that it explored the possibility of developing the learning process by using constructed response items in NAEA. However, the preliminary learning progression developed in this study is still hypothetical and inferential because it is not longitudinally traced to individual students. Therefore, it is necessary to continually revise and supplement through iterative research process.

이 연구에서는 2015년 국가수준 학업성취도 평가(NAEA)의 서답형 문항을 이용하여 중학교 과학 교과의 8개 핵심 개념에 대한 학습발달과정을 탐색하고자 하였다. 이를 위해 2015년 실시된 NAEA 서답형 8개 문항에 대한 중학교 3학년 7,390명의 응답 결과를 전산으로 입력하고 입력된 답안을 분석하여 수준별로 유형화하는 과정을 거쳤다. 이 과정을 마친 후 각 평가 구인별로 5개 수준을 설정하여 구인구성도를 작성하였다. 이 연구에서의 구인구성도는 발달 기반의 루브릭 형식으로 작성되었는데, 전체 학생들의 답안에 대해 수준을 부여하는 준거로 활용되었다. 또한, 평가 결과로 얻은 학생들의 점수를 평가 구인에 대한 성취 수준과 연결하기 위하여 통계적 해석으로 응답자의 점수나 성취 정도를 측정하는 Rasch 모델을 적용하였다. 마지막으로, Rasch 모델 적용 결과를 반영하여 구인구성도를 수정한 예비 학습발달과정을 작성하였다. 이 연구는 NAEA의 서답형 문항을 활용하여 학습발달과정 개발 가능성을 탐색하였다는 데 의의가 있다. 하지만, 이 연구에서 작성된 예비 학습발달과정이 개별 학생들 대상으로 종적으로 추적한 것이 아니므로 여전히 가설적이며 추론적이다. 그러므로 반복적인 연구 과정을 통해 지속적으로 수정 및 보완될 필요가 있다.

Keywords

References

  1. Alonzo, A. C., & Gotwals, A. W. (2012). Learning progressions in science: Current challenges and future directions. Sense Publishers, Rotterdam: The Netherlands.
  2. Bond, T. & Fox, C. (2007). Applying the Rasch model: Fundamental measurement in the human sciences (2nd). Mahwah, NJ: LEA.
  3. Corcoran, T., Mosher, F. A., & Rogat, A. (2009). Learning progressions in science: An evidence-based approach to reform. Consortium for Policy Research in Education Report #RR-63. Philadelphia, PA: Consortium for Policy Research in Education.
  4. Corcoran, T., & Silander, M. (2009). Instruction in high schools: The evidence and the challenge. The Future of Children. America’s High Schools, 19, 157-183.
  5. Duschl, R., Maeng, S., & Sezen, A. (2011). Learning progressions and teaching sequences: A review and analysis. Studies in Science Education, 47(2), 123-182. https://doi.org/10.1080/03057267.2011.604476
  6. Jeong, E., Kim, M., Sang, K., Kim, J. (2008). A Study on Improving the National Assessment System of Educational Achievement (RRE 2008-2). Seoul: Korean Institute for Curriculum and Evaluation.
  7. Kim, D., Kim, D., Kim, Y., Kim, H., Lee, J., Seo, M., Jo, Y., Lee, K., Lee, I., Sim, J., Pae, J., Jung, G., Choi, W., Park, Y. (2013). A Study on the Features of Educational Achievement and Development of the National Assessment of Educational Achievement (NAEA) 2013 (RRE 2013-4). Seoul: Korean Institute for Curriculum and Evaluation.
  8. Lee, C., Nam, M., Nam, G., Park, E., Kim, H., Kwon, J., Choi, W., Lee, I., Kim, M., Song, M., Jeong, E., Park, J., Sin, M., Choi, J., Ko, E., Kim, D. (2010). A Study on improving the process of developing, implementing, and scoring the National Assessment of Educational Achievement(NAEA) (RRE 2010-6-1). Seoul: Korean Institute for Curriculum and Evaluation.
  9. Lee, I., Lee, S., Kim, S., Lee, J., Seo, M., Jo, Y., Lee, K., Kim, H., Dong, H., Pae, J., Kim, S., Jung, K., Kwon, K., Lee, K. (2015). A Study on the Development of the 2015 National Assessment of Educational Achievement (NAEA) (RRE 2015-12-1). Seoul: Korean Institute for Curriculum and Evaluation.
  10. Lee, I., Dong, H., Kwon, K., Choi, W., Lee, K. (2016a). An anlaysis of the results of 2015 National Assessment of Educational Achievement (NAEA) (RRE 2016-31-4). Seoul: Korean Institute for Curriculum and Evaluation.
  11. Lee, I., Dong, H., Kwon, K., Choi, W., Lee, K. (2016b). An analysis of constructed items of the 2015 National Assessment of Educational Achievement (NAEA) (RRE 2016-9-4). Seoul: Korean Institute for Curriculum and Evaluation.
  12. Lee, K., Maeng, S., Park, Y., Lee, J., & Oh, H. (2016c). Validation of learning progressions for Earth’s motion and solar system in elementary grades: Focusing on construct validity and consequential validity. Journal of the Korean Association for Research in Science Education, 36(1), 177-190. https://doi.org/10.14697/jkase.2016.36.1.0177
  13. Maeng, S., & Lee, K. (2015). Cross-sectional item response analysis of geocognition assessment for the development of plate tectonics learning progressions: Rasch model. Journal of the Korean Earth Science Society, 35(1), 37-52.
  14. Maeng, S., Lee, K., Park, Y., Lee, J., & Oh, H. (2014). Development and validation of a learning progression for astronomical system using ordered multiple-choice assessment. Journal of the Korean Earth Science Society, 34(8), 703-718.
  15. Maeng, S., Seong, Y., & Jang, S. (2013). Present states, methodological features, and an exemplar study of the research on learning progressions. Journal of the Korean Association for Science Education, 33, 161-180. https://doi.org/10.14697/jkase.2013.33.1.161
  16. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174. https://doi.org/10.1007/BF02296272
  17. Ministry of Education. (2016). The Basic Plan for National and International Assessment of Educational Achievement in 2016 (2016. 1. 26.).
  18. National Research Council[NRC]. (2007). Taking science to school: Learning and teaching science in grades K-8. In R. A. Duschl, H. A. Schweingruber, & A. W. Shouse (Eds.). Washington, DC: The National Academies Press.
  19. Osborne, J., Henderson, J. B., MacPherson, A., Szu, E., Wild, A., & Yao, S.-Y. (2016). The development and validation of a learning progression for argumentation in science. Journal of Research in Science Teaching, 53, 821-846. https://doi.org/10.1002/tea.21316
  20. Paik, N. (2006). Specification of statements on educational contents in the subject curriculum. The Journal of Curriculum Studies, 24(2), 207-233.
  21. Seong, Y., Maeng, S., & Jang, S. (2013). A learning progression for water cycle from fourth to sixth graders with ordered multiple-choice tems. Elementary Science Education, 32(2), 139-158.
  22. Smith, C., Wiser, M., Anderson, C., & Krajcik, J. (2006). Implications of Research on Children’s Learning for Standards and Assessment: A Proposed Learning Progression for Matter and the Atomic-Molecular Theory. Measurement: Interdisciplinary Research and Perspectives, 4(1&2), 1-98. https://doi.org/10.1080/15366367.2006.9678570
  23. Vygotsky, L. (1978). Interaction between learning and development. In Gauvain & Cole (Eds.) Reading on the development of children (pp. 34-40). New York, NY: Scientific American Books.
  24. Wilson, M. (2005). Constructiong measure: An item response modeling approach. Mahwah, NJ: Lawrence Erlbaum Associates.
  25. Wright, B. D., & Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370.
  26. Yeo, C., & Lee, H. (2016). Developing and assessing a learning progression for the ecosystem. Journal of the Korean Association for Science Education, 36(1), 29-43. https://doi.org/10.14697/jkase.2016.36.1.0029
  27. Yun, H., Lee, J., Kim, Y., Paik, S., & Lee, K. (2009). A study on the improvement of contents in science education: Focusing on content-related issues in the science curriculum. KICE Research Report, RRC 2009-3-4.

Cited by

  1. 학습 발달과정 탐색을 통한 계절의 변화 교육과정 및 교수 계열 제안 vol.39, pp.3, 2017, https://doi.org/10.5467/jkess.2018.39.3.260
  2. 중학교 과학에서 서술형 평가의 실태 분석: 문항유형, 단원, 평가목표를 중심으로 vol.42, pp.2, 2017, https://doi.org/10.21796/jse.2018.42.2.198
  3. 지구의 공전과 별자리의 겉보기 운동에 대한 초등학생들의 공간적 추론 발달 경로의 사례 연구 vol.38, pp.4, 2017, https://doi.org/10.14697/jkase.2018.38.4.481
  4. 집단중심 추세모형을 적용한 과학고등학교 학생들의 통합 탐구 기능 변화 분석 vol.41, pp.1, 2017, https://doi.org/10.5467/jkess.2020.41.1.48
  5. 학업성취도 평가 결과에 기초한 2009 개정 교육과정 시기의 중학생의 과학 학업성취 특성 분석 vol.40, pp.4, 2017, https://doi.org/10.14697/jkase.2020.40.4.429
  6. 이슬점에 대한 중학생들의 개념 이해 평가 루브릭 개발 vol.41, pp.6, 2017, https://doi.org/10.5467/jkess.2020.41.6.684