A Method for Developing Items to Assess Earth Science Creativity

지구과학 창의력 평가 문항 개발 방법에 관한 연구

  • Lee, Hang-Ro (Daejeon Metropolitan West District Office of Education)
  • Published : 2003.04.30

Abstract

This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.

본 연구에서는 지구과학 지식과 창의력을 동시에 적용해야 해결할 수 있는 지구과학 창의력을 평가할 수 있는 문항의 개발 방법을 제시하고자 하였다. R&D과정을 거친 본 연구의 결과는 첫째, 조작적 정의를 통해 창의력과 과학창의력간의 인지능력 차이를 명료화하였고 둘째, 과학창의력을 구성하는 하위 요소들 중에서 문항 개발이 가능하다고 판단된 유창성, 융통성, 정교성, 독창성을 선정하여 각각에 대한 조작적 정의를 내린 후 각 요소들에 대한 평가와 채점의 준거를 제시하였다. 셋째, 평가도구의 구비 조건인 타당도, 신뢰도, 변별도, 난이도를 검증하기 위하여 3번의 현장검증을 실시하였으며, 본 연구에서 개발한 지구과학창의력 평가도구는 각 하위 요소별로 2문항씩 총 8문항으로 구성되어 있다. 넷째, 문항합치도 지수 평균은 .99, 문항 내적 합치도 지수인 Cronbach ${\alpha}$값은 .79, 각 문항별 평가자간 신뢰도는 0.78,각 하위 요소별 평가자간 신뢰도는 0.75, 변별도 지수인 점이연상관 지수는 .19, 문항 난이도 지수는 .00이었다. 이와 같이 평가도구의 구비조건들이 허용 범위 내에 있는 것으로 볼 때 본 연구에서 개발한 지구과학 창의력 평가도구는 유용한 것으로 판단할 수 있다.

Keywords

References

  1. Journal of Personality and Social Psychology v.45 The social psychology of creativity: A componential conceptualization Amabile, T.M. https://doi.org/10.1037/0022-3514.45.2.357
  2. Inservice Materials TM 2002-24 The Gifted Education for the Creative Knowledge Producer Baek, S.G.
  3. Creativity Research Journal v.4 Generality of creativity across performance domain Baer, J. https://doi.org/10.1080/10400419109534371
  4. Divergent thinking is not a general trait: A task-specific approach Baer, J.
  5. Creative Students Creative Teachers Baer, J.;Woo, J.O.(Trans.);Jun, K.W.(Trans.)
  6. Creativity Research Journal v.11 no.2 The case for domain specificity of creativity Baer, J. https://doi.org/10.1207/s15326934crj1102_7
  7. Teaching-Learning and Assessment to Develop a Creativity; Educational Strategy Seminar for Improving a Creativity Cho, Y.S.
  8. ACT research report services A multivariate generalizability analysis of the 1989 and 1990 AAP mathematics test forms with respect to the table of specification Colton, D, A.
  9. Investigating creativity in youth Fishkin, A., Cramond, B., and Olszewski-Kubilius, P.
  10. Creating minds Gardner, H.
  11. Journal of Gifted/Talented Education v.10 no.2 Investigation of Domain-specificity and Domain-generality of Creativity in Young Children Han, K..S.
  12. Gifted Child Quarterly v.46 no.2 Multiple creatives?: Investigating domain-specific of creativity in young children Han, K.S.;Marvin, C. https://doi.org/10.1177/001698620204600203
  13. The Journal of the Korean Earth Science Society v.23 no.4 Are Boys More Creative than Girls? -Based on the Scientific Creativity of Gifted Students- Han, K.S.;Shin, J.E.;Jeong, H.C.;Choe, S.E.
  14. The nature of creativity The role of environment in creativity Hennessy, B.;Amabile, T.M;Sternberg, R.J.(ed.)
  15. Intelligence and Creativity Hong, S.J.
  16. Problem Finding, problem solving, and Creativity Creative Problem Solving in the Classroom: Contributions of Four Psychological Approaches Houtz, J.C.;Ronco, M.A.(ed.)
  17. Creativity Test (for Secondary School Students) Jeong, W.S.;Lee, Y,D.
  18. Curriculum Basis on Curriculum Development to improve Creative Problem Solving Ability Kim, G.J;Kim, A.Y.;Cho, S.H.
  19. Sungkyunkwan University: Doctoral Dissertation Effects of Creativity Training Program and the Related Variables on the Improvement of Creativity Kim, M.S.
  20. Torrance Creativity (Language, a diagram) Test Kim, Y.C.
  21. Sungkyunkwan University: Doctoral Dissertation A Study on the Comparison of Creativity and the Training Effect for Improvement of Creativity Lee, I.S.
  22. The Invitation to Creativity Lim, S.H.
  23. Thinking and problem solving Creativity Lubart, T. I.;R. J. Sternberg(ed.)
  24. Science Curriculum Ministry of Education and Human Resources Development
  25. Before the gates of excellencer; The determinants of creative genius Ochse, R.
  26. The psychology of human thought Creativity and the quest for mechanism Perkins, D.;Sternberg, R.J.(ed.);Smith, E.(ed.)
  27. Theories of creativity Newbury Park History, chemistry, psychology, and genius: An intellectual autobiography of historiometry Simonton, D.K.;M.A. Runco(ed.);Rsalvert(ed.)
  28. What is a Gifted Education? Song, Y.D.
  29. Handbook of creativity Sternberg, R.J.
  30. Theory and Practice of Item Development and Analysis Sung, T.J.
  31. Conceptions of giftedness Giftedness: A psychological approach Tannenbaum, A.J.;R.J. Sternberg(ed.);J.E. Davidson(ed.)
  32. Journal of Creative Behavior v.6 Can we teach children to think creatively? Torrance, E.P. https://doi.org/10.1002/j.2162-6057.1972.tb00923.x
  33. Creativity: The myth of genius Weisberg, R. W.
  34. The two Axies of 21st Education-Creativity Education and Personality Education- Woo, J.O(ed.)
  35. The Journal of Creativity Education v.3 no.1 The Development of Creativity Instructional Model in Science Woo, J.O.;Kim, S.H;Kang, S.W.