• Journal of Gifted/Talented Education
• /
• v.20 no.1
• /
• pp.61-77
• /
• 2010

The purpose of this study was to analyze the items that were used in entrance examination for science gifted education center for middle school students by using content analysis and classical item analysis. In content analysis, objective type items exhibited mathematics and physics were dominant. Science giftedness & creativity items were dominant. And essay type items consisted of physics items, have evaluated creative problem solving ability. Item difficulty and discrimination index, on the whole, were appropriate. Comparing with objective type, essay type has higher discrimination index. In correlation analysis between total score and score of each type of items, total score has the highest correlation with essay type items and science giftedness & creativity. It was recommended that mathematics, physics and chemistry items with focusing giftedness & creativity could give some implications for future selection methods of science gifted education center.

• Journal of Science Education
• /
• v.42 no.3
• /
• pp.322-333
• /
• 2018

The purpose of this study is to identify the types and characteristics of the integrative thinking that learners with diverse learning backgrounds use in solving earth science problems. Four students in middle school were surveyed using questionnaires to know students' science learning background and test items with integrated content. A total of 200 items, 40 integrated items and 160 general items, were administered ten times. The students did not show a consistent relationship in terms of correct answer percentage in general items and that of in integrated items. In order to understand the type of integrative thinking of each student, after students solve an item, we analyzed the percentage of correct answers by types and interviewed them and analyzed the contents to identify the characteristics of the thinking used in solving each item. As a result, the types of integrative thinking used in problem solving were classified into three types, knowledge-based, real life-based, and integrated inquiry-based types. It is necessary to study various ways to improve the integrative thinking ability considering the characteristics of students in science teaching and learning.

• Journal of Science Education
• /
• v.38 no.3
• /
• pp.670-690
• /
• 2014

The purpose of this study was to analyze paper and pencil test items of life science I in high school to diagnose problems of the test items developed by teachers, and to provide some implication for better assessment. 690 selection-type items and 162 supply-type items in life science I were collected from 10 general high schools. In the analysis of test items, the ratio of the selection-type item and the supply-type item was 81:19 in the number of items based on item type, while the ratio was 74.4:25.6 in the distribution of marks, indicating that the distribution of marks compared to the number of items was higher in the supply-type items. In the analysis by the Bloom's revised taxonomy of educational objectives, the items of 'conceptual knowledge' in the knowledge and those of 'understanding' in the cognition process were shown most in both the selection-type item and the supply-type item. In the analysis by the science assessment frameworks of NAEA, the items of 'knowledge' were shown 9 times more than those of 'inquiry'. When compared to the level of difficulty presented in the two-way specification table and the percentage of correct answers in the selection-type item, the concurrence was 41.5%. When compared to the ratio of number of items based on the item type of the supply-type items, the short-answer items were 34.0%, the descriptive items were 61.1%, and the drawing items were 4.9%. The drawing items were mainly developed in the unit of 'Cells and Continuity of Life'. When the descriptive items were classified by the acceptance of response, all the items were 'response restricted' type, and the items of 'restricted in content range' type among them were highest. When the items were classified by presentation of data, the items of 'presentation of data' type were highest(65.4%), and when classified by type of question, the items of 'knowledge description' type were highest(80.4%). In conclusion, it is needed to develop items belonging to 'inquiry' area more in the school, and to increase the ratio of the descriptive items, presenting various types of items.

• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.617-626
• /
• 1998

Inquiry approach in teaching science has been widespread in Korea since the Third National Curriculum in 1970's. But the effect of the approach has never been evaluated systematically in Korea, so the science educators do not know if the inquiry approach really works and if any critical problems inhibit the effect of the approach. In this context, the NAEP of the Unied States and the APU of the United Kingdom were model programs for assessing the effect of the inquiry approach in teaching science. The purpose of this study is to develop an assessment system for evaluating the effect of inquiry teaching in elementary and secandary schools. For this purpose, an assessment framework and 240 test items were developed and tried with a sample of 8,906 students. The results say that the developed tests are reliable. The average Cronbach $\alpha$ reliability coefficient of the tests was 0.69. The discrimination index(point-biserial correlation coefficient) ranged from 0.39 to 0.54 with a mean of 0.49, which indiate they are excellent in discriminating students in terms of their inquiry achievement. The test items were also analyzed by "item response theory." The results also say that the items are successfully developed.

• 한국지구과학회:학술대회논문집
• /
• 2010.04a
• /
• pp.17-17
• /
• 2010

본 연구는 학생들의 과학 경험의 정도를 정량화 하는데 있어 통일된 측정 도구를 제시하는 것이다. 측정 도구를 구성하는 요인들은 선행연구를 통해 학교 안 과학 경험은 일반 활동 경험, 과학 탐구 경험, 실험 기구 경험으로 세분화 되며 학교 밖 과학 경험은 일반 활동 경험, 취미 활동 경험, 현장 견학 경험 6개의 영역으로 구분을 할 수 있었다. 각각의 요인을 구성하는 질문은 NAEP(1987)에서 사용된 과학 경험 검사 도구와 신영준(2000)의 과학 경험 검사 도구의 문항 중 일부를 발췌하고 더불어 과학 경험에 대한 개방적인 설문지를 통하여 1차 검사를 실시하여 얻은 답변 중 빈도가 많은 답변과 중등 교과서의 탐색적 분석을 통해 영역별 10문항씩 6개 영역의 문항을 선정하였다. 사전 설문조사와 선행 연구를 바탕으로 개발한 검사지를 고등학교 1학년 학생 413명을 대상으로 2차 검사를 실시하였다. 개발한 측정 도구의 타당도는 내용타당도와 구인타당도로 검사하였다. 내용타당도는 2명의 현직 중등교사와 2명의 과학교육전문가가 각 문항이 측정하고자 하는 목적에 부합하는지 심사하였고, 구인타당도는 요인분석을 통해 검사하였다. 신뢰도는 Cronbach $\alpha$를 통하여 문항을 분석하였다. 6개의 영역의 요인에 대하여 타당도와 신뢰도 분석 결과 6개 영역으로 구성된 60문항의 측정 도구는 학생들의 과학 경험을 측정하는 도구로서 적절하다는 결론을 내렸다.

• Korean Journal of Childcare and Education
• /
• v.10 no.3
• /
• pp.137-158
• /
• 2014

The present study aimed to develop an instrument to assess young children's understanding of science inquiry skills. For the purposes of the study, based on analysis of literature and evaluation tools related to young children's science inquiry skills, five categories of understanding science inquiry skills including observing, classifying, predicting, measuring, and discussing were selected. Then 30 test items were developed and verified three times through opinions from science education and early childhood education professionals and teachers. Finally, a total of 19 test items within five categories were developed. The 19 items' item difficulty, item discrimination, and item internal consistency were verified statistically. In addition, concurrent validity and test-retest reliability of the items were verified by the significant correlation coefficients. The instrument developed in this study was administered to 300 children who were 3, 4, and 5 years old. The results showed that 5 year old children had better competence to understand science inquiry skills than 4 and 3 year old children, while there were no differences in the competence between boys and girls.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1235-1244
• /
• 2004

The purpose of the study was to produce resources to help develop instructional methods and programs for school science to reduce gender differences in science achievement by analyzing TIMSS-R results according to item type, benchmark, and content category. Korean male students performed higher than Korean female students and gender differences of Korean students were higher than international means in all item types including multiple-choice, short answer, and extended response type. GDI(Gender Difference Index) of Korean students was lower than international mean in top 10% benchmark but higher than international means in other benchmarks. Korean male students also exhibited higher performance than Korean female students in all content categories except scientific inquiry and the nature of science category. Regarding items that GDIs were higher than 10, the number of items belonged to life science and earth science category was relatively larger and a high percentage of them was not included in school science curriculum. In addition, the items were equally distributed in each performance category. In sum, the study showed various gender differences according to item type, benchmark, and content category. The results could be used to find appropriate instructional methods to reduce gender differences in science achievement.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.76-92
• /
• 2002

OECD/PISA(Programme for International Student Assessment) is significant in that it is the first international comparative study assessing 15-year-old students' scientific literacy. Based on Korean students' results of percent correct in 35 science items, several characteristics such as followings were revealed. First, from the perspectives of science application area, Korean students showed the highest achievement in the area of 'science in technology' followed by in the areas of 'science in life and health' and 'science in earth and environment'. Male students achieved significantly better than female counterparts in all three areas. Second, the achievement in items of science knowledge was significantly higher than in items of scientific processes. Whereas the achievement difference between science knowledge- and scientific process items was larger for male students. Third, from the perspectives of application contexts, Korean students showed the highest achievement in the historical context and the lowest achievement in the personal context. Fourth, from the perspectives of item format, Korean students performed significantly better in open-constructed items rather than in multiple-choice items. Fifth, Korean students showed low performance in items of biotechnology and environment-related issue, which was more prominent for female students. Sixth, whereas male students performed significantly better than female students in most aspects, it is noteworthy that there was no significant gender differences in items of scientific processes and females performed significantly better than male students in open-constructed items which require long sentence.

• Journal of the Korean earth science society
• /
• v.26 no.6
• /
• pp.511-523
• /
• 2005

The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

• Journal of Korean Elementary Science Education
• /
• v.40 no.2
• /
• pp.191-209
• /
• 2021

This study analyzed how characteristics of process-focused assessment are implemented in the distributed process-focused assessment examples in elementary school science education. To this end, through a review of previous studies, the analysis perspectives on the characteristics of the process-focused assessment were extracted into six categories. Using the analysis framework, it was described how process-focused assessment examples in elementary school science education developed by metropolitan office of education reflected the characteristics of process-focused assessment. As a result of the study, the characteristics of process-focused assessment were often formally reflected in sample materials. For example, there was a lack of skills on how to effectively integrate instruction and evaluation in practical terms. In many cases, feedback simply induced a recall of a learned concept or simply guides a related scientific concept. In some cases, the characteristics of process-focused assessment did not appear prominently in the sample materials. Also the developed sample materials were divided into the same type as the existing science and performance assessment questionnaire, a narrative·essay type, and a type similar to experimental workbook.