• Journal of The Korean Association For Science Education
• /
• v.18 no.3
• /
• pp.357-369
• /
• 1998

Science-related affective domain is considered as a very important domain for achieving students' scientific literacy. Most science educational objectives include some objectives about affective domain such as scientific attitudes, values, curiosity, interests and concerns about nature and science. In this research, the evaluation framework and items of science-related affective domain were developed. The evaluation framework consists of three main categories such as cognition, interest and scientific attitudes and 16 subcategories. The validity of the evaluation framework is tested by ten science educators. Forty-eight items are selected among item pool by considering item response analysis and item-test correlation coefficient. The Cronbach ${\alpha}$ of the tests is 0.83(cognition and interest) and 0.86(scientific attitudes). The results of the test are as follows. First, boys got higher scores than girls. Second, elementary students got higher scores than secondary students. Finally. students in urban areas showed higher scores than those in rural areas.

• Journal of Science Education
• /
• v.34 no.1
• /
• pp.164-174
• /
• 2010

The purpose of this study was to find out taxonomic characteristics of objectives infered from questions of summative evaluation by analyzing those objectives with Bloom's revised taxonomy of educational objectives. 1,711 questions of midterm and final examinations collected from 25 middle schools were analyzed to classify objective of each question. The major findings of the study were as follows: first, from the analysis of objectives in the knowledge dimension, the assessment of factual knowledge was most prevailing(67.6%) in the biology summative evaluation. In the cognitive process dimension, memory assessment was most dominant(76.1%). Thus, the main objectives of evaluation leaned toward particular classes in the Bloom's revised taxonomy, which was different from the findings of earlier studies on the weights of evaluation areas. Second, the level of the objectives should be determined in consideration of the grade of middle schoolers, as their cognitive level improves with grade. In fact, however, there was no difference among three grades in characteristics of objective taxonomy.

• Journal of The Korean Association For Science Education
• /
• v.38 no.4
• /
• pp.495-504
• /
• 2018

This study was conducted to develop items to measure scientific core competency based on statements of scientific core competencies presented in the 2015 revised national science curriculum and to identify the validity and reliability of the newly developed items. Based on the explanations of scientific reasoning, scientific inquiry ability, scientific problem-solving ability, scientific communication ability, participation/lifelong learning in science presented in the 2015 revised national science curriculum, 25 items were developed by five science education experts. To explore the validity and reliability of the developed items, data were collected from 11,348 students in elementary, middle, and high schools nationwide. The content validity, substantive validity, the internal structure validity, and generalization validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there were no nonconformity in the 25 items. The confirmatory factor analysis using the structural equation modeling revealed that the five-factor model was a suitable model. The differential item functioning analyses by gender and school level revealed that the nonconformity DIF value was found in only two out of 175 cases. The results of the multivariate analysis of variance by gender and school level showed significant differences of test scores between schools and genders, and the interaction effect was also significant. The assessment items of science core competency based on the 2015 revised national science curriculum are valid from a psychometric point of view and can be used in the science education field.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1245-1255
• /
• 2004

The purpose of this study is to develop a valid and reliable evaluating instrument for elementary school fifth and sixth graders. The instrument is developed through R&D procedure, which includes two checks of science specialist and two field trials of the instrument. Evaluating items are content-free for each science inquiry skill. Each science inquiry element is based on SAPA and the 7th curriculum. This study has selected 10 science inquiry skills(observing, classifying, measuring, predicting, inferring, recognizing of a problem, controlling variables, interpreting data, drawing a conclusion, designing an experiment), formulated a clear definition of the elements of science inquiry skills, and established the objectives of evaluation. The content areas are divided into three categories, material and energy, life and environment, and the earth and circulation. Each category contains 10 items. So the instrument consists of 30 items. The content validity of items, objectivity of the scoring keys, and clarity of the items has been checked twice by specialists in science education. At the same time, two field trials were performed to produce the reliability of the instruments, discrimination index, and item difficulty index. The instrument has the content validity is 91.6%, reliability 0.79, objectivity 93.3%, discrimination index 0.30, and item difficulty index 66.1%.

• 대한공업교육학회지
• /
• v.36 no.2
• /
• pp.219-238
• /
• 2011

The purpose of this study was to analyze the industrial education items in the teacher recruitment examination for secondary school and make a better proposal. To achieve the purpose, all the industrial education items, which had taken an examination for ten times from the school year 2002 to the most recent year 2011, were analyzed. The results of this study were as follows; First, the number and score ratio of industrial education items had been increased quarterly from the school year 2002 to 2011, but had same sharing in all subjects and fixed since the school year 2010. Second, as the industrial education items had been increased quarterly, they were taken from more various subcategory of industrial education. Recently, the industrial education items on "complex domain" including two more subcategory of industrial education were increased. Third, the industrial education items with science education items was compared from the school year 2009 to 2011. The items on PCK(Pedagogical Content Knowledge) had been increased in the industrial education but the proportion of PCK was lower than science education.

• Journal of Science Education
• /
• v.42 no.2
• /
• pp.198-213
• /
• 2018

In recent years, descriptive evaluation has been gaining importance at school. The purpose of this study is to analyse descriptive evaluation items which have been made by school teachers. 300 items for regular examinations are collected from 7 middle schools (grades 1 through 3) in Gyeongnam Province. Distribution and types of items are examined to compare educational objectives of standard achievements and those of evaluation according to Bloom's revised taxonomy of educational objectives. The result shows that there exist a majority of shared subject units for descriptive evaluation. Huge difference of frequency is also found among subject units and standard achievements. Less than 65% of evaluation items are descriptive and the rest is simple completion or short answers. In addition, it reveals only 40.3% of agreement between educational objectives of standard achievements and those of evaluation items. The interviews with 27 teachers indicate that lack of ability to develop proper items and grading are the major obstacles. In conclusion, systematic training courses are to be provided in order to resolve issues over descriptive evaluation.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.40-53
• /
• 2002

This study was based on the analysis of earth and environmental science items in PISA 2000 data. The purpose of this study was to identify i) gender differences in scientific literacy, ii) item characteristics that favored either female or male, and iii) misconceptions that 15-years-old Korean students have in the field of earth and environmental science. The results revealed significant gender differences. Overall, male students demonstrated higher level of achievement than female students. On the other hand, amongst high ability students, female students outperformed male students in open-constructed items. Female students tended to score higher on items that required long answers or items related to scientific processes, whereas male students outperformed female students in science knowledge or items that required data interpretation. The study also revealed that a majority of Korean students had misconceptions in fundamental earth and environmental science knowledge, such as the direction of earth's axis and equator, and the causes of Greenhouse Effect.

• Journal of The Korean Association For Science Education
• /
• v.26 no.2
• /
• pp.200-211
• /
• 2006

The purpose of this study was to analyze Korean middle school student achievement in environmental science based on the TIMSS 2003 (Trends in International Mathematics and Science Study), a student comparison of 46 participating nations. Korea ranked the fourth with a mean score of 554 in environmental science. However, all 3 environment science topics assessed in TIMSS are not included in the Korean science curriculum through 8th grade, even though they are included in most other participating nations' curricula. The average percent correct of items was analyzed according to the main topic, the item type and the cognitive domain. Items that showed differences between the average percent correct of Korea and the international average as well as differences between the average percent correct of boys and girls were further analyzed. Results revealed that Korean students performed better than the international average, especially in 'use and conservation of natural resources', multiple-choice items, and items requiring 'factual knowledge'. Also, male students demonstrated significantly higher achievement than female students. On the other hand, Korean students showed relatively lower achievement in constructed-response items, items that contained content they had not learned in science lessons and items requiring descriptions of the uses and effect of science and technology. Moreover, Korean student lacked understanding about acid rain, global warming, and ozone layer destruction. Korean female students showed relatively lower environmental conceptions and lower performance on items requiring data analysis than Korean male students. On the basis of these results, this study suggested that topics of environmental science be included in the science curriculum and taught in the science classroom to help middle school students more fully comprehend environmental issues.

• Journal of the Korean BIBLIA Society for library and Information Science
• /
• v.10 no.1
• /
• pp.29-54
• /
• 1999

The purpose of this study is to find out scholarly information seeking patterns of university faculty in Korea. It is important and necessary to understand their information seeking behavior and also to assess the characteristics of communication process of scholarly information seeking in order to build and operate efficient library information system. For this purpose, a questionaire consisting of 15 information seeking channels was designed and used for interviewing three major groups of professors namely science, social science and humanities. Based on the Statistical Analysis System analysis of the questionaire, it was found that there is significant differences among three specialization field groups for 11 out of 15 questions and there is significant differences among age groups for 7 out of 15 questions.

• Journal of The Korean Association For Science Education
• /
• v.19 no.4
• /
• pp.604-621
• /
• 1999

We analyze the admission test problems used in 1998 at the Science Education Center for Gifted Youth at Kyungpook National University (SECGY, KNU). The test consists of two parts, an evaluation of the scientific thinking skills and an evaluation of the achievement for Mathematics and Sciences, the former of which includes evaluations of scientific process skills and logical thinking skills. The problems for the test of scientific thinking skills were developed and standardized by the Korea Education Development Center, while those of the achievement for Mathematics and Sciences were made at SECGY. We calculate the indices of the difficulty and discrimination for each problem to determine whether or not the test is appropriate to apply for selecting number of gifted students among the recommended students from 389 middle schools in Taegu-city and Kyungsang-pook-do Province. We find that both indices of most problems for the test of scientific thinking skills were out range of the appropriate level and. moreover, even those problems which fall into the appropriate range showed very low efficiencies for distractors. We, thus, conclude that the problems of the test of scientific thinking skills are inappropriate to use as a test for admission to SECGY. On the other hand, the problems of the achievement test showed extreme results; the Mathematics problems appeared to be too difficult, whereas the Physics problems appeared too easy. However, overall scores showed a normal distribution, indicating that those problems played crucial role in selecting gifted students. We finally propose several suggestions in developing the test problems and in selecting students at the SECGY.