• Proceedings of the Korean Society for the Gifted Conference
• /
• 2005.11a
• /
• pp.165-182
• /
• 2005

본 논문에서는 영재와 정보과학영재에 대한 여러 학자들의 정의와 특성 및 관련문헌의 분석을 통하여 정보과학영재의 특성과 정의를 재정립하여 초등정보과학영재 선발평가문항을 개발하였고, 개발된 문항의 신뢰도와 타당도를 검증하기 위해 1, 2차 예비검사를 통해 문항의 난이도와 변별도를 조정하였으며, 최종 검사를 통해 선발된 영재아와 일반 우수아의 검사 결과를 분석하고 정리하였다.

• Journal of the Korean Chemical Society
• /
• v.65 no.1
• /
• pp.48-57
• /
• 2021

This study analyzed the science assessment items that were conducted by the paper and the computer-based assessment in the TIMSS 2019 pre-test, which is an international academic achievement assessment. We examined whether the test mode influenced the percentage of items answered correctly by each graders. As a result, there was no significant difference in the correct answer rates of science items according to the test media in 4th and 8th graders. Looking at the each graders, the difference in the percentage of correct answers was relatively large in the fourth grader rather than the eighth grader. In terms of items, the difference in the percentage of correct answers was relatively larger for the constructed items than the multiple choice questions. As a result of analyzing the content of science and assessment items on the influence of the test media, the multiple choice items showed little difference between the paper and the computer-based assessment items, but the answer-type items tended to have a lower percentage of correct answers than the paper-based assessment. In addition, by grade, 4th graders showed lower percentages of correct answers in the constructed items than 8th graders. This study provides implications related to the development and introduction of computer-based assessment in Korea, and suggests an educational implications for computer-based assessment to be well established as school evaluation.

• Journal of The Korean Association For Science Education
• /
• v.28 no.1
• /
• pp.32-46
• /
• 2008

The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

• Journal of the Korean earth science society
• /
• v.24 no.3
• /
• pp.150-159
• /
• 2003

This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.

• Journal of Gifted/Talented Education
• /
• v.16 no.1
• /
• pp.81-100
• /
• 2006

In this paper, it conducted the following works to develop the selective test for the gifted of information science in elementary schools. First, it presented the discrete mathematical thinking as an essential competence of elementary information science gifted, through theoretical research with many expert's studies, in order to investigate the definition and characteristics of information science gifted. Second, it developed a test to measure the discrete mathematical thinking, according to the results of analysis of discrete mathematical elements, appeared in the 7th national mathematics curriculum, in order to extract the characteristics of selective test for elementary information science gifted. Third, regarding the verification of items in a newly developed test, it adjusted the difficulty and discrimination by conducting 2 sessions of preliminary test, and then finally confirmed that the standards of items in the test, by testifying sufficient level of validity after the application to a main experiment.

• Journal of the Korean earth science society
• /
• v.22 no.6
• /
• pp.469-479
• /
• 2001

This study investigated the trends in the number of applicants and mean score and applicants’ responses on the test items of Earth Science in the College Scholastic Ability Test (CSAT) implemented for 3 years (1999-2001). The percentage of applicants of science track were 43.14% in 1995, but reduced through 29.5% in 2001 to 26.92% in 2002 CSAT For elective subject, about 22% of science track students applied to Earth Science II which ranked third to Biology II and Chemistry II. In 1999, test items were developed to have the expected difficulty 40 ${\sim}$ 59% (6 items) to 60 ${\sim}$ 79% (10 items). But in 2001 every 16 items were developed to have difficulty 60 ${\sim}$ 79%, which was caused by the policy of so called ‘easy CSAT’. Thus the mean score of ‘Earth Science II’ was increased from 50.26 in 1999 through 64.47 in 2000, to 67.58 in 2001. Applicants were generally very good at solving test items focusing on process skills only and familar items but poor at solving test items related to the motion of the earth and planets and sea wave, especially items calling two or more concepts. Thus special measures to cope with the decrease in applicants of science track should be provided. And it is recommended to develop test items with wider range of difficulty and to reduce test items calling process skills only. And special consideration should be given to teaching the content area with poor achievement and high actual difficulty compared to the expected.

• Journal of The Korean Association For Science Education
• /
• v.22 no.2
• /
• pp.378-386
• /
• 2002

In this study, the students' responses on the chemistry items of in the general science of College Scholastics Ability Test (CSAT) implemented for the past 3 years since 1999 were investigated. The number of items by content and inquiry process, the average percent correct by content and inquiry process, the distribution of items by the level of percent correct, and the items with high and/or low percent correct were analysed. There were the fewest items in 'environment' area, especially in 'ozon layer', no test item had been made. The most difficult content area was 'acid rain' in 'environment'. By inquiry process, the most number of items belonged to 'analyzing & interpreting data', and 'identifying problems & formulating hypothesis' was the most difficult process. No test item came under the level of 'very difficult', and many items under the 'easy' or 'very easy' level. Students were generally poor at solving test items demanding several concepts, and very good at simply requiring basic concept treated in lower grade. Educational implications are discussed.

• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.781-786
• /
• 2010

The purpose of this study was to investigate errors on written tests of science, matters, in middle school 7th grade. Errors were defined something you have done which is considered to be incorrect or wrong, or which should not have been done. We found and classified errors, and then examined the frequency of types of errors on the written tests. A total of 167 test items from 10 middle schools were analyzed for this study. Errors on the written tests were classified into 5 types: insufficient information; unnecessary information; inaccurate information; information against curriculum; and unclear information. A total of 81 errors were counted out of 167 test items. The results of this study are expected to help teachers develop written test items to convey definite meanings by text and would be used as basic information for improving written test item standards.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.601-615
• /
• 1998

Establishing and evaluating science education policies and revising and monitoring the effectiveness of science curriculum should be based upon the results of systematic and scientific research studies. Advanced nations have already been administering and developing national level science assessments for these purposes. The science assessments administered in Korea have been reported having many limitations and problems, and not succeeded in providing data for science education policy making and curriculum reform. The major purpose of the study is developing national level science knowledge assessment system in order to identify longitudinal trends of elementary and secondary school students science knowledge achievements. The research team consisted of science education experts and teachers from various school levels, decided the directions and major elements of national level science knowledge assessment with the consultation of educational evaluation experts. Item developing ability of the researchers was improved by seminars? and workshops on national assessment in advanced nations and developing skills of writing science items. Nearly 500 items were developed and revised. Pilot test was administered with 958 students at various school levels. 380 items were selected and tested with 8766 students, and the characteristics were analyzed in terms of item response theory. The target populations for national level science knowledge assessment are 5th-grade of elementary school, 2nd-grade of middle school, 1st and 2nd-grade of high school students. The proper period for the assessment is February every year. Multi-stage clustered sampling method is desirable and rotated forms are recommendable for the test format. Bridge items should be introduced to compare the results of multiple tests, and various grades. Anchor items should also be used for longitudinal interpretations of the results. The items for elementary school require low to medium abilities, for middle school and first grade of high school require medium to high abilities and for 2nd-grade of high school high abilities. The discrimination ability of the items developed is high.