• Journal of Families and Better Life
• /
• v.12 no.2
• /
• pp.60-67
• /
• 1994

본 연구는 아동의 자기-효능감을 측정할 수 있는 검사도구를 개발하는데 그 목적을 두고 있다 연구대상자는 554명의 국민학교 5, 6학년 아동들로서, 선행연구를 중심으로 구성 한 문항들에 대한 몇 차례의 예비조사를 통하여 최종 23문항을 선정하였고 척도 구성을 위 한 검증 결과는 다음과 같다. 척도의 문항 양호도 검증을 위한 문항의 반응율과 변별도 분 석결과는 대체로 양호하게 나타났으며 척도의 타당도 검증을 위한 요인분석 결과 본 검사도 구가 세 요인으로 구성되어 있는 것으로 확인되었다. 신뢰도 분석 결과는 Cronbach's a 값 이 .62에서 .79로 나타났다.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Journal of The Korean Association For Science Education
• /
• v.28 no.1
• /
• pp.32-46
• /
• 2008

The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.16 no.6
• /
• pp.295-303
• /
• 2016

The purposes of this study are to describe the process for the instrument construction and the development of scales on rating college students' adaptability and to analyze the technical qualities of the test. The primary goal of this study is to inform students and institutions what is needed to college student's adjustment process into university and college life. The scales are tested by specialty group and statistical methods, and finally composed of 142 items, which measures 8 scales, the academic integration, the social integration into college, career identity, emotional stability, learning condition's stability, relationship with professors, satisfaction degree of educational service, satisfaction degree of college education. This study analyzed 1,959 students' responses from 4 colleges and universities. This study confirms that the scales which this study developed show high concurrent evidence with the college student's adaptability inventory for Korean university and college students based on various development process, specially rapid great change of college. The result of factor analysis shows the evidence based on internal structures of the scales. The Cronbach's ${\alpha}$ of the subscales is .965, from 742 to .937. The prediction model to determine the possibility of dropout by 7 scales is statistically significant in .05, except learning condition's stability. According to CFA Model, RMSEA= .08~.09. dependence factor variance are explained by this study's CFA model. In conclusion, this study confirms that the scales which this study developed are valid and reliable instrument for Korean university and college students to predict their adaptability to college.

• Communications of Mathematical Education
• /
• v.18 no.1 s.18
• /
• pp.191-199
• /
• 2004

본 연구에서는, 6년 전에 개발된 수학 창의적 문제 해결력 검사(MCPSAT; 한국교육개발원(김흥원 외, 1997))에 대한 현시점의 적합성여부를 알아보기 위하여 이 검사의 중학교 1-3학년용 A형 1부 검사와 고등학교 1-2학년용 A형 1부 검사를 해당 학년 학생들에게 적용하여 분석하였다. 검사도구의 양호도는 비교적 좋은 것으로 나타났다. 즉, 중학교와 고등학교 모두 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수가 약간 떨어져 있지만 비교적 양호한 것으로 볼 수 있으며 변별도는 점이연 상관 계수가 0에 가까운 문항이 없는 것으로 나타났다. 따라서 모든 문항이 학생들의 수학 창의적 문제 해결력을 변별해 줄 수 있을 것으로 생각한다. 내적 타당도는 중학교의 경우 관대하게 본다면 수용할 만 하고, 고등학교의 경우 아직은 우려할 수준은 아니다. 즉, 중학교 문항 1과 문항 4는 적합도 지수 1.2를 상회하였으나 Infit과 Outfit 모두 1.5를 넘는 문항은 없었다. 고등학교의 문항 4는 문항의 적합도 지수 1.2를 상회하는 것으로 나타나고 있으나 Infit과 Outfit 모두 1.2를 상회하지 않았다. 난이도 측면에서 볼 때, 이 검사의 계속 사용은 염려스러운 면이 있다. 즉, 중학교에서는 6년 전 보다 쉬운 것으로 나타나고 있는 바 이것은 현재의 학생들이 이러한 유형의 문항을 많이 접하였을 것으로 추측할 수 있다. 고등학교에서는 6년 전 보다 조금 더 어려워 졌다고 볼 수 있다. 위의 사항을 종합할 때, 수학 창의적 문제 해결력 검사에서 중학생용은 현재의 학생들의 수준을 고려하여 재 표준화하는 것이 바람직하고, 고등학생용은 개발 당시의 신뢰도, 난이도, 변별도 등에서 유사하므로 당분간 계속 사용하여도 될 것이다.

• Journal of Science Education
• /
• v.34 no.1
• /
• pp.155-163
• /
• 2010

The purpose of this study was to analyze the items that were used in entrance examination for science gifted education center for elementary school students by using content analysis and classical item analysis. In content analysis, objective type items exhibited matter and interpreting data were dominant. And essay type items consisted of creativity items, evaluated creative problem solving ability. Item difficulty and discrimination index, on the whole, were appropriate. Comparing with objective type, essay type has higher discrimination index. In correlation analysis between total score and score of each type of items, total score has the highest correlation with matter items, interpreting data and creativity.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2007.11a
• /
• pp.609-612
• /
• 2007

정보사회와 컴퓨딩환경의 발전으로 언어, 학력, 인지도 등의 평가도구로서 컴퓨터기반의 평가환경이 보편화되었다. 특히 컴퓨터기반의 학력평가 환경을 위해서는 문항의 난이도와 변별도 등 문항의 특성을 정확히 분석하는 것이 필수적이다. 문항분석은 컴퓨터기반의 평가를 위한 양질의 문제은행 구성 및 문항과 수험자 능력의 정확한 추정과 체계적이고 과학적인 평가를 위한 전제조건이라 할 수 있다. 본 논문에서는 고전평가이론의 문제분석을 적용한 문제은행 시스템을 구현하였으며 수험결과를 분석하여 각 문제의 곤란도나 변별도, 문항분포도를 통하여 문제를 분석할 수 있도록 하였다. 또한 수험자가 각 문제를 푸는데 걸린 시간을 기록하여, 수험자의 문제에 이해도를 정확히 분석하고 수험자의 추측, 랜덤 선택 등으로 인한 정답을 맞힐 가능성과 한 문제를 읽고 이해하는 시간이 너무 오래걸린 이유에 대해서도 추정하였다. 문제분석 및 수험결과의 평가 및 분석으로 교사들은 문항의 양호도를 높일 수 있고 문제은행에 저장되어 있는 문항들을 수정하고 보완하여 양질의 문항을 출제할 수 있도록 하였다.

• Communications of Mathematical Education
• /
• v.16
• /
• pp.201-215
• /
• 2003

이 연구에서는 창의적인 문제해결능력을 검사하는 도구로 널리 알려진 개방형 문항 5 문제를 수정 또는 번역하여 중학교 2학년 학생들에게 적용하고 그 결과를 분석하였다. 검사도구에 대한 양호도 분석 결과는 다음과 같다. 첫째, 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수는 0.8이다. 둘째, 문항반응이론에 근거한 문항의 적합도 지수는 모두 1.2미만으로서 분석모형에 적합한 문항이라고 볼 수 있다. 또한, 문항간의 난이도의 차이는 로짓트 점수가 0.6을 넘지 않은 범위에서 골고루 분포되어 있다. 셋째, 문항 신뢰도 지수가 모두 0.80보다 높은 것으로 나타나 사용된 문항들은 서로 잘 분리되어 창의적 문제해결력을 추정하고 변별하는데 무리가 없다. 학생들의 반응에 대한 분석 결과는 다음과 같다. 문항1에서 곡선을 이용한 반응은 영재학생들에서만 발견할 수 있었다. 문항2에 대한 각 반응의 독창성 점수는 모두 0이다 이것은 문항2가 널리 알려진 문제에 기인한 것으로 해석된다. 문항3은 영재학생들이 더 많은 반응을 보인 것으로 모든 반응이 독창성 점수를 부여받았다. 문항4에 대하여 일반학생들은 거의 반응을 하지 못하였다. 문항5는 대부분의 학생이 반응을 하였으며 반응의 종류도 가장 다양하였다.

• Archives of design research
• /
• v.12 no.2
• /
• pp.121-130
• /
• 1999

The purpose of this study is to provide standardization on the examination that could measure students' diagrammatic creativity at design college. For this purpose, we tested college students, who was selected by educational system, regional, and grade groups to use the examination, and suggested the standardization criterion by analyzing these data. The data analysis procedures of this study consist of three step, the first that was to investigate the goodness of the examination paper, second step was to measure the reliability and the validity for the goodness of questions, the last step was to suggest the standardize scores for standardization on the examination. The results of the goodness and standardization analysis showed three structural factors(fluency, flexibility, originality) of this examination were proper to measure the diagrammatic creativity, and the proposed examination tool seemed to be good enough to apply in practice.

• Korean Journal of Childcare and Education
• /
• v.10 no.3
• /
• pp.137-158
• /
• 2014

The present study aimed to develop an instrument to assess young children's understanding of science inquiry skills. For the purposes of the study, based on analysis of literature and evaluation tools related to young children's science inquiry skills, five categories of understanding science inquiry skills including observing, classifying, predicting, measuring, and discussing were selected. Then 30 test items were developed and verified three times through opinions from science education and early childhood education professionals and teachers. Finally, a total of 19 test items within five categories were developed. The 19 items' item difficulty, item discrimination, and item internal consistency were verified statistically. In addition, concurrent validity and test-retest reliability of the items were verified by the significant correlation coefficients. The instrument developed in this study was administered to 300 children who were 3, 4, and 5 years old. The results showed that 5 year old children had better competence to understand science inquiry skills than 4 and 3 year old children, while there were no differences in the competence between boys and girls.