• Journal of the Korean earth science society
• /
• v.26 no.6
• /
• pp.511-523
• /
• 2005

The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

• The Journal of the Korea Contents Association
• /
• v.16 no.7
• /
• pp.50-62
• /
• 2016

The aim of this study was to develop scale of test taker to affect on process of selection of college. The study procedures were performed as follow : establish of study model, item generation, verification of content validity, 1st and 2nd pilot test and verification of construct validity and reliability. In order to verification of validity and reliability, 230 freshman were surveyed and the data were analyzed by mean, standard deviation, skewness. kurtosis, Pearson correlation, Verimax factor analysis and Cronbach's ${\alpha}$. As result of factor analysis, the 15 factors(61 items) that explain 68.37% of the total variance were extracted and each factors were classified by attribution as follow : Information collection-mass media(4items), college activity (3items), support and environment(4items), education(5items), Influential person on decision making(3items), education quality(4items), education service(5items), reputation(3items), accessibility(2items), personal circumstances(2items), college's mass media(5items), promotion (4items), on-line(4items), person's PR (3items), College image(10items). Cronbach's ${\alpha}$ of total items was 0.916 and Cronbach's ${\alpha}$ of each factors were showed range between 0.694~0.878. Measurement scale of this study may be utilized to collect basic data be required to establish policy strategy of local college be faced with difficulty of admission recruitment.

• Journal of the Korean earth science society
• /
• v.24 no.3
• /
• pp.150-159
• /
• 2003

This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.

• Korean Journal of Health Psychology
• /
• v.19 no.1
• /
• pp.407-420
• /
• 2014

In this study, a Korean abbreviation scale to measure love and compassion toward other person was developed based on a critical review on Compassionate Love Scale(CLS; Sprecher, & Fehr, 2005). In the study 1, 12 items were selected from the original version of 21 item CLS by surveying a sample of 207 college students on the basis of several psychometric characteristics (i.e., discriminability, coefficient of factor loading, and contribution to internal consistency). In the study 2, the validity of 12 item version, ACLS (Ajou Compassionate Love Scale), was confirmed by examining the factor structure, reliability, and correlations with other related scales. The results clearly showed that ACLS not only had a sufficient psychometric properties as the CLS, but also superior to the CLS in terms of parsimoniousness. Limitations and implications for future research of ACLS were discussed.

• Journal of Digital Convergence
• /
• v.15 no.12
• /
• pp.517-529
• /
• 2017

The purpose of this study is to develop and evaluate the scale for university students' health behaviors. This research is based on Roger's(1975) Protection Motivation Theory and Weinstein(1988)'s Precaution Adoption Process Model as theoretical frameworks. The contents of the scale were first abstracted from personal depth interviews of qualitative study on university students' health behavior experiences and review of its related literature. The initial items consisted of 76 behavior questions and 34 perception questions. After conducting the preliminary test, 33 behavior questions and 24 perception questions were selected for the final test by revisions on the basis of the result of the content validity test and the item understanding test. The questionnaires for the final test were distributed to 400 students enrolled in three universities. The questionnaires collected from 373 participants were analyzed by the SPSS program. From the examination of construct validity, item correlation, and factor relation turned out to be relevant. Five factors were determined from 27 items with a cumulative explained variance of 54.498 %. After examining reliability and validity of the collected dat, 27 items were finalized as the scale for university students' health behaviors.

• Communications of Mathematical Education
• /
• v.18 no.2 s.19
• /
• pp.239-250
• /
• 2004

수학적 힘의 함양과 문제해결력의 신장을 위한 수학교육에서 확률영역은 중요한 학습소재임에도 불구하고, 확률영역은 어려운 것으로 고착되었다. 이 연구에서는 학생들이 확률영역의 어떤 부분을 어려워하고 이해하기 힘들어하는지를 구체적 문항분석을 통하여 알아봄으로서 교수-학습의 기초자료를 제공하고자한다. 이를 위하여, 지난 10년간 출제되었던 대학수학능력시험의 확률영역 16문항을 고등학교 학생 220명에게 실시하고, 고전검사이론과 문항반응이론울 적용하여 그 결과를 분석하였다. 고전검사이론에서는 신뢰도와 변별도를 측정하였고, 문항반응이론에서는 Rasch 1-모수 문항반응모형에 근거한 BIGSTEP을 사용하여 내적타당도와 난이도를 측정하였다.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.4
• /
• pp.39-49
• /
• 2007

The purpose of this study is to provide analysis resources to develop high standard questions by analyzing item characteristics and item usability of 'Basic course of Information Technology' in the College Scholastic Ability Test, For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty, item discrimination, item reliability, and distracters. As a result of analyzing tests in 2005 and 2006, questions were equally extracted from educational contents. However, the standard of questions were in need of revision. The development of high quality contents in Vocational Education Section was needed in order to meet to the College Scholastic Ability Test standards. Therefore, it is required to develop various difficulties and acceptable distinguishable questions.

• Journal of Christian Education in Korea
• /
• v.64
• /
• pp.409-444
• /
• 2020

The purpose of this study is to develop and propose a tool for accurately diagnosing factors influencing academic activities in Christian University. The first, the evaluation area is composed of factors that influence the academic life of students. Then, by developing a tool to diagnose the status in that areas, it is intended to provide a basis for providing appropriate help for students to adjust to university life. This tool composed items through prior research and developed a draft of tool through Delphi research. The draft tool was verified for reliability and validity by analyzing the response values of 182 freshmen at K University. As a result of the analysis, the reliability showed high reliability of .869~.955 for each diagnosis area. In conclusion, through the results of EFA and CFA, a final diagnostic tool was developed and suggested.

• 한국노년학
• /
• v.29 no.1
• /
• pp.117-134
• /
• 2009

The purpose of this study was designed to develop an questionnaire for healthy aging. The subjects of this study were total 335 people who participated in regular exercise and went to welfare centers in Seoul. The validity and reliability were tested for verifying the developed questionnaire for healthy aging. The data were collected between June 12, 2006 and October 27, 2006. The mean, standard deviation, kurtosis, skewness, reliability, exploratory factor analysis and confirmatory factor were analyzed for statistical purpose using by SPSS-Win 12.0 program. The results were as follows; First, to obtain content validity, the results of previous research and the value system responses were submitted to a judgement group. Second, the results of the factor analysis of the 20 items making up the questionnaire were classified into the following 3 factors; physiological health(6 items), cognitive-mental health(6 items), social-support health(8 items). Third, the reliability of the questionnaire for healthy aging was 0.891(Cronbach's alpha). In the factor analysis Cronbach's alpha correlations for the 4 factors ranged from 0.642 to 0.885. Fourth, the results of confirmatory factor analysis, all the index values(NFI, RFI, CFI, Delta 2 IFI) were close to 1. Thus, this questionnaire demonstrated good reliability and validity and therefore it was an appropriate measurement of healthy aging.

• The Journal of the Korea Contents Association
• /
• v.17 no.4
• /
• pp.520-531
• /
• 2017

The purpose of this study was to test the validity and reliability of the Korean version of the Tuberculosis Interview Instrument (K-TII). The instrument was first translated into Korean, back-translated to English, and reviewed. After the translation process, the instrument was revised from 52 items to 37 items by researchers and an expert according to the systematic review. In addition, these items were reduced to 32 items after the content validity test was done by 9 experts. As a result of pilot study conducted in 20 early childhood teachers, 32 items were selected for the preliminary instrument. Data collected from 289 early childhood teachers were used to test the validity and reliability of the preliminary instrument. The result of factor analysis showed that the instrument categorized into 7 factors explaining 71% of the total variance and 27 items were retained for the final instrument. The result of Cronbach's ${\alpha}$ coefficient was .88. In conclusion, the K-TII may be a suitable instrument for assessing tuberculosis prevention behaviors in early childhood teachers in Korea.