• School Mathematics
• /
• v.9 no.2
• /
• pp.223-240
• /
• 2007

The purpose of this study was to investigate the degree to which the middle school mathematics curriculum matched the item difficulty levels of representative mathematics items. The items used in this study were developed for the National Assessment of Educational Achievement. Ranks for difficulty values of the 60 multiple-choice item were calculated via both Classical Test Theory and Item Response Theory and correlated with the rank order of the mathematics content and cognitive domains sequence. There are six content domains; number and operation, algebra, measurement, figure, pattern and function, and probability and statistics. The cognitive domains include computation, understanding, reasoning and problem-solving. Results suggest a congruence between cognitive domain's sequence and item difficulty levels of items based on that sequence. This finding indicates that the linear or hierarchical assumptions concerning the sequence appears to be reasonable. The characteristics of items that were exceptions to this trend were addressed.

• Physical Therapy Korea
• /
• v.23 no.2
• /
• pp.35-43
• /
• 2016

Background: The Functional Gait Assessment (FGA) was developed to measure of gait-related activities. The FGA was translated in Korean but only a few psychometric characteristics had been studied. Objects: The purpose of this study was to evaluate the validity and reliability of the Korean version of FGA scale using Rasch analysis. Methods: The study included 120 patients with stroke (age range=30~83 years; mean${\pm}$standard deviation=$58.3{\pm}11.1$). The FGA and Berg Balance Scale were performed, and were analysed for dimensionality of the scale, item difficulty, scale reliability and separation, and item-person map using Rasch analysis. Results: The 4 rating scale categories of FGA were satisfied with optimal rating scale criteria. The most items of the FGA showed sound item psychometric properties except 2 items ('gait with the horizontal head turns', and 'gait with narrow base of support'), and the 2 misfit items were excluded for all further analyses. The 8 items were arranged in order of difficulty. The most difficult item was 'gait with eyes closed', the middle difficult item was 'gait level surface', and the easiest item was 'gait with vertical head turns.' A person separation reliability was .93 and the person separation index was 3.57. Conclusion: This study suggests that the 8-item Korean FGA are valid measure of assess the gait-related balance performance, and to set the goal of rehabilitation plan in patient with stroke.

• Journal of Korean Academy of Nursing
• /
• v.45 no.1
• /
• pp.107-117
• /
• 2015

Purpose: The purpose of this study was to evaluate the psychometric properties of the Korean version of the Alzheimer's Disease Knowledge Scale (ADKS-K) to determine its applicability to Korean adults. Methods: Cross-cultural validity was performed according to Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN). The Kuder-Richardson Formula 20 for internal consistency and Intraclass Correlation Coefficient (ICC) for test-retest reliability were conducted. Content validity, criterion related validity and construct validity were evaluated. The Classical Test Theory (CTT) model and the Item Response Theory (IRT) model were applied in performing the item analysis. Results: The KR 20 was .71, and the ICC was .90, indicating that the ADKS-K has internal consistency and stability reliability. Thirty items of the ADKS-K had significant Content Validity Ratio (CVR) values, i.e., mean of 0.82 and range of 0.60~1.00. Mean item difficulty and discrimination indices calculated by TestAn program were 0.63 and 0.23, respectively. Mean item difficulty and discrimination indices calculated by BayesiAn program were -0.60 and 0.77, respectively. These tests indicate that ADKS-K has an acceptable level of difficulty and discriminating efficiency. Conclusion: Results suggest that ADKS-K has the potential to be a proper instrument for assessing AD knowledge in Korean adults.

• Education of Primary School Mathematics
• /
• v.8 no.2 s.16
• /
• pp.61-68
• /
• 2004

The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

• Journal of The Korea Institute of Healthcare Architecture
• /
• v.17 no.4
• /
• pp.25-37
• /
• 2011

As International considerations about the Barrier-Free environment increase, Korean Barrier-Free Environment Certification System has operated since 2008 in Korea. The purpose of this study is to find way to improve evaluation items, so this study analyzed the result of examination certified facilities and investigated the importance of the evaluation item for conducted a questionair survey with the BF experts. As a result, a lower scored and high important item should assign a higher score or lower the difficulty level, so induces applicants to be certified. Second, a higher scored and lower important item should assign a lower score or increase the difficulty of evaluating. The results suggested are expected the use in the improvement direction of BF certification evaluation items.

• Research in Mathematical Education
• /
• v.11 no.4
• /
• pp.275-283
• /
• 2007

In this study, we gave 132 high school students fifteen probabilities and nine statistics problems of the Korean College Scholastic Aptitude Test and then analyzed their answer using the classical test theory and the item response theory. Using the classical test theory (the Testian 1.0) we get the item reliability ($0.730 \sim 0.765$), and using the item response theory (the Bayesian 1.0) we get the item difficulty ( $-2.32\sim0.83$ ) and discrimination ( $0.55\sim 2.71$). From results, we find out what and why students could not understand well.

• Journal of Korea Multimedia Society
• /
• v.10 no.7
• /
• pp.912-922
• /
• 2007

Evaluation of distance teaming systems needs a method that maintains a consistent level of difficulty for each test. In this paper, we propose a new algorithm for test sheet generation based on genetic algorithm. Unlike the existing methods that difficulty of each test item is assigned by tutors, in the proposed method, that can be adjusted by the result of the previous tests and the average difficulty of test sheet can be consistently reserved. We propose the new genetic operators to prevent duplications of test items in a test sheet and apply the adjusted difficulty of each test item. The result of simulation shows that difficulty of the test sheet generated by proposed method can be more regular than the random method and the simulated annealing method.

• Journal of the Korean Data and Information Science Society
• /
• v.22 no.3
• /
• pp.487-494
• /
• 2011

The purpose of this study was to investigate self-esteem item goodness-of-fit in sports talented children with socio-psychological aspect, which may be a basis of developing global sports leaders. Fifty children who were selected by 2010 sports talent identification program at Korea National Sport University participated in this study. All participants were asked to answer the questionnaire using Rogenberg (1965) self-esteem scale. Total 8 questions were used with 4 point Likert scale and high point stands for higher self-esteem status. Reliability of Cronbach's ${\alpha}$ was.785 in this study. Frequency analysis, descriptive statistics, and reliability analysis were conducted with SPSS 18.0. WINSTEPS 3.70 (Linacre, 2010) was used for calculating item goodness-of-fit and subject reliability, scale propriety, item goodness-of-fit and item level of difficulty, and level of difficulty were calculated. Statistical analysis showed results as follows. First, it was reported to be suitable for subject reliability in self-esteem as 1.01~1.03 and item reliability as 1.01~1.01. Second, 4 scale was suitable for scale propriety resulting from stage index judgment. Third, 2,7,8 and 3 question showed problems in item goodness-of-fit and item level of difficulty. Finally, scale propriety was reported to be inappropriate for considering sports talented children's ability distribution and scale level of difficulty.

• Physical Therapy Korea
• /
• v.17 no.1
• /
• pp.43-52
• /
• 2010

The Dynamic Gait Index (DGI) was developed and widely used as a clinical tool to assess balance performance during gait. The purpose of this study was to validate the Korean translated DGI using Rasch analysis. A total of 105 community-dwelling elderly was participated in this study (age range = 65~95 years; mean = 78.0 years). The translated DGI showed sound item psychometric properties, and the 8 items were arranged in order of difficulty for the total participants. The most difficult item was 'Steps' and the easiest item was 'Level surface'. Also, each of the original 4 rating scale categories satisfied the Linacre's essential criteria suggestions for optimal rating scale category effectiveness. Although, thirty eight person (36.2%) showed the maximal high score, but the most of them was no history of fall in the preceding year. For subjects who has falling history, all of the person's ability was arranged within the item's difficulty. The 8-item Korean translated DGI can be used to measure gain in elderly person with balance disorders without compromising important clinical measurement characteristics in Korea.

• Journal of Korea Society of Industrial Information Systems
• /
• v.27 no.2
• /
• pp.11-24
• /
• 2022

For the questions asked for LMS-based online evaluation the professor directly set exam questions, or use the automatic question-taking method according to the level of difficulty using the question bank divided by category. Among them, it is important to manage the difficulty of questions in an objective and efficient way, above all, in the automatic question-taking method according to difficulty. Because the questions presented to the evaluators may be different. In this paper, we propose an difficulty re-adjustment algorithm that considers not only the correct rate of a problem but also the time taken to solve the problem. For this, a logistic regression classification algorithm was used of machine learning, and a reference threshold was set based on the predicted probability value of the learning model and used to readjust the difficulty of each item. As a result, it was confirmed that there were many changes in the difficulty of each item that depended only on the existing correct rate. Also, as a result of performing group evaluation using the adjustment difficulty problem, it was confirmed that the average score improved in most groups compared to the difficulty problem based on the percentage of correct answers.