• Journal of Convergence for Information Technology
• /
• v.10 no.3
• /
• pp.115-125
• /
• 2020

Problem-Based Learning is the most commonly used teaching method in the field of education as the demand for talented people with creative problem-solving abilities has increased in recent society. In this study, we developed a tool that can simply and regularly measure the learning effects of applying Problem-Based Learning on the classroom. Twenty-two preliminary items for the development were constructed by gathering expert opinions about items collected in existing research of Problem-Based Learning effects measurement. Using this preliminary items, data were collected from 124 students who took the subject-based study. And the validity and reliability were verified through Rash analysis. 11 of 124 students and 1 of 22 items were found to nonconforming and excluded. In addition, the optimal scale for the configuration of this tool was found to be a four-point scale, and the reliability of separation on the subject and the item was found to be excellent. We hope that the assessment tools of Problem-Based Learning effectiveness developed in this study will be actively used to measure learning effectiveness and manage the quality of education.

• Korean Journal of Culture and Social Issue
• /
• v.30 no.2
• /
• pp.159-192
• /
• 2024

The purpose of this study is to validate the Reactive-Proactive Aggression Questionnaire (RPQ), a tool for measuring reactive-proactive aggression, in the context of South Korea. A thorough translation was conducted in collaboration with the original author. An exploratory factor analysis (EFA), exploratory structural equation modeling (ESEM), rating scale model (Rasch), differential item functioning (DIF), and convergent validity were performed on a sample of 510 South Korean individuals. The results revealed a two-factor structure of reactive and proactive aggression after removing one item showing dual loading. Rating scale analysis based on the Rasch model indicated the appropriateness of the 3-point Likert scale, with all items meeting fit criteria. Although the separation index and separation reliability of proactive aggression was marginally lower, the overall discrimination between participants and items was satisfactory. Examination of participant-item distribution indicated a suitable alignment between reactive aggression and participant ability levels, whereas proactive aggression exhibited slightly elevated item difficulty. Furthermore, three items were found to function differently based on gender. A moderate but statistically significant positive correlation was found between the Barratt Impulsiveness Scale-11-R (Korean version) and RPQ from the results of the convergent validity evaluation. Overall, this study employed rigorous statistical methods to validate the suitability of the RPQ for use in Korea, taking cultural nuances into account, and introduced the concepts of reactive and proactive aggression to the Korean general population.

• The Journal of the Korea Contents Association
• /
• v.15 no.10
• /
• pp.354-361
• /
• 2015

The purpose of this study is to investigate validation of the Recovery Assessment Scale(RAS) for Korean Version using Rasch analysis. This study included 60 patients who had chronic schizophrenia and were aged 18 or older. The data were analysed using a Rasch analysis to investigate whether the persons and items fit, the distribution of item difficulty and the appropriateness of the rating scale. 1 out of 60 subjects were found to not fit. 3 out of 24 items were also found to be misfit. The misfitted items was 'I believe that I can meet my current personal goals','Even when I don't care about myself, other people do. ','Coping with my mental illness is no longer the main focus of my life.'. Of the appropriate items, the most difficult was 'I can handle what happens in my life' and the easiest was 'Something good will eventually happen'. The RAS rating scale was shown to be appropriate for patients who had chronic schizophrenia. The item separation reliability was .70, and the person separation reliability was .94. Further studies are needed to investigate validity and criterion cut-off score for many patients with chronic mental illess.

• Physical Therapy Korea
• /
• v.18 no.2
• /
• pp.35-42
• /
• 2011

Three hundred and fourteen low back pain patients completed the Korean version of the Oswestry Disability Questionnaire (KODQ) and the Rasch analysis was then applied to identify the inappropriate items and to determine ODQ item difficulties according to a subject's characteristics. For women and youths, the 'sex life' item showed misfit statistics, whereas for older subjects it was the 'pain intensity' and 'standing' items. Also, in the acute low back group the 'pain intensity', 'standing' and 'sex life' items showed misfit statistics. For all subjects, the most difficult item was 'pain intensity', whereas the easiest item was 'walking'. But for the older and acute groups 'lifting' was the most difficult item and for those who have a visual analogue scale score of 3 or less 'sitting' was the most difficult item. These results show that differential item functioning is present in several items according to sex, age, acute and chronic pain, and VAS score. This study may be useful for adjusting the KODQ item difficulties for low back pain patients with different characteristics.

• Physical Therapy Korea
• /
• v.17 no.2
• /
• pp.51-59
• /
• 2010

The Functional Independence Measure (FIM) is widely used to determine the dependency of activity of daily living in rehabilitation patients. The purposes of this study were to evaluate the unidimentionality of the FIM physical items and to analyze the validity of cross-functional levels in stroke survivors in Korea. Thirteen physical items of FIM were rated according to an ordinal scale of a 7-level classification. Two hundred and seventy-nine patients participated in the study (age range 18~92 years and 57% male). Six items-eating, bladder control, bowel control, transfer to and from the bed/wheelchair, transfer to and from the toilet, and bathing-showed misfits with the Rasch model. The most difficult item was 'bathing', the easiest item was 'bowel control'. Although there were several differences within functional levels, the hierarchical order of item measures was rather similar. 'Bathing' was the most difficult in high level patients (above 60), however 'stairs' was most difficult in the middle level (41~60) group. In the low level group (below 40), 'toileting' was the most difficult. In conclusion, the present study has shown several differences of item difficulty among functional levels. This result will be useful in planning interventions, and developing rehabilitation programs for stroke survivors.

• Physical Therapy Korea
• /
• v.13 no.3
• /
• pp.49-56
• /
• 2006

This study was designed to examine, using Rasch analysis, the rating scale performance of the Korean version of the Berg Balance Scale (BBS). The subjects were 95 elderly people at community dwelling. Subjects (19 men, 76 women) ranged in age from 65 to 91 years. Rasch analysis was then done by means of the Winsteps program to determine the validity and reliability of the Korean version of the BBS evaluation tools for elderly people. The results were as follows: Twenty-one elderly people were excluded for misfit persons. Three items were found to be misfits and the order of item difficulty of the remaining 11 items was arranged. Elderly people BBS ability is indicated by -.94~7.41 logit, and the transformation formula is score=(logit score+.94)/$(.94+7.41){\times}100$. This transformation formula can be applied to Korean elderly people for balance ability. In the order of difficulty of evaluation items, the most difficult item was "Standing on one foot" and the easiest item was "Standing to Sitting". In conclusion, the Korean version of BBS evaluation tool for the elderly people has been proved valid and will be useful in clinical practice and research in Korea.

• Physical Therapy Korea
• /
• v.18 no.3
• /
• pp.94-102
• /
• 2011

The purpose of this study was to review existing assessment tools for patients with low back pain and improve them through combination. A total of 314 patients with low back pain participated. Their condition was assessed using the Oswestry Disability Questionnaire (ODQ), the Quebec Back Pain Disability Scale (QBPD), and the Back Pain Functional Scale (BPFS). Rasch analysis was applied to identify inappropriate items, item difficulties, and the separation index. In this study, the 'sex life' item of the ODQ (10 items) and the 'sleeping' item of the BPFS (12 items) showed misfit statistics, whereas all items of the QBPD (20 items) were appropriate. After combining the ODQ, QBPD and BPFS, Rasch analysis was applied. The 'pain intensity', and the 'sex life' item of the ODQ and the 'throw a ball' item of QBPD showed misfit statistics. These 3 items were retained for further analysis. The remaining 42 combined ODQ-QBPD-BPFS items were arranged according to difficulty. For all subjects, the most difficult item was 'pain intensity', whereas the easiest was 'take food out of the refrigerator'. As the separation index of 42 combined ODQ-QBPD-BPFS was higher than that of the three questionnaires separately, difficulty of items varied with some need for rearrangement. The results of this study confirmed the possibility and need for a new back pain disability assessment tool, and produced one. Further study is needed to refine the questionnaire in consideration of psychosocial and occupational factors.

• Korean Journal of Cognitive Science
• /
• v.19 no.3
• /
• pp.223-255
• /
• 2008

In this paper, we introduce an automatic system of scoring English essays. The system is comprised of three main components: a spelling checker, a grammar checker and a lexical cohesion checker. We have used such resources as WordNet, Link Grammar/parser and Roget's thesaurus for these components. The usefulness of an automatic scoring system depends on its reliability. To measure reliability, we compared the results of automatic scoring with those of manual scoring, on the basis of the Kappa statistics and the Multi-facet Rasch Model. The statistical data obtained from the comparison showed that the scoring system is as reliable as professional human graders. This system deals with textual units rather than sentential units and checks not only formal properties of a text but also its contents.

• Physical Therapy Korea
• /
• v.24 no.1
• /
• pp.41-50
• /
• 2017

Background: The Pediatric Balance Scale (PBS) was developed to assess of balance ability in children with balance problem. The PBS was translated into Korean and its reliability had been studied. However, it had need to be verified using psychometric characteristics including item fit and rating scale. Objects: The purpose of this study was to investigate the item fit, item difficulty, and rating scale of the Korean version of PBS using Rasch analysis. Methods: In total, 40 children with cerebral palsy (CP) (boy=17, girl=23) who were diagnosed with level 1 or 2 according to the Gross Motor Function Classification System participated in this study. The PBS was performed, and was verified regarding the item fit, item difficulty, rating scale, and separation index and reliability using Rasch analysis. Results: In this study, the 'transfer', and 'turning to look behind left and right shoulders while standing still' item showed misfit statistics. in total 40 children with CP. Also, 'transfer', 'standing unsupported with feet together' and 'standing with one foot in front' items showed misfit statistics in diplegia CP group. Regardless of the classification of CP, the most difficult item was 'standing on one foot', whereas the easiest item was 'sitting with back unsupported and feet supported on the floor'. The 4 rating scale categories of PBS were acceptable with all criteria. Both item and person separation indices and reliability showed acceptable values. Conclusion: The PBS has been proven reliable, valid and is an appropriate tool, but it needs to modify the items of PBS according to CP classification.

• Research in Vestibular Science
• /
• v.17 no.4
• /
• pp.152-159
• /
• 2018

Objectives: The Korean Dizziness Handicap Inventory (KDHI), which includes 25 patient-reported items, has been used to assess self-reported dizziness in Korean patients with Parkinson disease (PD). Nevertheless, few studies have examined the KDHI based on item-response theory within this population. The aim of our study was to address the feasibility and clinimetric properties of the KDHI instrument using polytomous Rasch measurement analysis. Methods: The unidimensionality, scale targeting, separation reliability, item difficulty (severity), and response category utility of the KDHI were statistically assessed based on the Andrich rating scale model. The utilities of the orderedresponse categories of the 3-point Likert scale were analyzed with reference to the probability curves of the response categories. The separation reliability of the KDHI was assessed based on person separation reliability (PSR), which is used to measure the capacity to discriminate among groups of patients with different levels of balance deficits. Results: Principal component analyses of residuals revealed that the KDHI had unidimensionality. The KHDI had satisfactory PSR and there were no disordered thresholds in the 3-point rating scale. However, the KDHI showed several issues for inappropriate scale targeting and misfit items (items 1 and 2) for Rasch model. Conclusions: The KDHI provide unidimensional measures of imbalance symptoms in patients with PD with adequate separation reliability. There was no statistical evidence of disorder in polytomous rating scales. The Rasch analysis results suggest that the KDHI is a reliable scale for measuring the imbalance symptoms in PD patients, and identified parts for possible amendments in order to further improve the linear metric scale.