• Title/Summary/Keyword: consistency of responses

Search Result 136, Processing Time 0.026 seconds

Reliability and Validity Study on the Korean Version of the Fullerton Advanced Balance Scale (한국어판 플러턴 어드밴스드 균형 척도의 신뢰도와 타당도 연구)

  • Kim, Gyoung-mo
    • Physical Therapy Korea
    • /
    • v.23 no.1
    • /
    • pp.31-37
    • /
    • 2016
  • Background: The assessment tool developed in other countries should be translated into Korean language using rigorous methodological approaches in order to be used in Korea. Because these procedures are insufficient for establishing the cross-cultural and linguistic equivalence, the need for statistical methods is raised. The Fullerton Advanced Balance Scale was translated into Korean and the content validity was verified through the back translation method, but the reliability and validity have not yet been proven by statistical methods. Objects: The purpose of this study was to investigate the reliability and validity of the Korean version of the Fullerton Advanced Balance Scale (KFAB) by statistical methods in elderly people. Methods: A total of 97 elderly adults (39 males and 58 females) participated in this study. Internal consistency of the KFAB was measured using Cronbach's alpha and an intraclass correlation coefficient (ICC) was used to assess test-retest reliability between the two measurement sessions. Concurrent validity was measured by comparing the KFAB responses with the Korean version of the Berg Balance Scale (KBBS) using the Spearman correlation coefficient. Construct validity of the KFAB was measured using the exploratory factor analysis to evaluate the unidimensionality of the questionnaire. The significance level was set at ${\alpha}=.05$. Results: The internal consistency of the KFAB was found be adequate with Cronbach's alpha (.96), and test-retest reliability was excellent as evidenced by the high ICC (r=.996). Concurrent validity showed high correlation between the KFAB and KBBS (r=.89, p<.001). Construct validity was evaluated using exploratory factor analysis. The result from Bartlett test of sphericity was statistically significant (p<.001), and the value of Kaiser-Meyer-Olkin measure of sampling adequacy was .93. Exploratory factor analysis revealed the existence of only one dominant factor that explained 76.43% of the variance. Conclusion: The KFAB is a reliable, valid and appropriate tool for measuring the balance functions in elderly people.

Validation of the Disaster Adaptation and Resilience Scale for Vulnerable Communities in Vietnam's Coastal Regions

  • Thanh Gia Nguyen;Binh Thang Tran;Minh Tu Nguyen;Dinh Duong Le
    • Journal of Preventive Medicine and Public Health
    • /
    • v.57 no.3
    • /
    • pp.279-287
    • /
    • 2024
  • Objectives: This study validated the Vietnamese version of the Disaster Adaptation and Resilience Scale (DARS) for use in vulnerable communities in Vietnam. Methods: This was a cross-sectional study involving 595 adults from 2 identified communities. The original DARS assessment tool was translated, and the validity and reliability of the Vietnamese version of DARS (V-DARS) were assessed. The internal consistency of the overall scale and its subscales was evaluated using Cronbach's alpha and McDonald's omega reliability coefficients. Confirmatory factor analysis (CFA) was employed to evaluate its construct validity, building upon the factor structure identified in exploratory factor analysis (EFA). Construct validity was assessed based on convergent and discriminant validity. Results: Following the established criteria for EFA, 8 items were removed, resulting in a refined V-DARS structure comprising 35 items distributed across 5 distinct factors. Both alpha and omega reliability coefficients indicated strong internal consistency for the overall scale (α=0.963, ω=0.963) and for each of the 5 sub-scales (all>0.80). The CFA model also retained the 5-factor structure with 35 items. The model fit indices showed acceptable values (RMSEA: 0.072; CFI: 0.912; TLI: 0.904; chi-square test: <0.01). Additionally, the convergent and discriminant validity of the V-DARS were deemed appropriate and satisfactory for explaining the measurement structure. Conclusions: Our findings suggest that the V-DARS is a valid and reliable scale for use within vulnerable communities in Vietnam to assess adaptive responses to natural disasters. It may also be considered for use in other populations.

Semi-Automatic Scoring for Short Korean Free-Text Responses Using Semi-Supervised Learning (준지도학습 방법을 이용한 한국어 서답형 문항 반자동 채점)

  • Cheon, Min-Ah;Seo, Hyeong-Won;Kim, Jae-Hoon;Noh, Eun-Hee;Sung, Kyung-Hee;Lim, EunYoung
    • Korean Journal of Cognitive Science
    • /
    • v.26 no.2
    • /
    • pp.147-165
    • /
    • 2015
  • Through short-answer questions, we can reflect the depth of students' understanding and higher-order thinking skills. Scoring for short-answer questions may take long time and may be an issue on consistency of grading. To alleviate such the suffering, automated scoring systems are widely used in Europe and America, but are in the initial stage in research in Korea. In this paper, we propose a semi-automatic scoring system for short Korean free-text responses using semi-supervised learning. First of all, based on the similarity score between students' answers and model answers, the proposed system grades students' answers and the scored answers with high reliability have been included in the model answers through the thorough test. This process repeats until all answers are scored. The proposed system is used experimentally in Korean and social studies in Nationwide Scholastic Achievement Test. We have confirmed that the processing time and the consistency of grades are promisingly improved. Using the system, various assessment methods have got to be developed and comparative studies need to be performed before applying to school fields.

THE PATIENTS' SATISFACTION FOLLOWING IMPLANT TREATMENT

  • Heo, Yoon-Young;Heo, Seong-Joo;Chang, Myung-Woo;Park, Ji-Man
    • The Journal of Korean Academy of Prosthodontics
    • /
    • v.46 no.6
    • /
    • pp.569-576
    • /
    • 2008
  • STATEMENT OF PROBLEM: While patient-centered outcomes are usually not reported, these may represent major aspects of the implant success for the patient. Use of a well-designed patient survey form can be an invaluable asset to the implant practitioners. PURPOSE: The objective of this study was to investigate patient satisfaction after implant therapy by means of a questionnaire. MATERIAL AND METHODS: South Korean patients (n = 100), who visited the dental examination center of Soon Chun Hyang university hospital, were asked to fill out the satisfaction questionnaire regarding aspects of cost, comfort, esthetics, chewing, gingival health, food impaction, phonetic aspect, screw loosening, and general satisfaction. Responses to statements were given on the Likert response scale. Four experimental groups of patients were distinguished with various location ($A_1,\;A_2,\;A_3$), year ($B_1,\;B_2,\;B_3$), number of implant replacements ($C_1,\;C_2,\;C_3$), and treatment cost ($D_1,\;D_2,\;D_3$). The reliability of the response scales was measured by calculation of its internal consistency, expressed as Cronbach's ${\alpha}$. The scales were distinguished by means of factor analysis method. Possible differences in scale scores among the groups were assessed by One-way ANOVA (${\alpha}$= 0.05). RESULTS: Patients responded to most of the statements with high satisfaction. But the mean scale score of statement about cost was low. After the verification of internal consistency and factor analysis, five components, e.g. general satisfaction, comfort, chewing efficiency, esthetics, and phonetic aspect were grouped together. These components could be explained with common meaning and the first factor was named as 'general satisfaction'. Differences in patient satisfaction on the scale with esthetics were present between patients who have been wearing the implant prosthesis less than three years and those more than seven years ($B_1<B_3$). CONCLUSION: The patients were generally satisfied with the outcome of implant treatment. But the patients' major complaint was high cost and while the statistically significant difference was not shown, the satisfaction scale about food impaction and esthetics was low. So the continuing efforts to make improvements about these problems are needed for the implant practitioners.

A Study on the Differences of Perception between Consumers and Providers about Nursing Service Quality, and the Usefulness of Tools Measuring Nursing Service Quality (간호서비스 질에 대한 지각차이 및 측정도구에 관한 연구)

  • Lee, Mi-Ae
    • Journal of Korean Academy of Nursing
    • /
    • v.30 no.5
    • /
    • pp.1121-1132
    • /
    • 2000
  • Service quality is, unlike goods quality, an abstract and elusive term. However, quality is very important to marketers and consumers in that it has many strategic benefits in contributing to profitability of marketing activities and consumers' problem-solving activities. The main purpose of this study is 1) to explore the differences of perception between consumers and providers about nursing service quality. 2) to identify the useful tool between two tools measuring nursing service quality. To achieve these purposes of the study, the questionnaire was developed and distributed to 210 nurses who worked at seven subjected hospitals in Seoul. Also, 280 people who had a direct experience with the subjected hospital nursing services at the time of screening were involved. They were randomly selected at the seven subjected hospitals during August to September of 1998. Among them, 165 responses from nurses and 229 responses from others resulted in worthy finds. The measurement instrument for a nursing services quality evaluation was modified from the SERVQUAL model originated from Parasuraman, Zeithaml, and Berry (1988). The reliability coefficient of the scale was calculated and showed high degree of internal consistency (Cronbachs' Alpha = .9353). For data analysis, SPSS/PC was used for descriptive statistics, t-test, ANOVA and regression analysis. The results were as follows : 1) In the perception about nursing services quality, there were gap between consumers and providers. Especially the critical attributes in point of perception nursing services quality, naming satisfy, hygiene and performance factors, are very different contents. 2) In the comparison analysis of the usefulness tools it was turned out that SEVPERF model is more appropriate than SERVQUAL model. And in the analysis to identify the construct validity of the tool, it is turned out that the relationship between the constructing factors of the tool and the general satisfaction is significant.

  • PDF

Dynamic Analysis of a KAERI Channel Type Shear Wall: System Identification, FE Model Updating and Time-History Responses (KAERI 채널형 전단벽체의 동적해석; 시스템판별, FE 모델향상 및 시간이력 응답)

  • Cho, Soon-Ho
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.25 no.3
    • /
    • pp.145-152
    • /
    • 2021
  • KAERI has planned to carry out a series of dynamic tests using a shaking table and time-history analyses for a channel-type concrete shear wall to investigate its seismic performance because of the recently frequent occurrence of earthquakes in the south-eastern parts of Korea. The overall size of a test specimen is b×l×h =2500 mm×3500 mm×4500 mm, and it consists of three stories having slabs and walls with thicknesses of 140 mm and 150 mm, respectively. The system identification, FE model updating, and time-history analysis results for a test shear wall are presented herein. By applying the advanced system identification, so-called pLSCF, the improved modal parameters are extracted in the lower modes. Using three FE in-house packages, such as FEMtools, Ruaumoko, and VecTor4, the eigenanalyses are made for an initial FE model, resulting in consistency in eigenvalues. However, they exhibit relatively stiffer behavior, as much as 30 to 50% compared with those extracted from the test in the 1st and 2nd modes. The FE model updating is carried out to consider the 6-dofs spring stiffnesses at the wall base as major parameters by adopting a Bayesian type automatic updating algorithm to minimize the residuals in modal parameters. The updating results indicate that the highest sensitivity is apparent in the vertical translational springs at few locations ranging from 300 to 500% in variation. However, their changes seem to have no physical meaning because of the numerical values. Finally, using the updated FE model, the time-history responses are predicted by Ruaumoko at each floor where accelerometers are located. The accelerograms between test and analysis show an acceptable match in terms of maximum and minimum values. However, the magnitudes and patterns of floor response spectra seem somewhat different because of the slightly different input accelerograms and damping ratios involved.

Evaluation of Reliability and Validity of the Louisville Instrument for Transplantation (LIFT) in Korean Population (한글판 Louisville Instrument for Transplantation 설문지의 신뢰도 및 타당도 평가)

  • Kim, Hong-Min;Kim, Ji-Hoon;Hwang, Jae-Ha;Kim, Kwang-Seog;Lee, Sam-Yong
    • Archives of Plastic Surgery
    • /
    • v.38 no.3
    • /
    • pp.245-250
    • /
    • 2011
  • Purpose: Composite tissue allotransplantation has emerged as a new therapeutic modality to reconstruct major tissue defects of the head, neck and extremities. A questionnaire-based instrument, the Louisville Instrument for Transplantation (LIFT), has been developed to objectively assess the risk-versus-benefit ratio for composite tissue allotransplantation procedures. The objective of this study is to assess if the LIFT is a useful, reliable and valid tool to apply to the Korean population. Methods: Seventy-three medical students and 60 lay public completed the LIFT questionnaire (translated to Korean) over the period from February 2010 to April 2010. Internal consistency was assessed using Cronbach's alpha. Test-retest reliability was analyzed using Pearson's correlation coefficient. Construct validity was assessed by comparing Pearson's correlation coefficients between perceived improvements in quality of life and responses to risk tolerance questions concerning organ transplants. Results: Measurements of the test-retest reliability showed that Pearson's correlation coefficients ranged from 0.241 to 0.902, and Cronbach's alphas ranged from 0.52 to 0.80 for medical students and from 0.63 to 0.83 for the lay public. Pearson's correlation coefficients showed significant correlations between perceived improvements in quality of life and responses to risk tolerance questions concerning organ transplants. Hand transplant showed a significant correlation in medical students. Foot, hand, two hands, larynx, partial face transplants showed significant correlations for the lay public. Conclusion: The applicability of the LIFT to the Korean population was found to be reliable and valid. The LIFT may serve as a useful tool for clinical application in the Korean population.

Analysis of Informatics-1 textbook based on Informatics Curriculum for Middle School Revised in 2007 (2007 개정 중학교 정보 교육과정에 기초한 정보1 교과서의 분석)

  • Kang, Oh-Han;Song, Hee-Heon
    • The Journal of Korean Association of Computer Education
    • /
    • v.13 no.3
    • /
    • pp.35-45
    • /
    • 2010
  • In this thesis, newly distributed informatics-1 textbook is analyzed according to the curriculum for middle school revised in 2007 and, as a result, a questionnaire is conducted to find solutions for early adoption of informatics-1 textbooks. The sample of this survey was limited to Kyungi province-based middle school teachers on Informatics-1. Items of the survey were chosen to explore the degree of satisfaction of teachers on the informatics-1 textbook and to discover contents requiring further necessary revision. Out of seven items concerning the satisfaction of the textbook, the item with the most positive responses was 'the consistency with the curriculum' with 95%. Also, the item with the most negative responses was 'the adequacy of contents and their organization' with 13%. In conclusion, we, based on the results from the questionnaire, proposed the introduction of various lecture materials and the training of teachers to learn new teaching methods.

  • PDF

Development and Application of an Online Scoring System for Constructed Response Items (서답형 문항 온라인 채점 시스템의 개발과 적용)

  • Cho, Jimin;Kim, Kyunghoon
    • The Journal of Korean Association of Computer Education
    • /
    • v.17 no.2
    • /
    • pp.39-51
    • /
    • 2014
  • In high-stakes tests for large groups, the efficiency with which students' responses are distributed to raters and how systematic scoring procedures are managed is important to the overall success of the testing program. In the scoring of constructed response items, it is important to understand whether the raters themselves are making consistent judgments on the responses, and whether these judgments are similar across all raters in order to establish measures of rater reliability. The purpose of this study was to design, develop and carry out a pilot test of an online scoring system for constructed response items administered in a paper-and-pencil test to large groups, and to verify the system's reliability. In this study, we show that this online system provided information on the scoring process of individual raters, including intra-rater and inter-rater consistency, compared to conventional scoring methods. We found this system to be especially effective for obtaining reliable and valid scores for constructed response items.

  • PDF

A rock mass assessment procedure based on quantitative geophysical log analysis of coal measure sequences (탄층에 대한 정량적 물리검층에 기초한 암반 평가 과정)

  • Hatherly Peter;Medhurst Terry;Sliwa Renate;Turner Roland
    • Geophysics and Geophysical Exploration
    • /
    • v.8 no.1
    • /
    • pp.112-117
    • /
    • 2005
  • Geophysical logging is routinely undertaken as part of most coal mine exploration programs. Currently, the main application for the logs is to determine coal seam depth and to qualitatively estimate coal quality, lithology, and rock strength. However, further information can be obtained, if quantitative log interpretation is made. To assist in the uptake of quantitative interpretation, we discuss log responses in terms of the mineralogy of the clastic sedimentary rocks frequently found in the Australian black coal mining areas of the Sydney and Bowen Basins. We find that the log responses can be tied to the mineralogy with reasonable confidence. Ambiguities in the interpretation will be better resolved if a full suite of logs is run. A method for checking for internal consistency, by comparing calculated and observed velocities, is also described. A key driver for quantitative interpretation is geotechnical characterisation. We propose a classification system for clastic rocks that takes into consideration physical rock properties that can be inferred from geophysical logs.