• Title/Summary/Keyword: Validity assessment

Search Result 1,143, Processing Time 0.029 seconds

Cognitive-Pragmatic Language Assessment for Normal Aging : Study of Assessment Tools and Content Validity (노년층의 인지-화용언어 능력 평가 : 평가도구 및 내용타당도 연구)

  • Lee, Mi-Sook;Kim, Hyang-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.5
    • /
    • pp.280-292
    • /
    • 2012
  • Cognitive-pragmatic language ability decreases during the normal aging process. Evaluating the ability might be useful in testing predicting cognitive level and diseases such as dementia. The aim of this study is to analyze various assessment protocols for normal aging, and evaluate the content validity of the currently developing cognitive-pragmatic language test domains and items. Content Validity Index(CVI) was calculated based on ratings judged by 17 experts including speech-language pathologists and clinical psychologists. As a result, it was found that CVIs of all 7 domains including attention, memory, organization, reasoning, problem solving, executive function, pragmatic language were above .75. It was concluded that the test items contained the appropriate content validity to assess cognitive-pragmatic language for normal aging.

A Review on Predictive Validity of Suicide Assessment Measures (자살성향 측정척도들의 자살예측력에 대한 고찰)

  • Park, Sung-Jin;Lim, Ayoung;Park, Subin;Na, Riji;Hong, Jin Pyo
    • Anxiety and mood
    • /
    • v.9 no.1
    • /
    • pp.10-18
    • /
    • 2013
  • The increasing suicide rate is a serious problem in Korea. Because of increased awareness of suicidality as a problem and because completed suicide is the fourth leading cause of death, it is very important to assess the risk of suicide. The purpose of this review is to provide a systematic examination of predictive validity of measures of suicidal ideation and behavior. A number of instruments are described as useful for identifying individuals "at high risk" for suicidal behavior. However, the predictive validity for most suicide measures has not been established. The present review only includes suicide assessment instruments with published predictive validity. In addition to evaluating the suicide assessment with respect to predictive validity, the present review describes and summarizes the psychometric properties of each measure. In conclusion, because of the complexity of studying the risk of suicide and the paucity of well-designed studies, it is extremely difficult to compare and generalize these findings. In addition, only a few instruments, such as the Scale for Suicide Ideation, Suicide Intent Scale and the Beck Hopelessness Scale, have been found to be significant risk factors for completed suicide. Another problem in the field involves that there have been few suicide measures designed for elderly populations. Clearly, future research is needed to investigate the predictive validity of standardized measures for completed suicide, especially targeting elderly populations.

An Analysis of the Reliability and Validity of a Korean Version of the Mobility and Gait Assessment Tools for Patients with Stroke

  • Jang, Ho Young;Lee, Jeong-Hoon;Oh, Jung Lim;Lee, Hyun Soo;Lee, Suk Min
    • The Journal of Korean Physical Therapy
    • /
    • v.30 no.1
    • /
    • pp.29-34
    • /
    • 2018
  • Purpose: This study aimed to systematically analyze the reliability and validity of Korean versions of mobility and gait assessment tools for patients with stroke. Methods: Two reviewers conducted an independent literature search and systematically reviewed the literature. Literature published until June of 2017 was searched using search engines for electronic databases. The 2 reviewers reviewed the title and abstract of each article. Among the articles examined, we read the full text of those judged to be suitable for our study. We classified the selected data into research methods and results. The determination was made through mutual agreement. Results: The reviewers selected 5 articles related to the purpose of this study. The DGI was found to be moderately associated with BBS, 10MWT, and TUG in intra-rater reliability (ICC=0.92), inter-rater reliability (ICC=0.88), and concurrent validity tests. The FGA demonstrated a high level of reliability with intra-rater (ICC=0.92-0.95) and inter-rater reliability (ICC=0.91, 0.95). The intra-rater reliability of the RMI was high at ICC=0.98. Its concurrent validity showed a high association with STREAM and BI. The intra-rater reliability of the MAS was ICC=0.75-0.99. Its inter-rater reliability was very high, exceeding 0.99. The inter-rater reliability of the Tinetti-gait Scale was ICC=0.91, and its concurrent validity was moderately associated with the DGI, 10WMT, OLST, FM-L/E, and STS. Conclusion: The results of this study revealed that the reliability and validity of the Korean versions of the mobility and gait assessment tools were high.

Domain-specific Assessment of Psychological Control in Parents of Korean Adolescents : Convergent and Discriminant Validity (청소년기 자녀에 대한 부모의 심리적 통제 구성요소의 타당성 연구 : 분리불안 심리적통제와 성취지향 심리적 통제)

  • Park, Seong-Yeon;Lee, Eun-Gyoung
    • Korean Journal of Child Studies
    • /
    • v.30 no.2
    • /
    • pp.211-229
    • /
    • 2009
  • This study examined replication of the factor structure of the DAPC [Domain-specific Assessment of Psychological Control (Soenens et al., 2006)] in parents of Korean adolescents. Participants included 289 adolescents who responded to DAPC items regarding their parents' psychological control behaviors. Two factors comprising 17 items were identified and labeled as "achievement oriented psychological control", and "separation-anxious psychological control." Confirmatory factor analysis and partial correlation analysis provided evidence for the construct validity of the DAPC through construct reliability, convergent validity and discriminant validity across both sex of parents and adolescents. The psychometric properties indicated that DAPC could be useful in studying parents' psychological control behaviors toward their adolescent children.

  • PDF

A Study on the Development of Diagnosis and Assessment Index by Soeumin's Ordinary Symptoms (소음인 소증 진단평가지표 개발 연구)

  • Hwang, Sabi;Lee, Junhee
    • Journal of Sasang Constitutional Medicine
    • /
    • v.33 no.1
    • /
    • pp.38-56
    • /
    • 2021
  • Objective This study was devised to create a new diagnosis and an assessment index by Soeumin's Ordinary Symptoms. Method First, a Working Committee and an Advisory Committee were formed for development, and the development goals were set. Then, the Soeumin's disease diagnosis indicators were extracted from the previous Clinical Practice Guidelines for Sasang Constitutional Medicine. To increase the clinical applicability, the extracted diagnosis indicators were focused on ordinary symptoms, and translated into Korean. The translated diagnosis and assessment indicators for Soeumin were surveyed to the Advisory Committee using the Delphi technique, and the inclusion, importance, and validity of each indicator were investigated accordingly. Result The translated diagnosis and assessment indicators were finally revised based on the surveyed inclusion and translation validity opinions, and the weight of each indicator was set based on the investigated importance, and a draft of the diagnosis and assessment index was developed. Conclusion This developed index can help to make effective diagnose about Soeumin's diseases by clinical doctor. In the future, a clinical study of this index can be conducted to consider the reliability, validity, and cut-point, and through this process, the actual clinical applicability will be improved.

Development and Validation of the Strengths Assessment Indicators for Daycare Centers (어린이집 강점평가지표 개발 및 타당화)

  • Hong, Sung hee;Hwang, Hae-Ik
    • Korean Journal of Childcare and Education
    • /
    • v.14 no.6
    • /
    • pp.143-170
    • /
    • 2018
  • Objective: The purpose of this study was to develop assessment indicators and to verify the validity and reliability of the developed assessment indicators. Methods: A Delphi survey, focus group interviews, and content verification were conducted in order for experts to develop an evaluation index of the strengths of the day care center. A main survey was conducted on 438 daycare center principals and teachers to test their item quality, validity and reliability. Results: The final assessment indicators consisted of three areas, seven assessment criteria, 19 evaluation factors, 41 assessment items and a five-point rubric rating scale. As for the common strengths indicators, there were three assessment areas, five assessment criteria, 12 assessment elements and 22 assessment items. In regard to the selective strengths indicators, there were 3 assessment areas, 5 assessment criteria, 12 assessment elements and 16 assessment items. Conclusion/Implications: The efforts to confirm the strengths of daycare centers are expected to facilitate the identity building of the daycare center itself and for its organizational members to make a contribution to the qualitative improvement of childcare.

Development of job performance assessment tool for dental hygienists (치과위생사의 직무수행능력 평가도구 개발)

  • Kim, Ji-Hee;Hwang, Tae-Yoon
    • Journal of Korean society of Dental Hygiene
    • /
    • v.13 no.5
    • /
    • pp.713-726
    • /
    • 2013
  • Objectives : The purpose of this study is to develop a job performance assessment tool for dental hygienists. Methods : The development consisted of three steps. The first step was to construct the contents of the assessment tool and a pretest questionnaire. In the second step, validity and reliability tests were done and modified for the pretest questionnaires and an assessment tool was made. The third step was verification of the assessment tool. A total of 678 data from the dental hygienists were analyzed to verify the validity and reliability. The assessment tool consisted of two areas such as job performance and competency/attitude: the job performance area covered four sub-areas including oral health education, preventive dental care, assistance for dental treatment, and administrative management. Results : The number of questions and reliability test result for each sub-area were as follows. Reliability coefficient for oral health education (10 questions) was 0.899, preventive dental care (8 questions) was 0.861, assistance for dental treatment (18 questions) was 0.915, administrative management (8 questions) was 0.919, competency of dental hygienists (11 questions) was 0.947, and attitude of dental hygienists (15 questions) was 0.955. Cronbach ${\alpha}$ coefficient for reliability of total 70 questions of the assessment tool was 0.980. Conclusions : The validity of the assessment tool was verified by three steps and the reliability proved to be significant. Consequently the assessment tool was found to be useful as an objective and valid job performance assessment tool for the dental hygienists.

Reliability and Validity of Patient Self-reported Daily Questionnaire on Oral Mucositis in Acute Leukemic Patients under Chemotherapy (화학요법을 받는 급성백혈병 환자 자가보고형 구강점막염 사정도구의 신뢰도와 타당도 분석)

  • Choi, So-Eun;Kim, Hee-Seung
    • Journal of Korean Biological Nursing Science
    • /
    • v.12 no.3
    • /
    • pp.148-156
    • /
    • 2010
  • Purpose: Oral mucositis (OM) is a serious consequence of chemotherapy that cancer patients must undergo. The objectives of this study were to find out reliability and validity of patients self-reported daily questionnaires on OM, and the impact OM makes on daily functions. Method: To test the reliability of oral mucositis daily questionnaire (OMDQ), internal consistency of the instrument (Cronbach's ${\alpha}$ and correlation between items) and test-retest reliability were analyzed. Criterion validity and discriminative validity were evaluated using WHO, oral assessment guide, and Nicolatou assessment tool. Forty-eight acute leukemic patients under chemotherapy were enrolled in this study. Result: The Cronbach's ${\alpha}$ coefficient indicated sufficient internal consistency. Correlations of Mouth and throat soreness (MTS) and MTSActivity Limitations (MTS-AL) were statistically significant. MTS and MTS-AL scores on consecutive days were highly correlated (days13,14=.84-.96; test-retest reliability). OMDQ scale had high criterion validity and discriminative validity. Patients with more severe WHO OM grades had higher MTS mean scores. Conclusion: Oral mucositis in acute leukemic patients under going chemotherapy can be easily quantified by patient self-administered OMDQ with reliability and validity.

Development of a Program Outcomes Assessment System based on Course Embedded Assessment for Nursing Education (Course Embedded Assessment 기반 간호교육 프로그램학습성과 평가체제 개발)

  • Nam, Soung Mi
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.23 no.2
    • /
    • pp.135-145
    • /
    • 2017
  • Purpose: The purpose of this study was to develop a program outcomes assessment system based on Course Embedded Assessment for nursing education. Methods: This study was conducted in accordance with the procedures of the developmental research method. Results: The major results are as follows. 1) The program outcomes were measured according to the Analytic Hierarchy Process. 2) The Course Embedded Assessment matrix was made according to program outcomes' weight, the curriculum-organizing principle, and achievement levels. 3) The Course Embedded Assessment rubric was developed in logical process, and consisted of a performance criterion, and rating scale. The content validity index of the Course Embedded Assessment rubric was 0.85. 4) An evaluation guideline and 12 documents were developed to facilitate the performance of the assessment system. 5) The average content validity index of the Course Embedded Assessment-based program outcomes assessment system was as high as 0.89. Conclusion: A Course Embedded Assessment-based program outcomes assessment system is more suitable for accreditation of nursing education than previous studies. Because this system evaluates the process of achievement as well as program outcomes, the results can also serve as immediate feedback to improve the educational process. Above all, this system facilitates that students check their achievements and strive to acquire core competencies in nursing.

A Quantitative Evaluation on Developmental Organization of Technical Proposals (기술제안서의 개발조직 부문에 관한 정량적 평가)

  • Choo, Kyung-Kyun;Kwon, Young-Kap;Rhew, Sung-Yul
    • Journal of Information Technology Services
    • /
    • v.3 no.1
    • /
    • pp.21-41
    • /
    • 2004
  • The technical proposal suggested and published by MIC(Ministry of Information and Communication, henceforth MIC) contains too general assessment elements, which causes qualitative and subjective assessment of technical proposals. Thus, in terms of the technical proposal assessment. It lacks In fairness, validity and accuracy. Furthermore, it has a great deal of difficulty in assessment caused by the inconsistency between proposal planning and assessment methods. Also, each company has different writing format, so it is impossible to make use of its maneuvering data for the assessment. To overcome these weaknesses, our research focused on a quantitative evaluation on development organization, which is a part of organizational and administrative part of the technical proposal suggested and published by MIC. In this research, we divided development organization for the technical proposal into organization, teams, and team members, and then studied addition, deletion and merging for the assessment criteria. For the related study, we chose especially CMM(Capability Maturity Model) from a lot of international and national references, which is a model measuring the maturity of organization, and then we focused on Small-CMM which is available in the small-sized organization. We also suggested input form, description method, assessment elements for the quantitative assessment in the chosen developmental organization, and finally we proposed standard referencing criteria for the assessment. Our study concludes that our assessment method are valid and available in comparison with the previous Delphi method through a validity evaluation test.