• Title/Summary/Keyword: validity examination

Search Result 307, Processing Time 0.03 seconds

The Validity and Reliability of the Daegu Diagnostic Aphasia Examination (대구 실어증 진단검사 개발 및 표준화 연구 -신뢰도와 타당도-)

  • Kim, Ji-Chae;Ahn, Jong-Bok;Lee, Ok-Bun;Hwang, Young-Jin;Jeong, Ok-Ran
    • Speech Sciences
    • /
    • v.12 no.3
    • /
    • pp.7-17
    • /
    • 2005
  • This study aimed at investigating the validity and reliability of the Daegu Diagnostic Aphasia Examination (DDAE). The DDAE has been developed to assess aphasics' receptive and expressive language ability. One hundred and forty eight aphasics (96 males and 52 females) diagnosed as aphasics participated in this study. Reliability coefficients showed that the DDAE was highly consistent and accurate (Cronbach's a = .76$\sim$.82). For its' content-validity, a 5-point scale was administered. Four speech and language pathologists served as evaluator. The receptive language mean score was 4.29, the expressive language mean score was 4.09, and the right-hemisphere function mean score was 4.00. For construct validity, the correlation total scores were calculated. The results showed a significant correlation.

  • PDF

Analysis of Content Validity and Case Studies of Responses to Scientific Questions on Qualification Examination for High School Graduation (고졸검정고시 과학 문항 타당도와 문항 반응 사례 분석)

  • MOON, Sungchae
    • Journal of Fisheries and Marine Sciences Education
    • /
    • v.29 no.1
    • /
    • pp.64-79
    • /
    • 2017
  • This study was to evaluate the suitability of scientific questions as qualification examination for high school graduation by content validity and item response with three examinees and two preliminary examinees. As a result, scientific questions were concentrated on two units of six units of total, and application appeared to be lacking problem area by 8% compared to understanding and application. Examinees and preliminary examinees chose correct answers most by hap or guess, sometimes by experience or common sense, and the least by scientific concept. In addition, they could chose correct answers by hap or guess because there were words that implied the correct answer in questions and answers, or because they could compared and/or analyzed questions and answers. With these results, two proposals were suggested as follows; (1) scientific questions of qualification examination for high school graduation should measure basic scientific literacy. (2) specific criteria for science literacy in qualification examination for high school graduation should be set.

Assessing the Validity of the Preclinical Objective Structured Clinical Examination Using Messick's Validity Framework (Messick의 타당도 틀을 활용한 임상실습 전 실기시험의 타당도 평가)

  • Lee, Hye-Yoon;Yune, So-Jung;Lee, Sang-Yeoup;Im, Sunju
    • Korean Medical Education Review
    • /
    • v.23 no.3
    • /
    • pp.185-193
    • /
    • 2021
  • Students must be familiar with clinical skills before starting clinical practice to ensure patients' safety and enable efficient learning. However, performance is mainly tested in the third or fourth years of medical school, and studies using the validity framework have not been reported in Korea. We analyzed the validity of a performance test conducted among second-year students classified into content, response process, internal structure, relationships with other variables, and consequences according to Messick's framework. As results of the analysis, content validity was secured by developing cases according to a pre-determined blueprint. The quality of the response process was controlled by training and calibrating raters. The internal structure showed that (1) reliability by generalizability theory was acceptable (coefficients of 0.724 and 0.786, respectively, for day 1 and day 2), and (2) the relevant domains had proper correlations, while the clinical performance examination (CPX) and objective structured clinical examination (OSCE) showed weaker relationships. OSCE/CPX scores were correlated with other variables, especially grade point average and oral structured exam scores. The consequences of this assessment were (1) making students learn clinical skills and study themselves, while causing too much stress for students due to lack of motivation; (2) reminding educators of the need to apply practical teaching methods and to give feedback on the test results; and (3) providing an opportunity for faculty to consider developing support programs. It is necessary to develop the blueprint more precisely according to students' level and to verify the validity of the response process with statistical methods.

Reliability and Validity of Stroke Impact Scale 3.0 (뇌졸중 영향 척도 3.0의 신뢰도와 타당도)

  • Park, Eun-Young;Choi, Yoo-Im;Kim, Eun-Joo
    • The Journal of the Korea Contents Association
    • /
    • v.19 no.8
    • /
    • pp.293-302
    • /
    • 2019
  • The purpose of this study was to examine the reliability and validity of Stroke Impact Scale 3.0 (SIS 3.0). Here, the SIS 3.0 was completed by 154 stroke patients (mean = 62.7; standard deviation [SD] = 9.43). Construct validity was verified by analyzing the correlation between SIS 3.0 sub-domains, and convergent validity was investigated by analyzing the correlation between the Modified Barthel Index (MBI) and the Mini-Mental State Examination-Korean (K-MMSE) version. The characteristics of each item were analyzed by internal consistency and item discrimination based on the classical item theory. Construct and convergent validity were verified through this study. Although the item i included in the emotion domain showed low item discrimination, all but this item showed high discrimination. Internal consistency was also high in all sub-domains.

A Survey on the Health Examination of Child Care Centers (보육시설의 건강검진 현황에 관한 조사연구)

  • Kim Il-Ok;Kang Ran-Hye
    • Child Health Nursing Research
    • /
    • v.11 no.3
    • /
    • pp.308-315
    • /
    • 2005
  • Purpose: This descriptive study was conducted to examine the status of the health examination in child care centers. Method: The participants in this study were 631 child care centers. A self report questionnaire on health examination which has been examined for content validity, was distributed by mail to 2,000 child care centers using randomized sampling. Result: Of the sample, $76.2\%$ child care centers had done health examination for children. Height & weight, urinalysis, dental check, anemia test and visual acuity were the most frequently performed items. The rate for maintaining a health record was highest in the national/public child care centers. Child care centers more closely related to community health centers, showed higher rates of health examination. Conclusion: Health care personnel and financial aids should be provided for child care centers to enhance the level of health management of children.

  • PDF

Current Status and Ways for Improvement of the Examination System for the Employment of Environmental Education Teachers in Secondary Schools (중등학교 환경과 교사 임용고사 제도의 문제점과 개선방안)

  • 최돈형
    • Hwankyungkyoyuk
    • /
    • v.14 no.1
    • /
    • pp.66-80
    • /
    • 2001
  • In this study, the current status and the desirable ways for improvement of the examination system for the employment of the environmental education teachers in the secondary school were investigated. For the study, first, problems and reasons, and the counterplan of policy on the teacher connected directly with the examination employing secondary school teachers through exploration of the related literatures were analyzed; second, it was identified that the essential quality which environmental education teachers should have ready; third, the curriculum of environmental education teacher training universities and the seventh environmental curriculum were examined to provide a basis of discussion on the principle of setting questions for the employment of environmental education teachers; fourth, the number of recruitment, the number of examinee, the principle of setting questions, the composition of questions, and the distribution of scores of the examination which were carried out in the school year 2000 and 2001 were compared and analyzed; finally, the basis of the above analyses, recommendations to consider the examination system for the employment of environmental education teachers in the secondary school were presented as follows: first, the team managing the examination for the employment should reflect the aims and special contents of environmental education to discuss and decide the principle of setting questions on the environmental course; second, the proportion of subject matter education in the examination for environmental education teachers should be increased; third, the validity of questions for the examination should be clarified and the difficulty level of the questions should be low.

  • PDF

Reliability and Validity Tests of Patient Classification System Based on Nursing Intensity (간호강도에 의한 환자분류도구의 신뢰도 및 타당도 검증)

  • Park, Jung-Ho;Kim, Eun-Hye
    • Journal of Korean Academy of Nursing Administration
    • /
    • v.13 no.1
    • /
    • pp.5-16
    • /
    • 2007
  • Purpose: This study is to verify the validity and reliability of classified items and criteria of the patient classification system(PCS) based on Park's definition of nursing intensity. Methods: An expert group of 8 persons verified the content validity of the tools. The 1817 inpatients at a tertiary hospital in Seoul, Korea were classified into 4 groups according to two tools for verifying concurrent validity and interraters' reliability. These verifications were performed from September to October, 2004. Results: Nursing domains of the tools have been divided into 12 items: hygiene, nutrition, elimination, exercise & activity, education & counseling, emotional support, communication & consciousness, treatment & examination, medication, measurement & observation, coordination of multidisciplinary team, admission & discharge & transfer management. Content validity was verified by the content validity index(above 0.75 in all 12 areas). Interraters' reliability was no significant difference in the results of the patient classification between the two raters(A group 93.75%. B group 88.24%). Concurrent validity was also verified by the agreement of two tools(73.7%). Conclusion: These results showed that the reliability and validity of the PCS based on the nursing intensity were verified. These will use an data for nursing productivity in the future.

  • PDF

A Study on the Validity and Reliability of Performance Assessment in Home Economics (가정과 수행평가의 타당성과 신뢰성 연구 - 경남 농촌지역의 소인수 학급을 대상으로 -)

  • 윤성희;유태명
    • Journal of the Korean Home Economics Association
    • /
    • v.39 no.10
    • /
    • pp.169-186
    • /
    • 2001
  • The purpose of the study was to verify validity and reliability of performance assessment in home economics by applying performance assessment tools developed by Korean Curriculum Assessment Institute and by the researcher to a class of 17 high school female students in a rural area. For the purpose of this study, the research question was formulated and addressed:“How are the validity and reliability of performance assessment in home economics\ulcorner” The results of the study were as follows. 1. The results of testing validity a. Thirteen high school home economics teachers, whose average teaching years is ten years verified high validity in the contents of performance assessment. b. In the validity of the items that is verified being based on the scores of high school entrance examination of 2000 school year, the essay type showed its characteristics as performance assessment. c. The generalizability among assessment methods was not high. 2. The results of testing reliability Both Cronbach's $\alpha$, inter-item reliability of the assessment tools used in the research, and reliability among the raters were high. But reliability among the tasks was relatively low. This study proposed that the diverse performance methods, the increasing number of assessment, the explicit assessment criterion, and scoring criterion are needed to satisfying validity and reliability of performance assessment.

  • PDF

Validity and Reliability of a Clinical Performance Examination using Standardized Patients (호흡기계 표준화 환자를 이용한 간호대 학생의 임상수행능력평가 타당도와 신뢰도 검증)

  • Choi, Ja-Yun;Jang, Keum-Seong;Choi, Soon-Hee;Hong, Mi-Soon
    • Journal of Korean Academy of Nursing
    • /
    • v.38 no.1
    • /
    • pp.83-91
    • /
    • 2008
  • Purpose: The purpose of this study was to test the validity of a modified clinical performance examination (CPX) for preclinical students in nursing. Method: 70 nursing students in their second semester of the junior year at C University participated in CPX. Scenarios and checklists were developed by our research team from September to October 2005. Six stations were organized. Evaluation included physical examination of a patient with lung cancer, education on usage of a metered dosage inhaler, and lobectomy postoperative care. Students were randomly assigned to a station. Result: There was a difference in the CPX scores according to stations. The agreement of scoring between trained faculty members and SPs was more than moderate (r=.647). The correlation between the CPX score and the average grade in the previous semester and between the CPX score and the average grade of a paper and pen test of the pulmonary system of adults was low (r=.276; r=.048). Conclusion: Traditional CPX is generally recommended, however, modified CPX is appropriate for preclinical students in the current Korean Nursing school setting if there are additional scoring systems to balance the testing level at each station.

Validity of Breast Cancer Symptom Questionnaire and Its Relationship With Breast Ultrasonography in Young Female Night Workers

  • Chae, Chang-Ho
    • Safety and Health at Work
    • /
    • v.11 no.3
    • /
    • pp.361-366
    • /
    • 2020
  • Background: This study aimed to identify the validity of breast cancer symptom questionnaire of worker's special health examination and its relationship with breast ultrasonography findings in young female night workers. Methods: The breast cancer symptom questionnaire data of worker's special health examination and breast ultrasonography results in young female shift workers who worked in one electronic manufacture company were collected from 2014 to 2018. Results: Of the 857 workers, 18 had a Breast Imaging Reporting and Database System category 4 or higher. Among other variables, shift work tenure alone was associated with the risk of having a Breast Imaging Reporting and Database System category higher than 4. The sensitivity, specificity, positive predictive value, and negative predictive value of the symptom questionnaire were 16.7%, 87.7%, 2.8%, and 98.0%, respectively. Conclusion: The current breast cancer symptom questionnaire of the worker's special health examination is inappropriate due to its low sensitivity and positive predictive value. In the future, female night workers will need alternative measures for more accurate screening for breast cancer.