• 제목/요약/키워드: assessment item analysis

검색결과 353건 처리시간 0.028초

간호학 프로그램 학습성과 간접측정 도구개발 (Development of Program Outcome Self-Assessment Tool in Korean Nursing Baccalaureate Education)

  • 김현경
    • 한국간호교육학회지
    • /
    • 제21권2호
    • /
    • pp.215-226
    • /
    • 2015
  • Purpose: This study aimed to develop a self-assessment tool to evaluate program outcomes of nursing students in Korean nursing undergraduate education. Methods: The instrument development process consisted of literature review, focus group interviews, and item validation. A total of 117 items were analyzed through content validity testing. Data was gathered from 302 nursing students in Korea and analyzed using SPSS 21.0. Results: To construct validity, principal component analysis and Varimax rotation were used, and 12 factors, with a cumulative explanatory variance of 69.16%, were determined from 79 items. For internal consistency and reliability, Cronbach's ${\alpha}$ was .91. The half-split reliability results were .84 and .85, and the ROC curve showed an optimal cutpoint at 227. A five-point Likert scale was used for scoring. Conclusion: This instrument was found to have fair validity and reliability as a self-assessment tool for nursing student learning outcomes. Therefore, it can be used to evaluate program outcomes indirectly in nursing schools.

Analysis of Measures against Personal Information Impact of Japanese Local Governments

  • Shin, Sanggyu
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2018년도 춘계학술발표대회
    • /
    • pp.135-138
    • /
    • 2018
  • In Japan, 24th May 2013, the Act on the Use of Numbers to Identify a Specific Individual in the Administrative Procedure (From now on referred to as the My Number Act) had raised. My Number system is used to confirm that information on individuals possessed by multiple agencies such as administrative agencies and local governments are information of the same person. In this paper, we analyzed the all item assessment report of the Specific Personal Information Protection Assessment conducted in local governments in Japan, etc. We investigated two directions: (1) Adequacy of risk assessment and measures, (2) Reuse of the Assessment Report.

Differential Item Functioning of the Oswestry Low Back Pain Questionnaire Between Participants With and Without Low Back Pain

  • Choi, Bong-Sam
    • 한국전문물리치료학회지
    • /
    • 제21권4호
    • /
    • pp.40-48
    • /
    • 2014
  • Differential item functioning (DIF) based on Rasch model can be used to examine whether the items function similarly across different groups and identify items that appear to be too easy or difficult after controlling for the ability levels of the compared groups. The Oswestry low back pain disability (Oswestry) has traditionally been proved as an effective instrument measuring disability resulting from low back pain (LBP). In this study, DIF method was used to explore whether items on the Oswestry perform similarly across two different groups (participants with LBP and no LBP). A series of Rasch analyses on the 10 items of the Oswestry were performed using Winsteps$^{(R)}$ software. Forty-two participants with back pain were recruited from 3 rehabilitation hospitals in Gainesville, Florida. Another 42 participants with no LBP were recruited from several public places in the rehabilitation hospitals. Based on the DIF analysis across the two groups, several items were found to have an uniform DIF. Participants with no LBP had more difficulty on lifting and personal care items and participants with LBP had more difficulty on sleeping and social life items. For non-LBP group, a high ceiling effects (83% of participants with non-LBP) was detected, which was not be able to be effectively measured with the Oswestry items. Although 4 items of the Oswestry function differently across the two groups, all items of the Oswestry were well targeted the LBP group.

피로사정도구(Fatigue Assessment Instrument : FAI)의 신뢰도와 타당도 검증 (Reliability and Validity Tests for the fatigue Assessment Instrument (FAI))

  • 변영순;이정인
    • 기본간호학회지
    • /
    • 제11권2호
    • /
    • pp.220-225
    • /
    • 2004
  • Purpose: The purpose of this study was to test the reliability and validity of FAI and to apply it in Korea. Method: Data were collected from 180 middle-age women. The questionnaire, which was originally developed by Schwartz, Jandorf & Krupp, was analyzed using Cronbach's a and factor analysis. Results: Cronbach's a for the FAI was .9198. As a result of item analysis, 27 items were selected from the total of 29 items, Items that showed low correlation with the total scale were excluded. Six factors were fixed from the data analysis performed using principle component analysis and varimax rotation. These six factors account for 65.3% of total variance. The first factor was global fatigue severity, and the second one was fatigue consequences. The other factors were method of fatigue reduction, fatigue caused by exercise, fatigue caused by routine activity, and fatigue caused by stress and depression, sequentially. Conclusion: The reliability and validity of FAI were verified.

  • PDF

고등학교 수학과 지필평가 문항 분석 - 기하와 벡터를 중심으로 - (Analysis on the Paper-Based Assessment of Mathematics in High School - Focused on Geometry and Vector -)

  • 양성현;이환철
    • 대한수학교육학회지:수학교육학연구
    • /
    • 제24권4호
    • /
    • pp.573-594
    • /
    • 2014
  • 교사의 평가 전문성의 영역 중에서도 평가 문항 제작 능력은 평가의 타당도, 신뢰도에 있어 필수적인 요소이다. 다시 말해, 평가문항의 내용적인 측면과 형식적인 측면에서의 오류는 올바른 평가를 저해하는 요소이며 이러한 평가를 통하여 긍정적 피드백이 이루어질 수 없다. 본 연구는 서울 경기 인천 일반고등학교 45개교 수학과 중간고사와 기말고사 기하와 벡터 60개 시험지의 문항 분석을 통하여 지필평가의 내용적인 측면과 형식적인 측면에서의 문항 오류와 개선점에 대하여 논하고, 이를 통하여 교사들의 평가 문항 제작에 대한 능력 제고를 그 목적으로 하고 있다.

  • PDF

외국 약사 국가시험 문항관리 분석연구 (The Analysis of Item Management on Foreign Pharmacists Examination)

  • 권경희;임성실;손의동
    • 약학회지
    • /
    • 제59권5호
    • /
    • pp.235-244
    • /
    • 2015
  • The goal of this study is to help for the utilization the national pharmacists test through the analysis of item development management to the foreign pharmacists examination. The United States is going to NABP (National Association of Boards of Pharmacy) initiative under the curriculum in question on the basis of this assessment and develop standards and unified, systematic system to conduct tests pharmacist. Practice oriented (patient scenario, the participation of a pharmacist or perform work, clinical practice) examination is doing in Canada, The UK is asking the for more than 70 percent and the prescription needed for actual calculation in practice prior to testing program, and by the including that allows references use. Our country may introduce the job as a clinical pharmacist, positively. Item management system is integrated into four regions based on the six-year curriculum should be done in harmony proportion of each region. Integration of fusion of each region in accordance with the duties should be come out. It has gradually been able to item management system developed by the United States or Canada. This item notice pharmacist judging the results of the work must be carried out for management upgrading to a form of management with an emphasis on clinical practice in developed countries. Foundation design, development, production and management and test after actively reviewing ways to improve management system for to management systems, a pharmacist to improve the quality of the national examination could be contributing are involved.

중등학교 과학 수행평가의 평가 유형과 채점 방식 및 신뢰도 분석 (Analysis of Assessment Types, Scoring Methods and Reliability of Science Performance Assessment in Middle and High School)

  • 이기영;안희수
    • 한국과학교육학회지
    • /
    • 제25권2호
    • /
    • pp.173-183
    • /
    • 2005
  • 본 연구에서는 중등학교 과학 수행평가가 어떤 평가 유형과 채점 방식을 사용하고 있는지 분석하였으며, 이를 토대로 일반화가능도 이론을 이용하여 과학 수행평가 점수가 얼마나 신뢰로운지 분석하였다. 연구 결과, 과학 수행평가의 유형은 크게 지필형과 과제형으로 나눌 수 있었다. 지필형으로는 중등학교 모두 응답제한형 서술형검사만을 실시하고 있었다. 과제형은 과정 평가와 결과물 평가로 나눌 수 있었다. 채점 방식은 1명의 교사가 모든 서술형문항과 수행과제를 채점하거나, 2명의 교사가 수행과제를 나누어 채점하고 있었다. 그러나 2명 이상의 교사가 서술형문항을 나누거나 교차하여 채점하는 경우는 없었다. 표집된 7개 중등학교 과학 수행평가의 신뢰도 분석 결과는 다음과 갇다: (1) 서술형 문항의 특성이 수행과제의 특성보다 학생들의 수행평가 점수에 미치는 영향이 더 큰것으로 나타났다. (2) 수행과제 채점에서 채점자가 피험자를 다르게 채점하는 정도는 학교에 따라 상당한 차이가 있었다. (3) 7개 중등학교 과학 수행평가의 일반화가능도(신뢰도)는 대부분 적정 수준인 0.80에 미치지 못하는 것으로 나타났으며, 적정 수준의 일반화가능도를 얻기 위해서는 지금보다 더 많은 수의 서술형 문항과 수행과제 그리고 채점자가 필요한 것으로 분석되었다.

암환자의 고통 측정도구 개발에 관한 연구 (Development of a Tool to Measure Suffering in Patients with Cancer)

  • 강경아
    • 대한간호학회지
    • /
    • 제29권6호
    • /
    • pp.1365-1378
    • /
    • 1999
  • This study is a methodological research study to develop an instrument to measure in patients with cancer and to test the validity and reliability of the instrument. The research procedure was as follows : 1) The first step was to develop conceptual framework based on a comprehensive review of the literature and in-depth interviews with patients with cancer. This conceptual framework was organized in to three dimensions (the intrapersonal dimension, the significant-other and context related dimension, the transcendental dimension). Initially 59 items were adopted. 2) These items were analyzed through the index of content validity(CVI) and 53 items were selected which met more than 80% on the CVI. 3) The pretest was carried out with 87 patients with cancer. After the pretest results were analyzed by item analysis, 44 items were selected. A second test of content validity was conducted and 6 items were eliminated considering the 80% CVI. 4) To test for reliability and validity, data collection was done during the period from January 25, 1999, to February 26, 1999. The subjects for the test were 160 patients with cancer and 185 healthy persons. analysis, item analysis and multitrait-multimethod method to analyze validity. The findings are as follows : 1) The Cronbach's alpha coefficient for internal consistency was .92 for the total 38 items and .79, .82, .85, for the three dimensions in that order. 2) The item analysis was based on the corrected item to total correlation coefficient( .30 or more) and information about the alpha estimate if this item was dropped from the scale. 3) As a result of the initial factor analysis using principal component analysis and varimax rotation, one item was deleted because of factor complexity (indiscriminate factor loadings). In the secondary factor analysis, 7 factors with eigenvalue of more than 1.0 were extracted and these factors explained 56 percents of the total variance. The seven factors were labeled as 'family relationship', 'emotional condition', 'physical discomfort', 'meaning and goal of life', 'contextual stimuli', 'change of body image', 'guilt feelings'. 4) The convergence effect between this instrument and the life satisfaction scale was identified and there was significant positive correlation(r= .52, p= .00). The discriminant validity between this instrument and the depression scale(CES-D) was tested and there was significant negative correlation(r= -.50, p= .00). The instrument for accessing the suffering of patients with cancer developed in this study was identified as a tool with a high degree of reliability and validity. In this sense, this tool can be effectively utilized for assessment in caring for patients with cancer.

  • PDF

PISA 2주기 검사에서 한국 학생들의 문제해결 영역 성취도 분석 (Korean Students' Performance in Problem Solving Literacy in PISA 2003)

  • 곽영순
    • 한국지구과학회지
    • /
    • 제25권8호
    • /
    • pp.647-655
    • /
    • 2004
  • PISA의 두 번째 주기에 해당되는 PISA 2003에서는 문제해결 영역에 대한 평가가 새로이 도입되었다. PISA 2003 본검사 문제해결 영역에서는 (1) 의사결정, (2) 체제 분석 및 설계, (3) 문제점 해결 등의 세 가지 문제해결 유형에 따라 학생들의 범교과적 문제해결 능력을 평가하였다. 본 논문에서는 PISA 2003 본검사에 포함된 문제해결 영역문항들에 대한 우리나라 학생들의 정답률을 살펴보고, 문제해결 문항들 중 개방형 서술형 문항에 대한 학생들의 답안을 상세하게 분석하였다. 분석 결과에 따르면, 우리나라 학생들은 그림이나 그래프로 표상하는 과제에 취약하며, 긴 문장으로 제시된 지문 해석에서 어려움을 겪은 것으로 보인다. 또한, 우리 나라 학생들에게는 다소 낯선 맥락이나 소재를 활용한 과제의 경우 낮은 정답률을 기록하였다. PISA 2003 문제해결 영역을 분석한 결과가 과학교육에 주는 시사점도 논의하였다.

일부 대학생의 상태-특성 불안 정도와 식사 장애 위험 정도의 관계 (The Relationship between Risk of Eating Disorder and Severity of State-Trait Anxiety)

  • 남희정;김영순
    • 한국식품영양학회지
    • /
    • 제18권3호
    • /
    • pp.229-240
    • /
    • 2005
  • This quantitative study was investigated to examine the relationship between severity of state-trait anxiety and disordered eating patterns in some university students. This study used a cross-sectional study design. Total 347 students participated in this study (88 male and 259 female) among three universities. The assessment of eating disorder was conducted by Eating Attitudes Test (EAT-26), a score of >or=20 identified individuals likely to have an eating disorder, including anorexia nervosa and bulimia nervosa. Scores of healthy dietary behaviors were obtained by self-assessment instrument on healthy diet scale(20-item questionnaire), and severity of state-trait anxiety was calculated by state-trait anxiety inventory(Total 40- item questionnaire). In groups for each state anxiety and trait anxiety, there were divided between 50 percentile point of cumulatived scores of state anxiety and trait anxiety in all subjects. Linear regression analysis showed overall significant difference between dietary patterns(anorexia nervosa and healthy dietary behaviors) and severity of state-trait anxiety in all sex. Our results indicated that severity of state-trait anxiety may marked eating disorder symptomatology on dimensions of eating disorder prevention.