• 제목/요약/키워드: Performance validity

검색결과 2,478건 처리시간 0.028초

사회복지사의 맥락적 수행에 대한 개념타당성 연구 (A Study on Construct Validity of Contextual Performance for Social Workers)

  • 조성우
    • 한국사회복지학
    • /
    • 제58권2호
    • /
    • pp.87-118
    • /
    • 2006
  • 이 연구의 목적은 최근 직무수행의 새로운 영역으로 주목받고 있는 맥락적 수행(contextual performance)이 사회복지 실천이론과 현장에서도 타당한 개념으로 인정받을 수 있는가를 검토하는 것이다. 이를 위해 본 연구에서는 현장의 관리자들을 대상으로 예비조사를 실시하여 연구실행의 가능성을 확인하였다. 이후 본 조사에서는 전국의 사회복지사 170명을 대상으로 맥락적 수행의 행동사례에 대한 질적 분석을 하였고, 질적분석 결과를 근거로 평가지표를 개발해 연구참여자를 대상으로 직무수행에 대한 상사 자기평가를 실시하였다. 이를 위해 다중속성-다중평정(multitriat-multimethod, MTMM) 자료를 구성하여 위계적 내재모형에 대한 확인적 요인분석을 실시하였다. 질적 양적 통합연구분석 결과, 사회복지사의 맥락적 수행의 영역은 '조직지향 수행', '동료지향 수행', '클라이언트지향수행', '자기지향 수행'의 4가지 영역으로 분류되었고, 이들은 기존의 직무수행과는 어느 정도 변별타 당도를 갖는 것으로 파악되었다. 본 연구에서는 이러한 연구결과에 근거하여 향후 사회복지사의 직무수행에 대한 연구전망과 제언을 제시하였다.

  • PDF

일반간호사 인사고과도구 수정 및 신뢰도, 타당도 검증 (Revision of Performance Appraisal Tool and Verification of Reliability and Validity)

  • 박광옥;박성애;박성희;이은희;김명애;곽월희
    • 임상간호연구
    • /
    • 제17권1호
    • /
    • pp.70-80
    • /
    • 2011
  • Purpose: This study was done to develop performance appraisal guidelines based on the standardized appraisal tool developed in a previous study. Methods: A preliminary investigation was done to draw up a draft guidelines through a literature review. To verify the content validity of the guidelines, 10 nurse managers reviewed the standardized appraisal tool and draft guidelines. Through this process, the performance appraisal guidelines were revised and supplemented. In order to examine the reliability and validity of the guidelines, 13 nurse managers conducted performance appraisal for 178 nurses. Results: As a result, the items of pre-existing tool was reduced from 63 to 30 for usefulness, and guidelines for each items were developed. Conclusion: The revised performance appraisal tool and guidelines are expected to be useful in objectively evaluating nursing performance objectively.

임상판단 평가도구의 신뢰도 및 타당도 검증 (The Reliability and Validity of the Lasater Clinical Judgement Rubric in Korean Nursing Students)

  • 심가가;신현숙
    • Child Health Nursing Research
    • /
    • 제21권2호
    • /
    • pp.160-167
    • /
    • 2015
  • Purpose: This study was done to evaluate the Lasater Clinical Judgement Rubric for use with Korean nursing students. Methods: A methodological study was used to validate the rubric developed by Lasater to assess clinical judgment during nursing simulation. Participants were 34 nursing students at K University in Seoul. Between February and May, 2012, analysis was done of 91 video clips recording performance during simulation. Results: Findings showed reliability and validity of the rubric. For internal consistency, Cronbach's ${\alpha}$ score was .884 and intraclass correlation coefficient was .839, which established reliability. The rubric was validated using the exploratory factor analysis and content validity. The content validity score was 83%, establishing the appropriateness and readiness of the tool. Factor analysis showed that noticing, responding, and reflecting domains had Eigen values of 2.669, 1.991, and 2.912, respectively and were bound, but unlike the original tool in which four factors noticing, interpretation, responding, and reflecting domains were bound. Conclusion: Results of the study indicate that the rubric shows acceptable reliability and validity in Korean nursing students. This evaluation tool for nursing simulation allows nursing faculty to objectively evaluate students' clinical judgment as well as students to reflect on their clinical judgment process during simulation.

임상 간호사의 간호업무성과 측정도구 개발 (Development of a Performance Measurement Scale for Hospital Nurses)

  • 고유경;이태화;임지영
    • 대한간호학회지
    • /
    • 제37권3호
    • /
    • pp.286-294
    • /
    • 2007
  • Purpose: The aim of this study was to develop a performance measurement scale for nurses in the hospital setting and to test the reliability and validity of the scale. Methods: This study was conducted in three phases including an application of conceptual framework, development of scale items, and test of validity and reliability of the scale. In order to test validity and reliability, data was collected from 1,966 nurses who work in twenty eight hospitals nation-wide. The data was analyzed by the SAS 8.0 program using descriptive statistics, factor analysis, and reliability coefficients. Results: The Performance measurement scale consisted of 4 factors which included competency, attitude, willingness to improve, and application of nursing process, and a total of 17 items. The Four factors explained 63.45% of the total variance, and Cronbach's alpha of the scale was.92. Conclusion: The performance measurement scale developed by this study is a reliable and valid instrument that is utilized effectively to evaluate the performance of hospital nurses. Furthermore, it could be used as a sloping stone to assess educational needs of nurses, develop professionalism among nurses, and improve quality of nursing care in the hospital setting.

K-means 알고리즘 기반 클러스터링 인덱스 비교 연구 (A Performance Comparison of Cluster Validity Indices based on K-means Algorithm)

  • 심요성;정지원;최인찬
    • Asia pacific journal of information systems
    • /
    • 제16권1호
    • /
    • pp.127-144
    • /
    • 2006
  • The K-means algorithm is widely used at the initial stage of data analysis in data mining process, partly because of its low time complexity and the simplicity of practical implementation. Cluster validity indices are used along with the algorithm in order to determine the number of clusters as well as the clustering results of datasets. In this paper, we present a performance comparison of sixteen indices, which are selected from forty indices in literature, while considering their applicability to nonhierarchical clustering algorithms. Data sets used in the experiment are generated based on multivariate normal distribution. In particular, four error types including standardization, outlier generation, error perturbation, and noise dimension addition are considered in the comparison. Through the experiment the effects of varying number of points, attributes, and clusters on the performance are analyzed. The result of the simulation experiment shows that Calinski and Harabasz index performs the best through the all datasets and that Davis and Bouldin index becomes a strong competitor as the number of points increases in dataset.

대학병원 간호조직 균형 성과지표의 적합성 검증 (Balanced Scorecard for Performance Measurement of a Nursing Organization in a Korean Hospital)

  • 홍윤미;황경자;김미자;박창기
    • 대한간호학회지
    • /
    • 제38권1호
    • /
    • pp.45-54
    • /
    • 2008
  • Purpose: The purpose of this study was to develop a balanced scorecard (BSC) for performance measurement of a Korean hospital nursing organization and to evaluate the validity and reliability of performance measurement indicators. Method: Two hundred fifty-nine nurses in a Korean hospital participated in a survey questionnaire that included 29-item performance evaluation indicators developed by investigators of this study based on the Kaplan and Norton's BSC (1992). Cronbach's alpha was used to test the reliability of the BSC. Exploratory and confirmatory factor analysis with a structure equation model (SEM) was applied to assess the construct validity of the BSC. Result: Cronbach's alpha of 29 items was .948. Factor analysis of the BSC showed 5 principal components (eigen value>1.0) which explained 62.7% of the total variance, and it included a new one, community service. The SEM analysis results showed that 5 components were significant for the hospital BSC tool. Conclusion: High degree of reliability and validity of this BSC suggests that it may be used for performance measurements of a Korean hospital nursing organization. Future studies may consider including a balanced number of nurse managers and staff nurses in the study. Further data analysis on the relationships among factors is recommended.

Reconsideration of F1 Score as a Performance Measure in Mass Spectrometry-based Metabolomics

  • Jeong, Jaesik;Kim, Han Sol;Kim, Shin June
    • 통합자연과학논문집
    • /
    • 제11권3호
    • /
    • pp.161-164
    • /
    • 2018
  • Over the past decade, mass spectrometry-based metabolomics, especially two dimensional gas chromatography mass spectrometry (GCxGC/TOF-MS), has become a key analytical tool for metabolomics data because of its sensitivity and ability to analyze complex biological or biochemical sample. However, the need to reduce variations within/between experiments has been reported and methodological developments to overcome such problem has long been a critical issue. Along with methodological developments, developing reasonable performance measure has also been studied. Following four numerical measures have been typically used for comparison: sensitivity, specificity, receiver operating characteristic (ROC) curves, and positive predictive value (PPV). However, more recently, such measures are replaced with F1 score in many fields including metabolomics area without any carefulness of its validity. Thus, we want to investigate the validity of F1 score on two examples, with the goal of raising the awareness in choosing appropriate performance comparison measure. We noticed that F1 score itself, as a performance measure, was not good enough. Accordingly, we suggest that F1 score be supplemented with other performance measure such as specificity to improve its validity.

Reliability and Validity of the Korean version of the Pain in Older Adults Knowledge Survey (K-POAKS) among Nurses Who Have Worked in Long-term Care Hospitals

  • Ryu, Young Seun;Park, Jeong Sook
    • 지역사회간호학회지
    • /
    • 제31권2호
    • /
    • pp.130-142
    • /
    • 2020
  • Purpose: The purpose of this study was to verify the validity and reliability of the Korean version of the Pain in Older Adults Knowledge Survey (K-POAKS) to assess knowledge of pain in older adults including people with dementia for use in long-term care hospital nurses. Methods: Survey data were collected from a convenience sample of 179 nurses who have worked in long-term care hospitals in B, D and U cities. The Kuder-Richardson Formula 20 for internal consistency for test reliability was conducted. The content, criterion-related and construct validity were evaluated using SPSS/WIN 22.0. Results: The KR 20 was .75 and Content Validity Ratio (CVR) was a range of 0.84~1.00. The criterion-related validity was positively correlated with attitudes (r=.28, p<.001) and performance (r=.21, p=.004). The construct validity of K-POAKS was analyzed by conducting the principal component method using the exploratory factor analysis varimax rotation, and seven factors were derived above the eigenvalue of 1.0. The seven factors explained 58.5% of the total variation. Conclusion: The Korean version of the POAKS showed satisfactory internal reliability, content validity, criterion-related validity and construct validity. These results suggest that the K-POAKS could be used as a suitable tool to measure the knowledge of the aged people's pain, including that of dementia patients for long-term care hospital nurses.

Reliability and Validity of the CAP for Computer Access Assessment of Persons with Physical Disabilities

  • Jeong, Dong-Hoon
    • The Journal of Korean Physical Therapy
    • /
    • 제27권1호
    • /
    • pp.30-37
    • /
    • 2015
  • Purpose: The purpose of this study was to develop a computer access assessment tool for persons with physical disabilities and to evaluate reliability and validity. Methods: We developed a computerized Computer access Assessment Program (CAP) through many kinds of literature review and tools analysis for evaluation of computer access, task analysis of fundamental input devices operation and expert review. The CAP data were obtained from 105 normal university students and 16 students with physical disabilities. The test items of CAP are composed of four timed mouse tasks, four timed keyboard tasks, and a timed scanning task. Thus, the software measures user performance in skills needed for computer interaction, such as keyboard and pointer use, navigating through menus, and scanning. To determine the validity of these measurements, we compared data on CAP reports to a Compass report. Compass software allows an evaluator for assessment of an individual's computer input skills. Results: Results of this study showed that the CAP had high internal consistency, reliability of test-retest, concurrent validity, and convergent validity. Conclusion: Therefore, the CAP is appropriate for evaluation and determination of computer access skill of persons with physical disabilities. It is possible to get clear quantitative data on performance when providing computer access services if you can use the CAP data. Using this quantitative evidence, insights can be gained into the specific nature of any difficulties experienced by persons with physical disabilities and find wise solutions.

약학대학생들의 입학전형요소와 학업성취도의 상관관계에 관한 연구 (Relationship between Entrance Qualifications and Academic Performance of Pharmacy Students)

  • 원권연;주상훈
    • 약학회지
    • /
    • 제58권4호
    • /
    • pp.250-254
    • /
    • 2014
  • Background: A new admission procedure was introduced to Korea when Doctor of Pharmacy (Pharm. D.) program was first established in 2011. In the new procedure, applicants are reviewed based on quantitative qualifications, which include Pharmacy Education Eligibility Test (PEET) scores, Test of English for International Communication (TOEIC) scores, and grade point average (GPA), as well as qualitative qualifications such as essay writing, extracurricular activities including volunteer experiences. Purpose: This study aimed to find relationships between entrance qualifications and academic performance of pharmacy students. Method: Entrance qualifications and academic performance of 164 first-year students were analyzed from 2011 to 2013 at Catholic University of Daegu. Other characteristics such as age and gender were also considered in the study. Results: Only GPA and TOEIC scores showed positive Pearson correlation with academic performance, while PEET scores did not. Conclusion: GPA and TOEIC scores could potentially have predictive validity for academic performance in pharmacy school. PEET scores, however, should simply be considered as pre-entrance qualifications, without predictive validity for academic performance.