• Title/Summary/Keyword: Consistency in Assessment

Search Result 337, Processing Time 0.032 seconds

Reliability and Accuracy of the Deployable Particulate Impact Sampler for Application to Spatial PM2.5 Sampling in Seoul, Korea (서울시 PM2.5 공간 샘플링을 위한 Deployable Particulate Impact Sampler의 성능 검증 연구)

  • Oh, Gyu-Lim;Heo, Jong-Bae;Yi, Seung-Muk;Kim, Sun-Young
    • Journal of Korean Society for Atmospheric Environment
    • /
    • v.33 no.3
    • /
    • pp.277-288
    • /
    • 2017
  • Previous studies of health effects of $PM_{2.5}$ performed spatial monitoring campaigns to assess spatial variability of $PM_{2.5}$ across people's residences. Highly reliable portable and cost-effective samplers will be useful for such campaigns. This study aimed to investigate applicability of the Deployable Particulate Impact Sampler(DPIS), one of the compact impact samplers, to spatial monitoring campaigns of $PM_{2.5}$ in Seoul, Korea. The investigation focused on the consistency of $PM_{2.5}$ concentrations measured by DPISs compared to those by the Low-volume Cyclone sampler (LCS). LCS has operated at a fixed site in the Seoul National University Yeongeon campus, Seoul, Korea since 2003 and provided qualified $PM_{2.5}$ data. $PM_{2.5}$ sampling of DPISs was carried out at the same site from November 17, 2015 through February 3, 2016. $PM_{2.5}$ concentrations were quantified by the gravimetric method. Using a duplicated DPIS, we confirmed the reliability of DPIS by computing relative precision and mean square error-based R squared value ($R^2$). Relative precision was one minus the difference of measurements between two samplers relative to the sum. For accuracy, we compared $PM_{2.5}$ concentrations from four DPISs (DPIS_Tg, DPIS_To, DPIS_Qg, and DPIS_Qo) to those of LCS. Four samplers included two types of collection filters(Teflon, T; quartz, Q) and impaction discs(glass fiber filter, g; pre-oiled porous plastic disc, o). We assessed accuracy using accuracy value which is one minus the difference between DPIS and LCS $PM_{2.5}$ relative to LCS $PM_{2.5}$ in addition to $R^2$. DPIS showed high reliability (average precision=97.28%, $R^2=0.98$). Accuracy was generally high for all DPISs (average accuracy=83.78~88.88%, $R^2=0.89{\sim}0.93$) except for DPIS_Qg (77.35~78.35%, 0.82~0.84). Our results of high accuracy of DPIS compared to LCS suggested that DPIS will help the assessment of people's individual exposure to $PM_{2.5}$ in extensive spatial monitoring campaigns.

Development and Validation of the Post-bereavement Growth Inventory in Later Life (노년기 사별 후 성장척도의 개발 및 타당화)

  • Chang, Sujie
    • Korean Journal of Social Welfare
    • /
    • v.67 no.2
    • /
    • pp.61-84
    • /
    • 2015
  • The purpose of this study was to develop the Post-bereavement Growth Inventory(PBGI) for the elderly and to evaluate its validity. The items for developing PBGI were compiled from a literature search, content validity review, and a preliminary survey. A main survey of 308 widowed persons(aged 60+) was conducted. The results were as follows. First, an exploratory factor analysis revealed six factors of the PBGI. The results of the confirmatory factor analysis supported a five-factor structure for the final 24 scale items of scale. Second, in terms of concurrent validity, the PGBI compared favorably with the "Personal Growth" scale from The Hogan Grief Reaction Checklist (HGRC: Hogan and Schimdt, 2001). Third, the results of contrast group validity tests demonstrated that the group scoring in the upper 30% on the scales of Psychological Well-being (PWB, Ryff and Keyes, 1995) and the Grief Reaction Inventory (GRI: Remondet and Hansson, 1987) showed a significantly higher degree of post-bereavement growth (PBG) than the group scoring in the lower 30%. Fourth, Cronbach's ${\alpha}$ values for the five factors were between .649-.856 and .907 overall, indicating high internal consistency. Finally, education had the most significant influence on PBG. All results indicated the high validity of the PBGI. The findings from this study could provide the rationale for practical interventions from a growth-oriented perspective for widowed persons, as well as an objective assessment tool for practitioners in clinical areas.

  • PDF

A Study on the evaluation technique rubric suitable for the characteristics of digital design subject (디지털 디자인 과목의 특성에 적합한 평가기법 루브릭에 관한 연구)

  • Cho, Hyun Kyung
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.6
    • /
    • pp.525-530
    • /
    • 2023
  • Digital drawing subjects require the subdivision of evaluation elements and the graduality of evaluation according to the recent movement of the innovative curriculum. The purpose of this paper is to present the criteria for evaluating the drawing and to propose it as a rubric evaluation. In the text, criteria for beginner evaluation were technical skills such as the accuracy and consistency of the line, the ratio and balance of the picture, and the ability to effectively utilize various brushes and tools at the intermediate levels. In the advanced evaluation section, it is a part of a new perspective or originality centered on creativity and originality, and a unique perspective or interpretation of a given subject. In addition, as an understanding of design principles, the evaluation of completeness was derived focusing on the ability to actively utilize various functions of digital drawing software through design principles such as placement, color, and shape. The importance of introducing rubric evaluation is to allow instructors to make objective and consistent evaluations, and the key to research in rubric evaluation in these art subjects is to help learners clearly grasp their strengths and weaknesses, and learners can identify what needs to be improved and develop better drawing skills accordingly through feedback on each item.

An Assessment and Review of IUCN Red List for Vascular Plants in Korean Peninsula (한반도 관속식물 IUCN 적색목록 평가와 문제점)

  • Chang, Chin-Sung;Kim, Hye Won;Kim, Hui
    • Journal of Korean Society of Forest Science
    • /
    • v.106 no.2
    • /
    • pp.111-120
    • /
    • 2017
  • The best source of information on the conservation status of species at a global scale is the IUCN Red List of Threatened Species. Until now, 236 vascular plants from Korean peninsula have been evaluated using the IUCN red list categories and criteria. It indicated that five taxa were considered as critically endangered, 20 as endangered and nine as vulnerable species as a threatened status. On the other hand, the rest (189 taxa) were assessed as a least concern, which did not qualify for threatened species categories. Korea Ministry of Environment published a revised version of 57 species list by re-classifying endangered species with idiosyncratic qualitative criteria for two levels (I and II) followed by status reviews in 2011. However, two thirds species proposed by Ministry of Environment do not qualify as threatened. The major difficulties found in applying IUCN Red List criteria at the global scale was a lack of knowledge on the status of species at broader geographic scales and the perceived difficulty the causes. The lack of consistency between two lists constrains the prioritization of species-based conservation work at the national level. Due to a lack of centralized monitoring data for most species, this status is largely qualitatively and so it carries a high level of uncertainty. This is reflected in the high number of species with an unknown population trend. The current list of endangered species of flora and fauna by the Ministry of Environment should be recognized as the national list (local and population extinction), which is different from the IUCN Red list due to the different geographical contexts. Also, it is necessary to improve the quality of evaluation and conservation management system rather than presenting massive number of endangered species list.

Development of Dual-task Based Cognitive Function Screening Test for the Elderly (이중과제를 활용한 노인인지기능 선별검사 개발)

  • Kwak, Ho-Soung;Yoo, Eun-Young;Park, Hae Yean;Lee, Seo-Hyun;Han, Dae-Sung;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.9 no.4
    • /
    • pp.69-81
    • /
    • 2020
  • Objective : The purpose of this study was to develop a Yonsei dual task cognitive screening test (Y-DuCog) for the elderly. Methods : The reliability and validity test of Y-DuCog (Yonsei Dual Task Cognitive Screening Test) was developed by 229 elderly people aged over 60 years from community organizations at Gyeonggi-do and Chungcheong-do from May 2019 to August 2019. In addition, the criteria for classifying elderly with cognitive impairment were presented. Results : The correlation analysis between MMSE-K, MoCA-K and Y-DuCog were a correlation between the DTE and CRR of Y-DuCog. As a result of internal consistency, Cronbach's-α values of DTE and CRR showed .848 (p<.01) and .916 (p<.01), respectively. The test-retest reliability was high. The screening point showed 88.7% sensitivity and 83.5% specificity at 31.76 seconds in total DTE, and 84.5% sensitivity and 76.6% specificity at 0.38 in total dual-task CRR. Conclusion : This study verified the reliability and validity of Y-DuCog. It was found that the level of education was not a barrier to the undertaking of this test. Furthermore, the test could be performed easily and quickly. It is also expected to be used to evaluate the effectiveness of cognitive function assessment and intervention methods in the elderly.

Development of Chicken Carcass Segmentation Algorithm using Image Processing System (영상처리 시스템을 이용한 닭 도체 부위 분할 알고리즘 개발)

  • Cho, Sung-Ho;Lee, Hyo-Jai;Hwang, Jung-Ho;Choi, Sun;Lee, Hoyoung
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.22 no.3
    • /
    • pp.446-452
    • /
    • 2021
  • As a higher standard for food consumption is required, the consumption of chicken meat that can satisfy the subdivided food preferences is increasing. In March 2003, the quality criteria for chicken carcasses notified by the Livestock Quality Assessment Service suggested quality grades according to fecal contamination and the size and weight of blood and bruises. On the other hand, it is too difficult for human inspection to qualify mass products, which is key to maintaining consistency for grading thousands of chicken carcasses. This paper proposed the computer vision algorithm as a non-destructive inspection, which can identify chicken carcass parts according to the detailed standards. To inspect the chicken carcasses conveyed at high speed, the image calibration was involved in providing robustness to the side effect of external lighting interference. The separation between chicken and background was achieved by a series of image processing, such as binarization based on Expectation Maximization, Erosion, and Labeling. In terms of shape analysis of chicken carcasses, the features are presented to reveal geometric information. After applying the algorithm to 78 chicken carcass samples, the algorithm was effective in segmenting chicken carcass against a background and analyzing its geometric features.

Quantitative Deterioration and Maintenance Profiles of Typical Steel Bridges based on Response Surface Method (응답면 기법을 이용한 강교의 열화 및 보수보강 정량화 이력 모델)

  • Park, Seung-Hyun;Park, Kyung Hoon;Kim, Hee Joong;Kong, Jung-Sik
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.28 no.6A
    • /
    • pp.765-778
    • /
    • 2008
  • Performance Profiles are essential to predict the performance variation over time for the bridge management system (BMS) based on risk management. In general, condition profiles based on experts opinion and/or visual inspection records have been used widely because obtaining profiles based on real performance is not easy. However, those condition profiles usually don't give a good consistency to the safety of bridges, causing practical problems for the effective bridge management. The accuracy of performance evaluation is directly related to the accuracy of BMS. The reliability of the evaluation is important to produce the optimal solution for distributing maintenance budget reasonably. However, conventional methods of bridge assessment are not suitable for a more sophisticated decision making procedure. In this study, a method to compute quantitative performance profiles has been proposed to overcome the limitations of those conventional models. In Bridge Management Systems, the main role of performance profiles is to compute and predict the performance of bridges subject to lifetime activities with uncertainty. Therefore, the computation time for obtaining an optimal maintenance scenario is closely related to the efficiency of the performance profile. In this study, the Response Surface Method (RSM) based on independent and important design variables is developed for the rapid computation. Steel box bridges have been investigated because the number of independent design variables can be reduced significantly due to the high dependency between design variables.

Development of Korean Adult ADHD Rating Scale (한국형 성인 ADHD 평가척도 개발 연구)

  • Kang, Taewoong;Kim, Jae-Won;Bahn, Geon Ho;Song, Sook Hyung;Kim, Junwon;Kim, Ji-Hoon;Kim, Yoon-Jung;Kim, Eui-Jung;Kim, Tae-Ho;Yang, Su-Jin;Yang, Jaewon;Lee, Soyoung Irene;Park, Joon-Ho;Choi, Jeewook;Han, Doug-Hyun
    • Journal of the Korean Academy of Child and Adolescent Psychiatry
    • /
    • v.26 no.4
    • /
    • pp.295-310
    • /
    • 2015
  • Objectives : Symptoms of attention-deficit hyperactivity disorder (ADHD) during childhood may persist into adulthood. This study included the development and validation process of the Korean Adult ADHD Rating Scale (K-AARS), which was developed for screening and monitoring treatment of adults with ADHD. Methods : Preliminary questionnaires of the K-AARS were based on the reviews of previous adult ADHD scales and clinical experiences of the board certified child and adolescent psychiatrists in Korea. For this study, 136 adults (18-50 years old) with inattention, hyperactivity and/or impulsivity symptoms were enrolled as ADHD subjects, and compared with 406 control subjects (18-50 years old) without ADHD symptoms. Construct validity was examined using explorative factor analysis and Cronbach's alpha to obtain internal reliability coefficients. Concurrent validity was evaluated by comparison with the Conners' Adult ADHD Rating Scale (CAARS). Results : An explorative factor analysis showed that the K-AARS had 8 factors (inattention, hyperactivity, impulsivity, antisocial personality disorder/conduct disorder/oppositional defiant disorder, impairment, driving, emotional dysregulation, disorganization). K-AARS was highly reliable in terms of internal consistency (Cronbach's alpha 0.77-0.95) and correlation between factors (0.57-0.86). Concurrent validity with the CAARS and discriminant validity were statistically significant. Conclusion : The K-AARS is a valid and reliable measure for assessment of Korean adults with ADHD.

Validity and Reliability of a Korean Version of the Flow State Scale for Occupational Task (한글판 작업과제 몰입상태척도(Korean version of Flow State Scale for Occupational Task: K-FSSOT)의 타당도 및 신뢰도연구)

  • Lee, Jeong-Hoon;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.4
    • /
    • pp.53-63
    • /
    • 2021
  • Objective : This study aimed to develop a Korean version of the Flow State Scale for Occupational Task (K-FSSOT), to measure the level of a flow experience of a subject in occupational therapy activities. Methods : To develop a measure of K-FSSOT, validity and reliability were verified through a systematic development process. The validity was verified by calculating the content validity index (CVI) through the content validity of 10 occupational therapists and a question-and-answer survey of 20 patients. Reliability was verified by investigating the internal consistency and examination-re-test reliability of 33 patients. Results : The item-CVI for each question in the content feasibility study was .90 to 1.00, and the scale-CVI, which is the average of the whole item, was found to be appropriate at .97. The verification of reliability indicated that the intrinsic value of the entire question was high at .855, and the test-retest reliability value was high at .894 (p<.01), showing a high correlation, and very high reliability. Conclusion : K-FSSOT could be used as a useful tool to measure the level of a flow experience of the target in performing occupational therapy activities for occupational therapists concerned about the participation and flow experience of the target.

Assessment of the usefulness of the Machine Performance Check system that is an evaluation tools for the determination of daily beam output (일간 빔 출력 확인을 위한 평가도구인 Machine Performance Check의 유용성 평가)

  • Lee, Sang Hyeon;Ahn, Woo Sang;Lee, Woo Seok;Choi, Jin Hyeok;Kim, Seon Yeon
    • The Journal of Korean Society for Radiation Therapy
    • /
    • v.29 no.2
    • /
    • pp.65-73
    • /
    • 2017
  • Purpose: Machine Performance Check (MPC) is a self-checking software based on the Electronic Portal Imaging Device (EPID) to measure daily beam outputs without external installation. The purpose of this study is to verify the usefulness of MPC by comparing and correlating daily beam output of QA Beamchecker PLUS. Materials and Methods: Linear accelerator (Truebeam 2.5) was used to measure 10 energies which are composed of photon beams(6, 10, 15 MV and 6, 10 MV-FFF) and electron beams(6, 9, 12, 16 and 20 MeV). A total of 80 cycles of data was obtained by measuring beam output measurement before treatment over five months period. The Pearson correlation coefficient was used to evaluate the consistency of the beam output between the MPC and the QA Beamchecker PLUS. In this study, if the Pearson correlation coefficient is; (1) 0.8 or higher, the correlation is very strong (2) between 0.6 and 0.79, the correlation is strong (3) between 0.4 and 0.59, the correlation is moderate (4) between 0.2 and 0.39, the correlation is weak (5) lower than 0.2, the correlation is very weak. Results: Output variations observed between MPC and QA Beamchecker PLUS were within 2 % for photons and electrons. The beam outputs variations of MPC were $0.29{\pm}0.26%$ and $0.30{\pm}0.26%$ for photon and electron beams, respectively. QA Beamchecker PLUS beam outputs were $0.31{\pm}0.24%$ and $0.33{\pm}0.24%$ for photon and electron beams, respectively. The Pearson correlation coefficient between MPC and QA Beamchecker PLUS indicated that photon beams were very strong at 15 MV, and strong at 6 MV, 10 MV, 6 MV-FFF and 10 MV-FFF. For electron beams, the Pearson correlation coefficient were strong at 16 MeV and 20 MeV, moderate at 9 MeV and 12 MeV, and very weak at 6 MeV. Conclusion: MPC showed significantly strong correlation with QA Beamchecker PLUS when testing with photon beams and high-energy electron beams in the evaluation of daily beam output, but the correlation when testing with low-energy electron beams (6 MeV) appeared to be low. However, MPC and QA Beamchecker PLUS are considered to be suitable for checking daily beam output, as they performed within 2 % of beam output consistency during the observation. MPC which can perform faster than the conventional daily beam output measurement tool, is considered to be an effective method for users.

  • PDF