Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

An Analysis of Reliability and Discrimination Power on Evaluation Criteria of Dream Start Services

드림스타트 사업 평가지표의 신뢰도와 변별력 측정

  • 송미령 (한양대학교 교육문제연구소) ;
  • 김정화 (목포대학교 아동학과)
  • Received : 2018.11.08
  • Accepted : 2019.02.01
  • Published : 2019.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

This research examines whether the evaluation index used Dream Start services operation evaluation has 'reliability in evaluation field and area' and 'whether there is discrimination according to evaluation index'. To do this, we conducted an empirical analysis based on the evaluation data of 126 municipal and provincial governments that received the 2018 Dream Start services operation evaluation. First, as a result of examining whether there is trust in each evaluation area, it was found that the reliability of the basic construction, integrated case management, and service operation field is higher than .6 and the lower evaluation indexes are the same Standards were met. However, the field of resource exploit and connectivity was not so reliable as the concept of sub-domains. Second, 'Are there discriminatory power according to the evaluation indexes?' The results showed that 18 of the 28 indicators were highly discriminative. On the other hand, 10 indicators showed low discrimination power.

본 논문은 드림스타트 사업평가에 사용된 평가지표가 '평가분야 및 영역별 신뢰도가 있는지'와 '평가지표별 변별력이 있는지'를 분석하고자 하였다. 이를 살펴보기 위하여 2018년 드림스타트 사업운영 평가를 받은 126개 시군구의 평가 자료를 바탕으로 실증적인 분석을 하였다. 연구결과는 첫째, 평가영역별 신뢰도를 살펴본 결과, 기본구성, 통합사례관리, 서비스 운영의 평가지표에 대한 신뢰도가 .6 이상으로 하위 평가지표들이 상위 평가분야와 같은 개념으로 볼 수 있는 최소기준을 충족하였다. 그러나 자원 개발 및 연계 분야는 신뢰도가 낮게 파악되었다. 평가영역별로 보면, 통합사례관리 분야에서 사례관리 과정에 대한 하위 평가지표의 신뢰도는 높았으나 기본구성 분야에서 사업운영 체계, 전담조직 및 인력을 확인하는 평가지표간의 신뢰도가 낮았고, 사례회의, 서비스 운영을 확인할 수 있는 하위 지표 간의 신뢰도가 낮게 나타났다. 둘째, 평가지표별 변별력을 측정한 결과, 28개 지표 중 18개 지표는 변별력이 높은 것으로 분석되었다. 반면 10개 지표는 변별력이 낮은 것으로 나타났다.

Keywords

Table 1. Dream Start Evaluation Index Form

SHGSCZ_2019_v20n2_210_t0001.png 이미지

Table 2. Dream Start evaluation Index Scores

SHGSCZ_2019_v20n2_210_t0002.png 이미지

Table 3. Dream Start Evaluation Index Reliability

SHGSCZ_2019_v20n2_210_t0003.png 이미지

Table 4. Correlation between Score and Total Score by Evaluation Index

SHGSCZ_2019_v20n2_210_t0004.png 이미지

References

  1. I. J. Chung, K. C. Nam & Y. J. Chun, "Development of services operation model by Dream Start regional type" Seoul: Ministry of Health & Welfare, 2009.
  2. J. W. Kim, J. J. An, M. R. Song, Y. R. Cho & H. S. Kim, "2013 Dreamstart effectiveness report", Korea Childcare Promotion Institute & Ministry of Health & Welfare, 2013.
  3. M. S. Kim, "The Well-being of Children in Poverty and Income Support Policy", Health and Welfare Forum, 206, pp. 35-47, Korea Institute for Health and Social Affairs, 2013.
  4. Y. K. Lee, J. S. Kim, "A Study on the Recognition of Social Welfare Facilities Evaluation Index", Korean public management review, 25(1), pp. 33-56, 2011. https://doi.org/10.24210/kapm.2011.25.1.002
  5. C. S. Lee, "An analysis of the Discriminating Power of Medical Journal Evaluation Criteria", Journal of the Korean Biblia Society for Library and Information Science, 14(1), pp. 199-218. 2003.
  6. Health and Welfare Ministry, "Dream Start Guide", Seoul: Ministry of Health & Welfare, 2018.
  7. M. Y. Song, H. J. Park, "An Analysis of Reliability and Discrimination Power on Evaluation Criteria of Community Child Center", Journal of Social Science, 21(2), pp. 109-136, 2010. DOI: https://doi.org/10.16881/jss.2010.04.21.2.109
  8. Ministry of Government Legislation, Child Welfare Act, 2018.
  9. O. K. Yang. "Study on Development of the Family Relationship Scale". Korean Journal of Family Social Work, 8, pp.119-147, 2001.
  10. Y. S. Kim, E. Y. Lee, K. E. Ko & E. H. Min, "Reliability and Validity of the Korean Version of the Client Satisfaction Inventory", Korean Journal of Social Welfare, 59(4), pp. 83-109, 2007. DOI: https://doi.org/10.20970/kasw.2007.59.4.004
  11. Van de Ven A.H. & Ferry, D.L. "Measuring and Assessing Organizations", New York: Wiley. 1980.
  12. S. W. Lee, S. M. Choi, "Where Does the Evaluation of Social Welfare Institutions Stand and Where It Should Go?", Social Welfare policy, 15, pp. 133-154, 2002.
  13. S. M. Woo, " SPSS for Windows 10.0/11.0 to hold with Mouse", Seoul: Human & Welfare, 2003.