Journal of the Korea Academia-Industrial cooperation Society (한국산학기술학회논문지)

The Korea Academia-Industrial cooperation Society (한국산학기술학회)
권호 표지
DOI QR코드

DOI QR Code

A Quality Assessment of Meta-Analyses Research in Social Work

국내 사회복지 관련 메타분석 연구의 질 평가

  • Received : 2016.07.11
  • Accepted : 2016.10.07
  • Published : 2016.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

This study was conducted to evaluate the quality of meta-analysis of social work in South Korea using the Assessment of Multiple Systematic Review (AMSTAR). Electronic databases including the Korean Studies Information Service System (KISS), DBpia, and RISS4U were searched for 'meta-analysis', 'social work', and 'social welfare' from 2000 to December 2015, and 42 meta-analysis studies were included. Data were analyzed using descriptive statistics, t-tests, and ANOVA. The mean score for AMSTAR evaluation was $4.766{\pm}1.66$, while 19 studies (45.2%) were classified at the low-quality level, and 22 (52.4%) were at the moderate-quality level. The scores of quality assessment were analyzed by publication year, participants, number of studies included, number of DB, reporting study quality, extraction diagram and topics. The findings indicated that the following changes should be implemented to improve the quality and reliability of meta-analysis results in social work research: 1) common reporting guidelines should be provided for the social work field, 2) quality analyses of each study should be conducted to achieve a high level of evidence of effectiveness of social work interventions, 3) the characteristics of the included studies should be provided, and 4) a consensus and procedure based on at least two independent data extractors should be reported.

본 연구의 목적은 사회복지관련 메타분석 연구를 대상으로 Assessment of Multiple Systematic Reviews (AMSTAR) 도구를 이용하여 질 평가를 하기 위한 서술적 조사연구이다. '메타분석', '사회복지', '사회사업'을 키워드로하여 2000년부터 2015년에 KISS, DBpia, RISS4U 데이터베이스를 이용하여 출판된 연구 중 42개의 메타분석 연구에 대해 질 평가를 실시하였다. 수집된 자료는 기술통계, 독립집단 t-test, 일원분산분석으로 분석되었다. 평균 AMSTAR 질 평가점수는 $4.76{\pm}1.66$점이었고, 낮은 수준이 19개(45.2%), 중간 수준이 22개(52.4%), 높은 수준이 1개(2.4%)이었다. 질 평가점수는 연구의 특성인 출판년도, 대상자, 분석논문의수, DB의 수, 저널유형, 재정지원 유무, 연구의 질 평가유무, 분석대상논문을 추출흐름도 유무, 주제에 따라 차이가 분석되었다. 질 평가점수는 출판년도, DB의 수, 연구의 질 평가유무, 분석대상논문을 추출흐름도 유무에 따라 통계적으로 유의한 차이가 있었고, 4개 요인이 메타분석 연구의 질에 영향을 미치는 요인으로 51.9%의 설명력이 있었다. 본 연구는 메타분석 연구의 질을 향상시키기 위해 필요한 가이드라인을 제시하는데 기여하고 있다. 본 연구는 사회복지 분야 메타분석 연구의 질 향상과 분석 결과의 신뢰성 확보를 위하여 첫째, 메타분석 보고를 위한 공통적이고 구체적인 가이드라인을 마련하고 공유하는 것, 둘째, 근거기반의 실천적 개입을 위해서는 질 평가를 통해 근거강도가 높은 논문의 결과를 메타분석으로 합성하는 것, 셋째, 분석대상 논문의 연구특성을 제시하는 것, 마지막으로 문헌선택과 자료추출 과정에서 두 명이상의 연구자에 의한 독립적 실시와 최종 문헌추출을 위한 합의과정과 이해상충여부가 보고되어야 함을 제안하고 있다.

Keywords

References

  1. Y. M. Kim, M. J. Park, "A study on social worker attitude toward the adoption of evidence-based practice", Social Science Research Review, vol. 23, no. 2, pp. 281-303, 2007.
  2. S. D. Hwang, "Validation of evidence-based practice attitude scale", Social Science Research Review, vol. 27, no. 4, pp. 77-97, 2011.
  3. Z. Gellis, W. J. Reid, "Strengthening evidence-based practice", Brief Treatment and Crisis Intervention, vol. 4, no. 2, pp. 155-165, 2004. DOI: http://dx.doi.org/10.1093/brief-treatment/mhh012
  4. G. V. Glass, "Primary, secondary, and meta-analysis of research", Educational Researcher, vol. 5, no. 10, pp. 3-8, 1976. DOI: http://dx.doi.org/10.3102/0013189X005010003
  5. L. Videka-Sherman, "Meta-analysis of research on social work practice in mental health", Social Work, vol. 33, no. 4, pp. 325-338, 1988.
  6. K. Gorey, B. Thyer, D. Pawluck, "Differential effectiveness of prevalent social work practice models: a meta-analysis", Social Work, vol. 43, no. 3, pp. 269-278, 1998. DOI: http://dx.doi.org/10.1093/sw/43.3.269
  7. S. S. Oh, Meta analysis : Theory and practice, pp. 1-283, Konkuk publisher, Seoul, 2011.
  8. D. J. Cook, D. L. Sackett, W. O. Spitzer, "Meteorologic guidelines for systematic reviews of randomized controlled trials in health care from the Postdam consultation on meta-analysis", Journal of Clinical Epidemiology, vol. 48, no. 1, pp. 167-171, 1995. DOI: http://dx.doi.org/10.1016/0895-4356(94)00172-M
  9. D. Moher, D. J. Cook, S. Eastwood, I. Olkin, D. F. Stroup, "Improving the quality of reports of metal-analyses of randomized controlled trials: the QUORUM statement", The Lancet, vol. 357, no. 27, pp. 1896-1900, 1999. DOI: http://dx.doi.org/10.1016/S0140-6736(99)04149-5
  10. S. D. Park, I. S. Shin, "A review of meta-analysis research in early childhood education", Journal of Early Childhood Education, vol. 34, no. 2, pp. 393-412, 2014. DOI: http://dx.doi.org/10.18023/kjece.2014.34.2.018
  11. Y. S. Song, M. H. Gang, S. A. Kim, I. S. Shin, "Review of meta-analysis research on exercise in south Korea", Journal of Korean Academy of Nursing, vol. 44, no. 5, pp. 459-470, 2014. DOI: http://dx.doi.org/10.4040/jkan.2014.44.5.459
  12. B. J. Shea, C. Hamel, G. A. Wells, L. M. Bouter, E. Kristjansson, J. Grimshaw, D. A. Henry, M. Boers, "AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews", Journal of Clinical Epidemiology, vol. 62, no. 10, pp. 1013-1020, 2009. DOI: http://dx.doi.org/10.1016/j.jclinepi.2008.10.009
  13. J. H. Kim, A. K. Kim, "A quality assessment of meta-analyses of nursing in South Korea", Journal of Koran Academy of Nursing, vol. 43, no. 6, pp. 736-745, 2013. DOI: http://dx.doi.org/10.4040/jkan.2013.43.6.736
  14. I. S. Shin, E. Y. Park, "Review of the meta-analysis research in special education and related field", Korean Journal of Physical and Multiple Disability, vol. 54, no. 4, pp. 157-176, 2011. https://doi.org/10.20971/kcpmd.2011.54.4.157
  15. Y. S. Song, M. H. Gang, S. A. Kim, "Methodological quality of meta-analyses on the elderly in Korea", The Korean Association for Local Government & Administration Studies, vol. 28, no. 4, pp. 349-370, 2014. DOI: http://dx.doi.org/10.18398/kjlgas.2014.28.4.349
  16. C. Mikton, A. Butchart, "Child maltreatment prevention: a systematic review of reviews", Bulletin of the World Health Organization, vol. 87, no. 5, pp. 353-361, 2009. DOI: http://dx.doi.org/10.2471/BLT.08.057075
  17. J. A. Bellon, P. Moreno-Peral, E. Motrico, A. Rodriguez-Morejon, A. Fernandez, A. Serrano-Blanco, E. Zabaleta-del-Olmo, S. Conejo-Ceron, "Effectiveness of psychological and/or educational interventions to prevent the onset of episodes of depression: a systematic review of systematic reviews and meta-analyses", Preventive Medicine, vol. 76, pp. 522-532, 2015. DOI: http://dx.doi.org/10.1016/j.ypmed.2014.11.003
  18. S. Y. Kim, J. E. Park, H. J. Seo, H. S. Seo, H. J. Sohn, C. M. Shin, Y. J. Lee, B. H. Jang, D. S. Heo, "NECA's guidance for undertaking systematic reviews and meta-analyses for intervention", National Evidence-based Healthcare Collaborating Agency, pp. 1-287, 2011.
  19. S. D. Lee, S. J. Kim, D. M. Yeum, "Discussion and proposal for metal-analysis papers of social welfare field", Journal of Korea Contents Association, vol. 14, no. 1, pp. 209-222, 2014. DOI: http://dx.doi.org/10.5392/JKCA.2014.14.01.209
  20. B. J. Shea, J. M. Grimshaw, G. A. Wells, M. Boers, N. Andersson, C. Hamel, A. C. Porter, P. Tugwell, D. Moher, L. M. Bouter, "Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews", BioMed Central Medical Research Methodology, pp. 7-10, 2007. DOI: http://dx.doi.org/10.1186/1471-2288-7-10
  21. M. O. Suh, "The review of meta-analysis and research methodology proposed", Korean Journal of Educational Research, vol. 49, no. 2, pp. 1-23, 2011.