Korean Journal of Community Nutrition (대한지역사회영양학회지)

The Korean Society of Community Nutrition (대한지역사회영양학회)
권호 표지
DOI QR코드

DOI QR Code

Program Evaluation using the RE-AIM Framework: A Systematic Review and Application to a Pilot Health Promotion Program for Children

RE-AIM 프레임워크를 이용한 프로그램 평가: 체계적 고찰과 어린이 대상 건강증진 프로그램 평가

  • Lee, Ji-Eun (Department of Food service Management and Nutrition, Sangmyung University) ;
  • Shim, Jae Eun (Department of Food and Nutrition, Daejeon University) ;
  • Kim, Kirang (Department of Food Science and Nutrition, Dankook University) ;
  • Kang, Jae-Heon (Department of Family Medicine, Kangbuk Samaung Hospital, School of Medicine, Sungkyunkwan University) ;
  • Hwang, Ji-Yun (Major of Foodservice Management and Nutrition, Sangmyung University)
  • 이지은 (상명대학교 대학원 외식영양학과) ;
  • 심재은 (대전대학교 식품영양학과) ;
  • 김기랑 (단국대학교 식품영양학과) ;
  • 강재헌 (성균관대학교 의과대학 강북삼성병원 가정의학과) ;
  • 황지윤 (상명대학교 식품영양학전공)
  • Received : 2022.06.15
  • Accepted : 2022.08.08
  • Published : 2022.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives: This study aimed to develop evaluation criteria for the elementary-school-based health promotion program using the RE-AIM framework and to examine their feasibility. Methods: Previous evaluation studies on health interventions for elementary-school students using the RE-AIM framework were reviewed systematically to identify appropriate evaluation criteria. A diet and physical activity intervention based on the transtheoretical model was implemented in a pilot study using the "Happy Me" application. The feasibility of using the RE-AIM framework to evaluate it was examined. Results: The review yielded the following evaluation criteria: "reach," the ratio of participants out of the total target population; "efficacy/effectiveness," the difference in outcomes between the intervention and control groups, or between a pre- and post-test; "adoption," the rate of use of the program and participation in the next stage of the program; "implementation," the progress on the program components; "maintenance," the participants' and teachers' intention to continue using the program. The pilot study reached 76.6% of the targeted population. The intake of sugar-sweetened beverages decreased (P < 0.0001), and the duration of walking increased (P < 0.0001). Other indicators could not be evaluated; therefore, potential indicators were suggested. Conclusions: This study produced feasible evaluation criteria for elementary-school-based health promotion using the RE-AIM framework. Nevertheless, the feasibility needs to be validated with a broader range of studies and long-term interventions.

Keywords

Acknowledgement

This work was supported by the Bio & Medical Technology Development Program of the National Research Foundation (civil research project for solving social problems through the National Research Foundation of Korea (NRF)) and funded by the Ministry of Science, ICT & Future Planning (Grant No. 2013M3C8A2A01078464, 2014M3C8A2A01070970, NRF-2020R1A2C1011675).

References

  1. Ogden CL, Carroll MD, Curtin LR, Lamb MM, Flegal KM. Prevalence of high body mass index in US children and adolescents, 2007-2008. J Am Med Assoc 2010; 303(3): 242-249. https://doi.org/10.1001/jama.2009.2012
  2. Ng M, Fleming T, Robinson M, Thomson B, Graetz N, Margono C et al. Global, regional, and national prevalence of overweight and obesity in children and adults during 1980-2013: A systematic analysis for the global burden of disease study 2013. Lancet 2014; 384(9945): 766-781. https://doi.org/10.1016/S0140-6736(14)60460-8
  3. Freedman DS, Kettel L, Serdula MK, Dietz WH, Srinivasan SR, Berenson GS. The relation of childhood BMI to adult adiposity: The Bogalusa Heart Study. Pediatrics 2005; 115(1): 22-27. https://doi.org/10.1542/peds.2004-0220
  4. Freedman D, Wang J, Thornton JC, Mei Z, Sopher AB, Pierson RN et al. Classification of body fatness by body mass index-for-age categories among children. Arch Pediatr Adolesc Med 2009; 163(9): 805-811. https://doi.org/10.1001/archpediatrics.2009.104
  5. Benjamin RM. The Surgeon General's vision for a healthy and fit nation. Public Health Rep 2010; 125(4): 514-515. https://doi.org/10.1177/003335491012500402
  6. Nader PR, O'Brien M, Houts R, Bradley R, Belsky J, Crosnoe R et al. Identifying risk for obesity in early childhood. Pediatrics 2006; 118(3): e594-e601. https://doi.org/10.1542/peds.2005-2801
  7. Biro FM, Wien M. Childhood obesity and adult morbidities. Am J Clin Nutr 2010; 91(5): 1499S-1505S. https://doi.org/10.3945/ajcn.2010.28701B
  8. Centers for Disease Control and Prevention (CDC). School health guidelines to promote healthy eating and physical activity. Morb Mortal Wkly Rep 2011; 60(RR-5): 1.
  9. De Bourdeaudhuij I, Van Cauwenberghe E, Spittaels H, Oppert, JM, Rostami C, Brug J et al. School-based interventions promoting both physical activity and healthy eating in Europe: A systematic review within the HOPE project. Obes Rev 2011; 12(3): 205-216. https://doi.org/10.1111/j.1467-789X.2009.00711.x
  10. Van Cauwenberghe E, Maes L, Spittaels H, van Lenthe FJ, Brug J, Oppert JM et al. Effectiveness of school-based interventions in Europe to promote healthy nutrition in children and adolescents: Systematic review of published and 'grey'literature. Br J Nutr 2010; 103(6): 781-797. https://doi.org/10.1017/S0007114509993370
  11. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: The RE-AIM framework. Am J Public Health 1999; 89(9): 1322-1327. https://doi.org/10.2105/AJPH.89.9.1322
  12. Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: Using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res 2006; 21(5): 688-694. https://doi.org/10.1093/her/cyl081
  13. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: A systematic review of use over time. Am J Public Health 2013; 103(6): e38-e46. https://doi.org/10.2105/AJPH.2013.301299
  14. Kim YA. Our Class Revolution: Current situation of smart learning and development plan (OR2011-02-7). Seoul: Korean Educational Development Institute; 2011.
  15. Turner-McGrievy GM, Beets MW, Moore JB, Kaczynski AT, Barr-Anderson DJ, Tate DF. Comparison of traditional versus mobile app self-monitoring of physical activity and dietary intake among overweight adults participating in an mHealth weight loss program. J Am Med Inform Assoc 2013; 20(3): 513-518. https://doi.org/10.1136/amiajnl-2012-001510
  16. Prochaska JO, DiClemente CC, Norcross JC. In search of how people change: Applications to addictive behaviors. Am Psychol 1992; 47(9): 1102-1114. https://doi.org/10.1037/0003-066X.47.9.1102
  17. Prochaska JO, Redding CA, Evers KE. The transtheoretical model and stages of change. In: Glanz K, Rimer BK, Viswanath K, editors. Health behavior and health education. San Francisco (CA): John Wiley & Sons; 2008. p. 97-122.
  18. Carvalho de Menezes M, Bedeschi LB, Santos LC, Lopes AC. Interventions directed at eating habits and physical activity using the Transtheoretical Model: A systematic review. Nutr Hosp 2016; 33(5): 1194-1204.
  19. Partridge SR, McGeechan K, Hebden L, Balestracci K, Wong AT, Denney-Wilson E et al. Effectiveness of a mHealth lifestyle program with telephone support (TXT2BFiT) to prevent unhealthy weight gain in young adults: Randomized controlled trial. JMIR Mhealth Uhealth 2015; 3(2): e66.
  20. Jung JH, Jeon SH, Bae HJ, Cho YG, Hur YI, Sung EJ et al. Development of a smartphone application for 4th-6th grade elementary students aimed to prevent childhood obesity. Korean J Obes 2016; 25(2): 99-104. https://doi.org/10.7570/kjo.2016.25.2.99
  21. Kim K, Kang J, Park HA, Cho SH, Jeon S, Jung J et al. Development of a smartphone application prototype for child obesity prevention: rationale and study design of acceptability and feasibility tests. Korean J Health Promot 2015; 15(4): 194-201 https://doi.org/10.15384/kjhp.2015.15.4.194
  22. Collard DC, Chinapaw MJ, Verhagen EA, Van Mechelen W. Process evaluation of a school based physical activity related injury prevention programme using the RE-AIM framework. BMC pediatrics 2010; 10(1): 86.
  23. Janssen M, Toussaint HM, Van Mechelen W, Verhagen EA. Translating the PLAYgrounds program into practice: A process evaluation using the RE-AIM framework. J Sci Med Sport 2013; 16(3): 211-216. https://doi.org/10.1016/j.jsams.2012.06.009
  24. Dunton GF, Liao Y, Grana R, Lagloire R, Riggs N, Chou CP et al. State-wide dissemination of a school-based nutrition education programme: A RE-AIM (Reach, Efficacy, Adoption, Implementation, Maintenance) analysis. Public Health Nutr 2014; 17(2): 422-430. https://doi.org/10.1017/S1368980012005186
  25. Larsen AL, Robertson T, Dunton G. RE-AIM analysis of a randomized school-based nutrition intervention among fourth-grade classrooms in California. Transl Behav Med 2015; 5(3): 315-326. https://doi.org/10.1007/s13142-015-0311-6
  26. De Meij JS, Chinapaw MJ, Kremers SP, Jurg ME, Van Mechelen W. Promoting physical activity in children: The stepwise development of the primary school-based JUMP-in intervention applying the RE-AIM evaluation framework. Br J Sports Med 2010; 44(12): 879-887. https://doi.org/10.1136/bjsm.2008.053827
  27. Wozniak L, Rees S, Soprovich A, Al Sayah F, Johnson ST, Majumdar SR et al. Applying the RE-AIM framework to the Alberta's Caring for Diabetes Project: A protocol for a comprehensive evaluation of primary care quality improvement interventions. BMJ open 2012; 2(5): e002099.
  28. Kim HK, Kim M, Lee EH, Kwon EJ, Cho HI. Development of "Drink smart" alcohol education program for university students: Application of the intervention mapping and transtheoretical model. Korean J Health Educ Promot 2011; 28(5): 145-160.
  29. Woolford SJ, Clark SJ, Strecher VJ, Resnicow K. Tailored mobile phone text messages as an adjunct to obesity treatment for adolescents. J Telemed Telecare 2010; 16(8): 458-461. https://doi.org/10.1258/jtt.2010.100207
  30. Burke LE, Styn MA, Sereika SM, Conroy MB, Ye L, Granz K et al. Using mHealth technology to enhance self-monitoring for weight loss: A randomized trial. Am J Prev Med 2012; 43(1): 20-26. https://doi.org/10.1016/j.amepre.2012.03.016
  31. De Niet J, Timman R, Bauer S, van den Akker E, de Klerk C, Kordy H et al. Short message service reduces dropout in childhood obesity treatment: A randomized controlled trial. Health Psychol 2012; 31(6): 797-805. https://doi.org/10.1037/a0027498
  32. Turner-McGrievy GM, Beets MW, Moore JB, Kaczynski AT, Barr-Anderson DJ, Tate DF. Comparison of traditional versus mobile app self-monitoring of physical activity and dietary intake among overweight adults participating in an mHealth weight loss program. J Am Med Inform Assoc 2013; 20(3): 513-518. https://doi.org/10.1136/amiajnl-2012-001510
  33. Kim JW, Lee EJ. Current status of dietary education applications (App) as a smart education material. J Korean Pract Arts Educ 2013; 26(4): 81-110.
  34. Woolford SJ, Clark SJ, Strecher VJ, Resnicow K. Tailored mobile phone text messages as an adjunct to obesity treatment for adolescents. J Telemed Telecare 2010; 6(8): 458-461.
  35. Andres A, Gomez J, Saldana C. The transtheoretical model and obesity: A bibliometric study. Scientometrics 2007; 73(3): 289-301. https://doi.org/10.1007/s11192-007-1692-1
  36. Kim HH, Seo HJ. HealthTWITTER initiative: Design of a social networking service based tailored application for diabetes self-management. Healthc Inform Res 2014; 20(3): 226-230. https://doi.org/10.4258/hir.2014.20.3.226
  37. Lee MK, Park HA, Yun YH, Chang YJ. Development and formative evaluation of a web-based self-management exercise and diet intervention program with tailored motivation and action planning for cancer survivors. JMIR Res Protoc 2013; 2(1): e11.
  38. Partridge SR, McGeechan K, Hebden L, Balestracci K, Wong AT, Denney-Wilson E et al. Effectiveness of a mHealth lifestyle program with telephone support (TXT2BFiT) to prevent unhealthy weight gain in young adults: Randomized controlled trial. JMIR Mhealth Uhealth 2015; 3(2): e66.
  39. Steinberg DM, Levine EL, Askew S, Foley P, Bennett GG. Daily text messaging for weight control among racial and ethnic minority women: Randomized controlled pilot study. J Med Internet Res 2013; 15(11): e244.
  40. Shaya FT, Flores D, Gbarayor CM, Wang J. School-based obesity interventions: A literature review. J Sch Health 2008; 78(4): 189-196. https://doi.org/10.1111/j.1746-1561.2008.00285.x
  41. Lee JE, Lee DE, Kim K, Shim JE, Sung E, Kang JH et al. Development of tailored nutrition information messages based on the transtheoretical model for smartphone application of an obesity prevention and management program for elementary-school students. Nutr Res Pract 2017; 11(3): 247-256. https://doi.org/10.4162/nrp.2017.11.3.247