The Comparison Study on Observational Before-After Studies: Case Study on Safety Evaluation on Highways

관찰적 사전·사후 평가연구 방법의 비교 연구: 공용중인 고속도로 안전진단사업 효과평가를 사례로

  • Mun, Sung Ra (Graduate School of Environmental Studies, Seoul National University) ;
  • Lee, Young-Ihn (Graduate School of Environmental Studies, Seoul National University)
  • Received : 2013.08.30
  • Accepted : 2013.11.14
  • Published : 2013.12.31


This study is to perform empirical analysis on observational before-after studies in Naive Method, Comparison Group(CG) Method and Empirical Bayes(EB) Method, and to compare with their results and to propose ways to apply to evaluation researches. For this purpose, the evaluation of road safety audit executed on Y$\breve{o}$ng-dong freeway in 2005 and 2006 was performed. As a result, all three methods have showed improved effects due to safety treatments. The safety effectiveness of Naive method is the largest, CG Method is the second and EB method is the last. The results of Naive method are overestimated due to the trend of reducing traffic accidents and those of CG method are affected by the external casual effects of comparison group. In the EB method, as "regression to the mean" phenomenon are controlled by reference group's accident model, it's result is relatively more accurate than that of other methods. In the conduct of evaluation studies, the analysts have to understand the pros and cons of each evaluation method. And after leading the survey on accident trends of related all sites, evaluation analysis is performed to be able to minimize bias.


  1. Abbess C., Wright C. C. (1981), Accident at Blackspots : Estimating the Effectiveness of Remedical Treatment, With Special Reference to the Regression-tothe-mean Effect, Traffic Engineering and Control 22(10), 535-542.
  2. Al-Masaeid H. (1997), Performance of Safety Evaluation Methods, Journal of Transportation Engineering, 123(5), 364-369.
  3. Bauer K. et al. (2004), Safety Effect of Narrow Lanes and Shoulder-Use Lanes to Increase Capacity of Urban Freeways, Transportation Research Record 1897, 71-80.
  4. Benekohal R. F., Hashmi A. M. (1992), Procedures for Estimating Accident Reductions on Two-Lane Highways, Journal of Transportation Engineering, 118(1), 111-129.
  5. Brabander B., Vereeck L. (2007), Safety Effect of roundabouts in Flanders : Signal type, speed limits and vulnerable road users, Accident Analysis and Prevention 39, 591-599.
  6. Cameron A. C., Trivedi P. K. (1998), Regression Analysis of Count Data, Cambridge University Press.
  7. Chatterjee A. et al. (2005), Planning Level Regression Models for Crash Prediction on Interchange and Non- Interchange Segments of Urban Freeways, Center for Transportation Research, The University of Tennessee, Knoxville, TN.
  8. Galton Sir F. (1877), Typical Laws of Heredity, Proc. Roy. Inst., 8, 282-301.
  9. Griffin L. I., Flowers R. J. (1997), A Discussion of Six Procedures for Evaluating Highway Safety Projects, Federal Highway Administration, Publication, U.S. Department of Transportation.
  10. Griffith M. S. (1999), Safety Evaluation of Continuous Shoulder Rumble Strips Installed on Freeways, Transportation Research Record 1665, 28-34.
  11. Harwood D. et al. (2002), Safety Effectiveness of Intersection Left- and Right-Turn Lanes, Report FHWA-RD-02-089, Federal Highway Administration, Publication, U.S. Department of Transportation.
  12. Harwood D. et al. (2003), Safety Effectiveness of Intersection Left- and Right-Turn Lanes, Transportation Research Record 1840, 131-139.
  13. Hauer E. (1997), Observational Before-After Studies in Road Safety, Pergamon, Oxford, UK.
  14. Hauer E. (2004), Statistical Road Safety Modeling, Transportation Research Record 1897, 81-87.
  15. Hauer E., Lovell J., Persaud B.(1986), New Directions for Learning About Safety Effectiveness, FHWARD-86-015, U.S. DOT.
  16. Im B. I., Son Y. T., Kim H. S. (2007), An Effect Analysis on the Improvement Strategics Using Empirical Bayes method, Korean Society of Civil Engineering, Regular Conference, 1555-1558.
  17. Jovanis P., Chang H. (1986), Modeling the Relationship of Accidents to Miles Traveled, Transportation Research Record 1068, 42-51.
  18. Kim G. S., Kang S. L. (2003), A Study of the Analysis on the Accident Reduction Effect of the Median, J. Korean Soc. Transp., 21(2), Korean Society of Transportation, 45-60.
  19. Kim T. Y., Park B. H. (2009), Effects on the Accident Reduction of Red Light Camera Using Empirical Bayes Method, Journal of the Korea Institute of Intelligent Transport Systems, 8(6), 46-54.
  20. Kwon, S. K., Lee, Y. I., Cho, S. J. (2012), Estimation of Traffic Accident Effectiveness of Zig-zag Marking Using a Comparison Group Method, Journal of the Korean Society of Road Engineers, 14(6), 149-158.
  21. Lee D. M. et al. (2007), A Safety Evaluation of Shoulder Rumble Strips on Freeway Using C-G Method, Journal of the Korean Society of Road Engineers, 9(2), 77-87.
  22. Lee D. M., Kim D. H., Song K. S. (2011), Analysis of Effects From Traffic Safety Improvement on Roadways Using C-G Method, J. Korean Soc. Transp., 29(3), Korean Society of Transportation, 31-40.
  23. Lee S. B., Jung D. Y., Kim D. G. (2008), The Effects of a School Zone Improvement Project on Crash Reduction Regarding Land Use Characteristics, J. Korean Soc. Transp., 26(3), Korean Society of Transportation, 109-117.
  24. Lord D. (2000), The Prediction of Accidents on Digital Networks: Characteristics and Issues Related to the Application of Accident Prediction Models, Ph.D Dissertation, Department of Civil Engineering, University of Toronto, Toronto.
  25. Lord D., Persaud B. (2004), Estimating the Safety Performance of Urban Road Transportation Networks, Accident Analysis and Prevention 36, 609-620.
  26. Lovell J., Hauer E. (1986), The Safety Effect of Conversion to All-Way Stop Control, Transportation Research Record 1068, 103-107.
  27. Mun S. R. (2011), Development of a Traffic Accident Casualty Prediction Model on Freeway, Ph.D Dissertation, Graduate School of Environmental Studies, Seoul National University, Seoul.
  28. Mun S. R. (2012), Evaluation of Road Safety Audit on existing Freeway by Empirical Bayes Method, Journal of the Korean Society of Road Engineers, 14(2), 117-129.
  29. Oh H. U., Chang J. H. (2007), Probable Effect of Rumble Strips on Reduction of Traffic Accidents, Journal of the Korean Society of Road Engineers, 9(4), 65-74.
  30. Parajuli B., et al. (2006), Safety Performance Assessment of Interchanges, Ramps, and Ramp Terminals, Annual Conference of the Transportation Association of Canada.
  31. Park B. H., Jung Y. I., Kim K. H. (2012), Traffic Accident Reduction Effects of the All-Red Clearance Interval (ARCI) Operation, J. Korean Soc. Transp., 30(2), Korean Society of Transportation, 21-27.
  32. Park K. Y., Kim T. H., Kim S. W., Lee S. B. (2006), Comparing the Effectiveness of Road Safety Features by Spatial Scope of Safety Improvement Project, J. Korean Soc. Transp., 24(4), Korean Society of Transportation, 31-42.
  33. Park M. H., Park K. Y, Chang I. J., Lee S. B. (2006), Accident Conversion Effect Analysis of Installing Median Barriers, J. Korean Soc. Transp., 24(2), Korean Society of Transportation, 113-124.
  34. Patel R., Council F., Griffith M. (2007), Estimating Safety Benefits of Shoulder Rumble Strips on Two-Lane Rural Highways in Minnesota, Transportation Research Record 2019, 205-211.
  35. Persaud B. et al. (2001), Observational Before-After Study of the Safety Effect of U.S. Roundabout Conversions Using the Empirical Bayes Method, Transportation Research Record 1751, 1-8.
  36. Persaud B. et al. (2003), Development of a Procedure for Estimating Expected Safety Effects of a Contemplated Traffic Signal Installation, Transportation Research Record 1840, 96-103.
  37. Persaud B. et al. (2004a), Safety Evaluation of Permanent Raised Snow- Plowable Pavement Markers, Transportation Research Record 1897, 148-155.
  38. Persaud B., Retting R., Lyon C. (2004b), Crash reduction following installation of centerline rumble strips on rural two-lane roads, Accident Analysis and Prevention 36, 1073-1079.
  39. SAS 9.2 GENMOD Procedure Manual.
  40. Sayed T., El-Basyouny K. (2006), Safety Evaluation of Stop Sign In-Fill Program, Transportation Research Record 1953, 201-210.
  41. Sharma S. L., Datta T. K. (2007), Investigation of Regression-to-Mean Effect in Traffic Safety Evaluation Methodologies, Transportation Research Record 2019, 32-39.
  42. Shen J., Gan A. (2003), Development of Crash Reduction Factors-Methods, Problems, and Research Needs, Transportation Research Record 1840, 50-56.
  43. Washington S. P., Mannering F. L. (2003), Statistical and Econometric Methods for Transportation Data Analysis, Chapman & Hall/CRC.
  44. Yuan F. et al. (2001), Safety Benefits of Intersection Approach Realignment on Rural Two-Lane Highways, Transportation Research Record 1758, 21-29.
  45. Yun I. S. et al. (2011), Study of the Effect of the Point-to-Point Speed Enforcement System Using a Comparison-Group Method, Journal of the Korean Society of Road Engineers, 13(4), 177-185.

Cited by

  1. Effect Analysis on Red Light Camera for Signalized Intersection Safety -Focused on Side Right-Angle Collision Accidents- vol.17, pp.1, 2015,
  2. Analysis of Traffic Accident Reduction Effects considering Monitoring Direction of Traffic Camera vol.20, pp.1, 2018,