Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Design and Implementation of a Big Data Analytics Framework based on Cargo DTG Data for Crackdown on Overloaded Trucks

  • Kim, Bum-Soo (Dept. of Future Technology and Convergence Research, Korea Institute of Civil Engineering and Building Technology)
  • Received : 2019.11.25
  • Accepted : 2019.12.16
  • Published : 2019.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we design and implement an analytics platform based on bulk cargo DTG data for crackdown on overloaded trucks. DTG(digital tachograph) is a device that stores the driving record in real time; that is, it is a device that records the vehicle driving related data such as GPS, speed, RPM, braking, and moving distance of the vehicle in one second unit. The fast processing of DTG data is essential for finding vehicle driving patterns and analytics. In particular, a big data analytics platform is required for preprocessing and converting large amounts of DTG data. In this paper, we implement a big data analytics framework based on cargo DTG data using Spark, which is an open source-based big data framework for crackdown on overloaded trucks. As the result of implementation, our proposed platform converts real large cargo DTG data sets into GIS data, and these are visualized by a map. It also recommends crackdown points.

본 논문에서는 과적 화물차량 단속을 위한 대용량 화물 DTG 데이터 분석 플랫폼을 설계 및 구현한다. DTG(digital tachograph)는 차량운행기록을 실시간으로 저장하는 장치로서, 차량의 GPS, 속도, RPM, 제동유무, 이동거리 등 차량운행 관련 데이터가 1초 단위로 기록된다. 차량 운행 패턴 및 분석을 하기 위해서는 DTG 데이터의 빠른 처리가 필수적이며, 특히 대용량 DTG 데이터를 가공 및 변환하기 위해서는 빅데이터 분석 플랫폼이 필요하다. 본 논문에서는 오픈소스 기반의 빅데이터 프레임워크인 스파크(Spark)를 이용하여 과적차량 단속을 위한 대용량 화물 DTG 데이터의 분석 플랫폼을 구현하였다. 구현 결과, 실제 대용량 화물 DTG 데이터를 GIS 데이터로 변환하여 지도상에 표현하고 단속 추천 지점을 보여준다.

Keywords

References

  1. X. Wu, X. Zhu, G. Wu and W. Ding, "Data Mining with Big Data," IEEE Transactions on Knowledge and Data Engineering, Vol. 26, No. 1, pp. 97-107, Jan. 2014. https://doi.org/10.1109/TKDE.2013.109
  2. T.-H. Kim, B.-S. Kim, and J.-U. Kim, "A Study on the Analysis Method for the Optimal Location of Overstrength Restrictions Using Cargo DTG," In Proc. of the KAIS Fall Conference, pp. 1-3, Nov. 2018.
  3. Apache Spark, https://spark.apache.org/
  4. Suwon National Territory Management Office, http://www.molit.go.kr/srocm/intro.do
  5. H. Hu, Y. Wen, T.-S. Chua, and X. Li, "Toward Scalable Systems for Big Data Analytics: A Technology Tutorial," IEEE Access, Vol. 2, No. 8, pp. 652-687, July 2014. https://doi.org/10.1109/ACCESS.2014.2332453
  6. L. Dagum and R. Menon, "OpenMP: An Industry Standard API for Shared-Memory Programming," IEEE Comput. Sci. & Eng. Vol. 5, No. 1, pp. 46-55, Jan./Mar. 1998. https://doi.org/10.1109/99.660313
  7. G. Malewicz, M. H. Austern, A. J.C Bik, J. C. Dehnert, I. Horn, N. Leiser, and G. Czajkowski, "Pregel: a system for large-scale graph processing," in Proc. of the 2010 ACM SIGMOD Int'l Conf. on Manag. Data, Indianapolis, Indiana, pp. 135-146, June 2010.
  8. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters," Communications of the ACM, Vol. 51, No. 1, pp. 107-113, Jan. 2008. https://doi.org/10.1145/1327452.1327492
  9. Apache Hadoop, https://hadoop.apache.org/
  10. Apache Mahout, http://mahout.apache.org/
  11. NGA Office of GEOINT Science (WGS 84), http://earthinfo.nga.mil/GandG/wgs84/index.html
  12. D.-H. Han, S.-H. Kim, J.-J. Park, J.-H. Lee, and J.-H. Kim, "A Study on the Traffic Analysis Method Using Vehicle Trajectory Data," Expressway & Transportation Research Institute, 2017.
  13. L. Cao and J. Krumm, "From GPS Traces to a Routable Road Map," in Proc. of the 17th ACM SIGSPATIAL Int'l Conf. on Adv. in Geo. Inf. Sys., Seattle, Washington, pp. 3-12, Nov. 2009.
  14. J. Krumm, J. Letchner, and E. Horvitz, "Map Matching with Travel Time Constraints," SAE Technical Paper 2007-01-1102, 2007.
  15. S. R. Eddy, "Profile Hidden Markov models," Bioinformatics Review, Vol. 14, No. 9, pp. 755-763, Sept. 1998. https://doi.org/10.1093/bioinformatics/14.9.755
  16. S. Menard, "Applied Logistic Regression Analysis," SAGE Publishing, 2002.
  17. Y. Lou, C. Zhang, X. Xie, Y. Zheng, W. Wang, and Y. Huang, "Map-Matching for Low-Sampling-Rate GPS Trajectories," in Proc. of the 17th ACM SIGSPATIAL Int'l Conf. on Adv. in Geo. Inf. Sys., Seattle, Washington, pp. 352-361, Nov. 2009.
  18. G., Branko, "Convex Polytopes, Graduate Texts in Mathematics," Springer, 2003.
  19. Geocoding XGA Solution, http://www.openmate.co.kr/
  20. OGC GeoServer, http://geoserver.org/
  21. Open Data Portal, https://www.data.go.kr/
  22. Construction CALS System, https://www.calspia.go.kr/